Sep 15 21:23:53.108654 ip-10-0-133-42 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 15 21:23:53.108665 ip-10-0-133-42 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 15 21:23:53.108672 ip-10-0-133-42 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 15 21:23:53.108861 ip-10-0-133-42 systemd[1]: Failed to start Kubernetes Kubelet. Sep 15 21:24:03.158159 ip-10-0-133-42 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 15 21:24:03.158180 ip-10-0-133-42 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 8d1f45de3c724569b271dd088b4ded27 -- Sep 15 21:25:45.297147 ip-10-0-133-42 systemd[1]: Starting Kubernetes Kubelet... Sep 15 21:25:45.705075 ip-10-0-133-42 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 15 21:25:45.705075 ip-10-0-133-42 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 15 21:25:45.705075 ip-10-0-133-42 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 15 21:25:45.705075 ip-10-0-133-42 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 15 21:25:45.705075 ip-10-0-133-42 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 15 21:25:45.705983 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.705826 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 15 21:25:45.709523 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709507 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 21:25:45.709523 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709522 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 21:25:45.709576 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709526 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 21:25:45.709576 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709529 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 21:25:45.709576 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709533 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 21:25:45.709576 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709537 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 21:25:45.709576 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709540 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 21:25:45.709576 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709543 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 21:25:45.709576 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709546 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 21:25:45.709576 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709549 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 21:25:45.709576 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709552 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 21:25:45.709576 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709554 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 21:25:45.709576 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709557 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 21:25:45.709576 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709559 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 21:25:45.709576 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709562 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 21:25:45.709576 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709564 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 21:25:45.709576 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709567 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 21:25:45.709576 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709570 2573 feature_gate.go:328] unrecognized feature gate: Example Sep 15 21:25:45.709576 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709572 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 21:25:45.709576 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709575 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 21:25:45.709576 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709578 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 21:25:45.709576 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709581 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 21:25:45.710130 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709584 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 21:25:45.710130 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709587 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 21:25:45.710130 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709589 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 21:25:45.710130 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709592 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 21:25:45.710130 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709596 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 21:25:45.710130 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709599 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 21:25:45.710130 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709601 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 21:25:45.710130 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709605 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 21:25:45.710130 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709610 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 21:25:45.710130 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709612 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 21:25:45.710130 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709615 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 21:25:45.710130 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709619 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 21:25:45.710130 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709624 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 21:25:45.710130 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709627 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 21:25:45.710130 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709630 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 21:25:45.710130 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709633 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 21:25:45.710130 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709637 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 21:25:45.710130 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709640 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 21:25:45.710654 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709643 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 21:25:45.710654 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709645 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 21:25:45.710654 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709648 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 21:25:45.710654 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709650 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 21:25:45.710654 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709653 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 21:25:45.710654 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709656 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 21:25:45.710654 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709658 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 21:25:45.710654 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709661 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 21:25:45.710654 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709664 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 21:25:45.710654 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709666 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 21:25:45.710654 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709669 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 21:25:45.710654 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709671 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 21:25:45.710654 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709674 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 21:25:45.710654 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709677 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 21:25:45.710654 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709680 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 21:25:45.710654 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709683 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 21:25:45.710654 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709685 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 21:25:45.710654 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709688 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 21:25:45.710654 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709691 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 21:25:45.711140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709694 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 21:25:45.711140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709696 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 21:25:45.711140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709699 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 21:25:45.711140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709702 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 21:25:45.711140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709704 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 21:25:45.711140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709707 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 21:25:45.711140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709710 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 21:25:45.711140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709713 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 21:25:45.711140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709715 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 21:25:45.711140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709718 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 21:25:45.711140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709720 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 21:25:45.711140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709723 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 21:25:45.711140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709725 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 21:25:45.711140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709728 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 21:25:45.711140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709731 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 21:25:45.711140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709733 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 21:25:45.711140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709736 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 21:25:45.711140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709738 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 21:25:45.711140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709742 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 21:25:45.711140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709744 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 21:25:45.711629 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709747 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 21:25:45.711629 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709749 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 21:25:45.711629 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709752 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 21:25:45.711629 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709754 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 21:25:45.711629 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709757 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 21:25:45.711629 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709759 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 21:25:45.711629 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709762 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 21:25:45.711629 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709765 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 21:25:45.711629 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709768 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 21:25:45.711629 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709771 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 21:25:45.711629 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709774 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 21:25:45.711629 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709776 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 21:25:45.711629 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709779 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 21:25:45.711629 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709782 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 21:25:45.711629 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709784 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 21:25:45.711629 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709787 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 21:25:45.711629 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709789 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 21:25:45.711629 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709792 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 21:25:45.711629 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709794 2573 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 21:25:45.711629 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.709797 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 21:25:45.712143 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711388 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 21:25:45.712143 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711395 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 21:25:45.712143 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711399 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 21:25:45.712143 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711402 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 21:25:45.712143 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711405 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 21:25:45.712143 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711408 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 21:25:45.712143 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711410 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 21:25:45.712143 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711413 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 21:25:45.712143 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711416 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 21:25:45.712143 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711418 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 21:25:45.712143 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711421 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 21:25:45.712143 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711424 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 21:25:45.712143 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711427 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 21:25:45.712143 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711430 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 21:25:45.712143 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711432 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 21:25:45.712143 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711435 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 21:25:45.712143 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711439 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 21:25:45.712143 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711442 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 21:25:45.712143 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711445 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 21:25:45.712143 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711448 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 21:25:45.712705 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711451 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 21:25:45.712705 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711454 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 21:25:45.712705 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711456 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 21:25:45.712705 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711459 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 21:25:45.712705 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711462 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 21:25:45.712705 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711464 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 21:25:45.712705 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711467 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 21:25:45.712705 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711470 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 21:25:45.712705 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711472 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 21:25:45.712705 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711475 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 21:25:45.712705 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711478 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 21:25:45.712705 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711481 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 21:25:45.712705 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711483 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 21:25:45.712705 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711486 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 21:25:45.712705 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711488 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 21:25:45.712705 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711491 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 21:25:45.712705 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711493 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 21:25:45.712705 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711495 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 21:25:45.712705 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711498 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 21:25:45.712705 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711500 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 21:25:45.713216 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711502 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 21:25:45.713216 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711505 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 21:25:45.713216 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711508 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 21:25:45.713216 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711510 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 21:25:45.713216 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711513 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 21:25:45.713216 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711516 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 21:25:45.713216 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711518 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 21:25:45.713216 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711521 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 21:25:45.713216 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711523 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 21:25:45.713216 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711526 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 21:25:45.713216 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711528 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 21:25:45.713216 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711531 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 21:25:45.713216 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711534 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 21:25:45.713216 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711537 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 21:25:45.713216 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711539 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 21:25:45.713216 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711542 2573 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 21:25:45.713216 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711544 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 21:25:45.713216 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711547 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 21:25:45.713216 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711549 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 21:25:45.713216 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711553 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 21:25:45.713706 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711555 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 21:25:45.713706 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711558 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 21:25:45.713706 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711560 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 21:25:45.713706 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711563 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 21:25:45.713706 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711566 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 21:25:45.713706 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711568 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 21:25:45.713706 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711571 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 21:25:45.713706 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711573 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 21:25:45.713706 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711577 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 21:25:45.713706 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711580 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 21:25:45.713706 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711584 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 21:25:45.713706 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711586 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 21:25:45.713706 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711589 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 21:25:45.713706 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711591 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 21:25:45.713706 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711594 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 21:25:45.713706 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711596 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 21:25:45.713706 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711599 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 21:25:45.713706 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711602 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 21:25:45.713706 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711605 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 21:25:45.714207 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711607 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 21:25:45.714207 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711610 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 21:25:45.714207 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711613 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 21:25:45.714207 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711616 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 21:25:45.714207 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711619 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 21:25:45.714207 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711623 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 21:25:45.714207 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711626 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 21:25:45.714207 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711628 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 21:25:45.714207 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711631 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 21:25:45.714207 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711634 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 21:25:45.714207 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711637 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 21:25:45.714207 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711639 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 21:25:45.714207 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711642 2573 feature_gate.go:328] unrecognized feature gate: Example Sep 15 21:25:45.714207 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711646 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 21:25:45.714207 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711650 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 21:25:45.714207 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711653 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 21:25:45.714207 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711656 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 21:25:45.714207 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711659 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 21:25:45.714207 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711662 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 21:25:45.714675 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.711665 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 21:25:45.714675 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712045 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 21:25:45.714675 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712050 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 21:25:45.714675 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712053 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 21:25:45.714675 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712057 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 21:25:45.714675 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712060 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 21:25:45.714675 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712063 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 21:25:45.714675 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712066 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 21:25:45.714675 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712069 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 21:25:45.714675 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712071 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 21:25:45.714675 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712074 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 21:25:45.714675 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712077 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 21:25:45.714675 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712080 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 21:25:45.714675 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712082 2573 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 21:25:45.714675 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712085 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 21:25:45.714675 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712088 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 21:25:45.714675 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712090 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 21:25:45.714675 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712093 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 21:25:45.714675 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712096 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 21:25:45.714675 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712099 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 21:25:45.715183 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712102 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 21:25:45.715183 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712104 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 21:25:45.715183 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712107 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 21:25:45.715183 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712112 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 21:25:45.715183 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712115 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 21:25:45.715183 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712118 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 21:25:45.715183 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712121 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 21:25:45.715183 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712123 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 21:25:45.715183 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712126 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 21:25:45.715183 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712129 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 21:25:45.715183 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712131 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 21:25:45.715183 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712133 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 21:25:45.715183 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712136 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 21:25:45.715183 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712139 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 21:25:45.715183 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712141 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 21:25:45.715183 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712144 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 21:25:45.715183 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712146 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 21:25:45.715183 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712149 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 21:25:45.715183 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712152 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 21:25:45.715636 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712154 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 21:25:45.715636 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712157 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 21:25:45.715636 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712160 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 21:25:45.715636 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712164 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 21:25:45.715636 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712167 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 21:25:45.715636 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712171 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 21:25:45.715636 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712174 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 21:25:45.715636 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712177 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 21:25:45.715636 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712179 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 21:25:45.715636 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712182 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 21:25:45.715636 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712185 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 21:25:45.715636 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712188 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 21:25:45.715636 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712191 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 21:25:45.715636 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712193 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 21:25:45.715636 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712196 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 21:25:45.715636 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712198 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 21:25:45.715636 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712201 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 21:25:45.715636 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712203 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 21:25:45.715636 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712206 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 21:25:45.715636 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712209 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 21:25:45.716132 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712211 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 21:25:45.716132 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712214 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 21:25:45.716132 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712216 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 21:25:45.716132 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712218 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 21:25:45.716132 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712221 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 21:25:45.716132 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712223 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 21:25:45.716132 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712226 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 21:25:45.716132 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712229 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 21:25:45.716132 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712231 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 21:25:45.716132 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712234 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 21:25:45.716132 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712236 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 21:25:45.716132 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712239 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 21:25:45.716132 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712243 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 21:25:45.716132 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712246 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 21:25:45.716132 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712249 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 21:25:45.716132 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712252 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 21:25:45.716132 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712254 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 21:25:45.716132 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712257 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 21:25:45.716132 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712261 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 21:25:45.716132 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712263 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 21:25:45.716610 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712266 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 21:25:45.716610 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712269 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 21:25:45.716610 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712271 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 21:25:45.716610 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712274 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 21:25:45.716610 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712277 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 21:25:45.716610 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712279 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 21:25:45.716610 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712282 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 21:25:45.716610 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712284 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 21:25:45.716610 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712287 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 21:25:45.716610 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712289 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 21:25:45.716610 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712292 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 21:25:45.716610 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712294 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 21:25:45.716610 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712297 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 21:25:45.716610 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712299 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 21:25:45.716610 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712302 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 21:25:45.716610 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712305 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 21:25:45.716610 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712307 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 21:25:45.716610 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712310 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 21:25:45.716610 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712312 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 21:25:45.716610 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712315 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 21:25:45.717108 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.712317 2573 feature_gate.go:328] unrecognized feature gate: Example Sep 15 21:25:45.717108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.712393 2573 flags.go:64] FLAG: --address="0.0.0.0" Sep 15 21:25:45.717108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.712433 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 15 21:25:45.717108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713026 2573 flags.go:64] FLAG: --anonymous-auth="true" Sep 15 21:25:45.717108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713032 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 15 21:25:45.717108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713036 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 15 21:25:45.717108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713040 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 15 21:25:45.717108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713044 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 15 21:25:45.717108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713048 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 15 21:25:45.717108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713052 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 15 21:25:45.717108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713056 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 15 21:25:45.717108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713060 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 15 21:25:45.717108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713064 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 15 21:25:45.717108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713067 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 15 21:25:45.717108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713070 2573 flags.go:64] FLAG: --cgroup-root="" Sep 15 21:25:45.717108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713074 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 15 21:25:45.717108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713077 2573 flags.go:64] FLAG: --client-ca-file="" Sep 15 21:25:45.717108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713079 2573 flags.go:64] FLAG: --cloud-provider="external" Sep 15 21:25:45.717108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713082 2573 flags.go:64] FLAG: --cluster-dns="[]" Sep 15 21:25:45.717108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713087 2573 flags.go:64] FLAG: --cluster-domain="" Sep 15 21:25:45.717108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713090 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 15 21:25:45.717108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713093 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 15 21:25:45.717108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713096 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 15 21:25:45.717108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713099 2573 flags.go:64] FLAG: --container-log-max-files="5" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713103 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713106 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713109 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713112 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713115 2573 flags.go:64] FLAG: --contention-profiling="false" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713118 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713121 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713124 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713128 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713132 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713134 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713137 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713140 2573 flags.go:64] FLAG: --enable-load-reader="false" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713143 2573 flags.go:64] FLAG: --enable-server="true" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713146 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713151 2573 flags.go:64] FLAG: --event-burst="100" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713154 2573 flags.go:64] FLAG: --event-qps="50" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713157 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713160 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713163 2573 flags.go:64] FLAG: --eviction-hard="" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713167 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713170 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713173 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713176 2573 flags.go:64] FLAG: --eviction-soft="" Sep 15 21:25:45.717693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713179 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 15 21:25:45.718356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713182 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 15 21:25:45.718356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713185 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 15 21:25:45.718356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713188 2573 flags.go:64] FLAG: --experimental-mounter-path="" Sep 15 21:25:45.718356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713191 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 15 21:25:45.718356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713194 2573 flags.go:64] FLAG: --fail-swap-on="true" Sep 15 21:25:45.718356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713196 2573 flags.go:64] FLAG: --feature-gates="" Sep 15 21:25:45.718356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713200 2573 flags.go:64] FLAG: --file-check-frequency="20s" Sep 15 21:25:45.718356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713203 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 15 21:25:45.718356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713206 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 15 21:25:45.718356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713209 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 15 21:25:45.718356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713212 2573 flags.go:64] FLAG: --healthz-port="10248" Sep 15 21:25:45.718356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713215 2573 flags.go:64] FLAG: --help="false" Sep 15 21:25:45.718356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713218 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-133-42.ec2.internal" Sep 15 21:25:45.718356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713221 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 15 21:25:45.718356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713224 2573 flags.go:64] FLAG: --http-check-frequency="20s" Sep 15 21:25:45.718356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713227 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 15 21:25:45.718356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713231 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 15 21:25:45.718356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713234 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 15 21:25:45.718356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713237 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 15 21:25:45.718356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713240 2573 flags.go:64] FLAG: --image-service-endpoint="" Sep 15 21:25:45.718356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713243 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 15 21:25:45.718356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713246 2573 flags.go:64] FLAG: --kube-api-burst="100" Sep 15 21:25:45.718356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713249 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713252 2573 flags.go:64] FLAG: --kube-api-qps="50" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713255 2573 flags.go:64] FLAG: --kube-reserved="" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713258 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713260 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713264 2573 flags.go:64] FLAG: --kubelet-cgroups="" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713267 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713270 2573 flags.go:64] FLAG: --lock-file="" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713272 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713275 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713278 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713283 2573 flags.go:64] FLAG: --log-json-split-stream="false" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713286 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713289 2573 flags.go:64] FLAG: --log-text-split-stream="false" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713291 2573 flags.go:64] FLAG: --logging-format="text" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713294 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713298 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713300 2573 flags.go:64] FLAG: --manifest-url="" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713303 2573 flags.go:64] FLAG: --manifest-url-header="" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713307 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713310 2573 flags.go:64] FLAG: --max-open-files="1000000" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713314 2573 flags.go:64] FLAG: --max-pods="110" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713317 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713320 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713323 2573 flags.go:64] FLAG: --memory-manager-policy="None" Sep 15 21:25:45.718963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713325 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713328 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713331 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713334 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713342 2573 flags.go:64] FLAG: --node-status-max-images="50" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713345 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713348 2573 flags.go:64] FLAG: --oom-score-adj="-999" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713351 2573 flags.go:64] FLAG: --pod-cidr="" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713354 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713360 2573 flags.go:64] FLAG: --pod-manifest-path="" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713363 2573 flags.go:64] FLAG: --pod-max-pids="-1" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713366 2573 flags.go:64] FLAG: --pods-per-core="0" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713369 2573 flags.go:64] FLAG: --port="10250" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713372 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713376 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f51a9f365ae53846" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713379 2573 flags.go:64] FLAG: --qos-reserved="" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713382 2573 flags.go:64] FLAG: --read-only-port="10255" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713384 2573 flags.go:64] FLAG: --register-node="true" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713387 2573 flags.go:64] FLAG: --register-with-taints="" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713391 2573 flags.go:64] FLAG: --registry-burst="10" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713393 2573 flags.go:64] FLAG: --registry-qps="5" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713396 2573 flags.go:64] FLAG: --reserved-cpus="" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713399 2573 flags.go:64] FLAG: --reserved-memory="" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713403 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713406 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 15 21:25:45.719574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713409 2573 flags.go:64] FLAG: --rotate-certificates="false" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713411 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713414 2573 flags.go:64] FLAG: --runonce="false" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713417 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713420 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713423 2573 flags.go:64] FLAG: --seccomp-default="false" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713426 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713435 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713438 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713441 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713445 2573 flags.go:64] FLAG: --storage-driver-password="root" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713448 2573 flags.go:64] FLAG: --storage-driver-secure="false" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713451 2573 flags.go:64] FLAG: --storage-driver-table="stats" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713453 2573 flags.go:64] FLAG: --storage-driver-user="root" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713458 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713462 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713465 2573 flags.go:64] FLAG: --system-cgroups="" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713468 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713474 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713477 2573 flags.go:64] FLAG: --tls-cert-file="" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713480 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713484 2573 flags.go:64] FLAG: --tls-min-version="" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713488 2573 flags.go:64] FLAG: --tls-private-key-file="" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713491 2573 flags.go:64] FLAG: --topology-manager-policy="none" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713494 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 15 21:25:45.720225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713497 2573 flags.go:64] FLAG: --topology-manager-scope="container" Sep 15 21:25:45.720824 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713500 2573 flags.go:64] FLAG: --v="2" Sep 15 21:25:45.720824 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713504 2573 flags.go:64] FLAG: --version="false" Sep 15 21:25:45.720824 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713508 2573 flags.go:64] FLAG: --vmodule="" Sep 15 21:25:45.720824 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713511 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 15 21:25:45.720824 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.713515 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 15 21:25:45.720824 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713636 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 21:25:45.720824 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713640 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 21:25:45.720824 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713644 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 21:25:45.720824 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713647 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 21:25:45.720824 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713651 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 21:25:45.720824 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713655 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 21:25:45.720824 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713658 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 21:25:45.720824 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713664 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 21:25:45.720824 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713667 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 21:25:45.720824 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713670 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 21:25:45.720824 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713672 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 21:25:45.720824 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713675 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 21:25:45.720824 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713677 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 21:25:45.720824 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713680 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 21:25:45.720824 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713683 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 21:25:45.721363 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713688 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 21:25:45.721363 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713690 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 21:25:45.721363 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713693 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 21:25:45.721363 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713696 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 21:25:45.721363 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713698 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 21:25:45.721363 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713701 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 21:25:45.721363 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713704 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 21:25:45.721363 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713707 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 21:25:45.721363 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713710 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 21:25:45.721363 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713713 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 21:25:45.721363 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713716 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 21:25:45.721363 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713719 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 21:25:45.721363 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713721 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 21:25:45.721363 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713724 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 21:25:45.721363 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713727 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 21:25:45.721363 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713729 2573 feature_gate.go:328] unrecognized feature gate: Example Sep 15 21:25:45.721363 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713732 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 21:25:45.721363 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713734 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 21:25:45.721363 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713738 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 21:25:45.721363 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713740 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 21:25:45.721842 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713744 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 21:25:45.721842 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713747 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 21:25:45.721842 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713750 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 21:25:45.721842 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713754 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 21:25:45.721842 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713759 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 21:25:45.721842 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713762 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 21:25:45.721842 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713765 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 21:25:45.721842 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713768 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 21:25:45.721842 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713771 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 21:25:45.721842 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713774 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 21:25:45.721842 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713776 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 21:25:45.721842 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713779 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 21:25:45.721842 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713783 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 21:25:45.721842 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713786 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 21:25:45.721842 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713788 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 21:25:45.721842 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713791 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 21:25:45.721842 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713793 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 21:25:45.721842 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713796 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 21:25:45.721842 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713798 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 21:25:45.722359 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713801 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 21:25:45.722359 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713804 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 21:25:45.722359 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713806 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 21:25:45.722359 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713809 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 21:25:45.722359 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713811 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 21:25:45.722359 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713814 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 21:25:45.722359 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713816 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 21:25:45.722359 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713819 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 21:25:45.722359 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713822 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 21:25:45.722359 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713824 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 21:25:45.722359 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713827 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 21:25:45.722359 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713829 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 21:25:45.722359 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713832 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 21:25:45.722359 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713834 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 21:25:45.722359 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713837 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 21:25:45.722359 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713841 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 21:25:45.722359 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713856 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 21:25:45.722359 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713861 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 21:25:45.722359 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713864 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 21:25:45.722359 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713866 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 21:25:45.722875 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713869 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 21:25:45.722875 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713872 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 21:25:45.722875 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713874 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 21:25:45.722875 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713877 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 21:25:45.722875 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713880 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 21:25:45.722875 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713883 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 21:25:45.722875 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713886 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 21:25:45.722875 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713888 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 21:25:45.722875 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713891 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 21:25:45.722875 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713894 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 21:25:45.722875 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713896 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 21:25:45.722875 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713899 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 21:25:45.722875 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713901 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 21:25:45.722875 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713904 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 21:25:45.722875 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713907 2573 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 21:25:45.722875 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713910 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 21:25:45.722875 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713913 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 21:25:45.722875 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713916 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 21:25:45.722875 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713918 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 21:25:45.722875 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713921 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 21:25:45.723377 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713923 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 21:25:45.723377 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713926 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 21:25:45.723377 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713928 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 21:25:45.723377 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713931 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 21:25:45.723377 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.713934 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 21:25:45.723377 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.714577 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 15 21:25:45.723377 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.721390 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 15 21:25:45.723377 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.721406 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 15 21:25:45.723377 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.721424 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 15 21:25:45.723377 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.721430 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 15 21:25:45.723377 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721483 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 21:25:45.723377 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721488 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 21:25:45.723377 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721491 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 21:25:45.723377 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721495 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 21:25:45.723377 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721498 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 21:25:45.723755 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721500 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 21:25:45.723755 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721503 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 21:25:45.723755 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721508 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 21:25:45.723755 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721511 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 21:25:45.723755 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721515 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 21:25:45.723755 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721518 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 21:25:45.723755 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721521 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 21:25:45.723755 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721524 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 21:25:45.723755 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721526 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 21:25:45.723755 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721529 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 21:25:45.723755 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721532 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 21:25:45.723755 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721534 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 21:25:45.723755 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721537 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 21:25:45.723755 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721540 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 21:25:45.723755 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721543 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 21:25:45.723755 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721546 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 21:25:45.723755 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721548 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 21:25:45.723755 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721551 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 21:25:45.723755 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721554 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 21:25:45.724237 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721557 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 21:25:45.724237 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721559 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 21:25:45.724237 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721562 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 21:25:45.724237 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721565 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 21:25:45.724237 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721567 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 21:25:45.724237 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721570 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 21:25:45.724237 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721574 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 21:25:45.724237 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721576 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 21:25:45.724237 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721579 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 21:25:45.724237 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721582 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 21:25:45.724237 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721584 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 21:25:45.724237 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721587 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 21:25:45.724237 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721589 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 21:25:45.724237 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721592 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 21:25:45.724237 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721594 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 21:25:45.724237 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721597 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 21:25:45.724237 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721599 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 21:25:45.724237 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721602 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 21:25:45.724237 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721605 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 21:25:45.724708 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721607 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 21:25:45.724708 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721610 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 21:25:45.724708 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721613 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 21:25:45.724708 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721615 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 21:25:45.724708 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721618 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 21:25:45.724708 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721620 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 21:25:45.724708 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721623 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 21:25:45.724708 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721625 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 21:25:45.724708 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721628 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 21:25:45.724708 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721631 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 21:25:45.724708 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721634 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 21:25:45.724708 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721637 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 21:25:45.724708 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721639 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 21:25:45.724708 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721642 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 21:25:45.724708 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721644 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 21:25:45.724708 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721647 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 21:25:45.724708 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721649 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 21:25:45.724708 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721652 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 21:25:45.724708 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721655 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 21:25:45.724708 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721658 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 21:25:45.725234 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721661 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 21:25:45.725234 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721663 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 21:25:45.725234 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721666 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 21:25:45.725234 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721668 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 21:25:45.725234 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721671 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 21:25:45.725234 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721674 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 21:25:45.725234 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721677 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 21:25:45.725234 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721680 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 21:25:45.725234 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721682 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 21:25:45.725234 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721685 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 21:25:45.725234 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721687 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 21:25:45.725234 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721690 2573 feature_gate.go:328] unrecognized feature gate: Example Sep 15 21:25:45.725234 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721692 2573 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 21:25:45.725234 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721695 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 21:25:45.725234 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721699 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 21:25:45.725234 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721702 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 21:25:45.725234 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721705 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 21:25:45.725234 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721708 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 21:25:45.725234 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721710 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 21:25:45.725234 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721713 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 21:25:45.725716 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721716 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 21:25:45.725716 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721719 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 21:25:45.725716 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721722 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 21:25:45.725716 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721725 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 21:25:45.725716 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721727 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 21:25:45.725716 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721731 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 21:25:45.725716 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721734 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 21:25:45.725716 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721737 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 21:25:45.725716 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721740 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 21:25:45.725716 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721742 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 21:25:45.725716 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721746 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 21:25:45.725716 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721749 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 21:25:45.725716 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721751 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 21:25:45.725716 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721754 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 21:25:45.725716 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721757 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 21:25:45.725716 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721760 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 21:25:45.726140 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.721766 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 15 21:25:45.726140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721899 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 21:25:45.726140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721905 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 21:25:45.726140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721908 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 21:25:45.726140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721911 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 21:25:45.726140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721913 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 21:25:45.726140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721916 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 21:25:45.726140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721920 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 21:25:45.726140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721924 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 21:25:45.726140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721927 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 21:25:45.726140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721929 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 21:25:45.726140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721932 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 21:25:45.726140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721936 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 21:25:45.726140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721939 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 21:25:45.726485 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721942 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 21:25:45.726485 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721945 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 21:25:45.726485 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721949 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 21:25:45.726485 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721952 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 21:25:45.726485 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721959 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 21:25:45.726485 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721962 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 21:25:45.726485 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721965 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 21:25:45.726485 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721969 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 21:25:45.726485 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721971 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 21:25:45.726485 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721974 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 21:25:45.726485 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721977 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 21:25:45.726485 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721979 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 21:25:45.726485 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721982 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 21:25:45.726485 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721985 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 21:25:45.726485 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721988 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 21:25:45.726485 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721991 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 21:25:45.726485 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721993 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 21:25:45.726485 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721996 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 21:25:45.726485 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.721998 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 21:25:45.727042 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722001 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 21:25:45.727042 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722004 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 21:25:45.727042 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722006 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 21:25:45.727042 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722009 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 21:25:45.727042 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722011 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 21:25:45.727042 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722014 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 21:25:45.727042 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722016 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 21:25:45.727042 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722019 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 21:25:45.727042 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722021 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 21:25:45.727042 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722024 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 21:25:45.727042 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722026 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 21:25:45.727042 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722029 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 21:25:45.727042 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722032 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 21:25:45.727042 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722035 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 21:25:45.727042 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722037 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 21:25:45.727042 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722040 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 21:25:45.727042 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722042 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 21:25:45.727042 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722045 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 21:25:45.727042 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722049 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 21:25:45.727042 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722051 2573 feature_gate.go:328] unrecognized feature gate: Example Sep 15 21:25:45.727521 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722054 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 21:25:45.727521 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722063 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 21:25:45.727521 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722066 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 21:25:45.727521 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722069 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 21:25:45.727521 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722072 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 21:25:45.727521 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722075 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 21:25:45.727521 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722078 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 21:25:45.727521 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722080 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 21:25:45.727521 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722083 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 21:25:45.727521 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722085 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 21:25:45.727521 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722088 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 21:25:45.727521 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722090 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 21:25:45.727521 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722093 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 21:25:45.727521 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722095 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 21:25:45.727521 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722098 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 21:25:45.727521 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722101 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 21:25:45.727521 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722103 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 21:25:45.727521 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722106 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 21:25:45.727521 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722109 2573 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 21:25:45.727521 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722111 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 21:25:45.728038 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722114 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 21:25:45.728038 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722116 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 21:25:45.728038 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722119 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 21:25:45.728038 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722121 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 21:25:45.728038 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722124 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 21:25:45.728038 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722127 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 21:25:45.728038 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722129 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 21:25:45.728038 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722132 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 21:25:45.728038 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722135 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 21:25:45.728038 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722137 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 21:25:45.728038 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722140 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 21:25:45.728038 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722143 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 21:25:45.728038 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722146 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 21:25:45.728038 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722148 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 21:25:45.728038 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722151 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 21:25:45.728038 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722153 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 21:25:45.728038 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722156 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 21:25:45.728038 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722159 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 21:25:45.728038 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722162 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 21:25:45.728038 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722165 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 21:25:45.728512 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722168 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 21:25:45.728512 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722170 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 21:25:45.728512 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722173 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 21:25:45.728512 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722175 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 21:25:45.728512 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722178 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 21:25:45.728512 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722180 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 21:25:45.728512 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:45.722183 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 21:25:45.728512 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.722188 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 15 21:25:45.728512 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.722287 2573 server.go:962] "Client rotation is on, will bootstrap in background" Sep 15 21:25:45.728512 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.724215 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 15 21:25:45.728512 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.725060 2573 server.go:1019] "Starting client certificate rotation" Sep 15 21:25:45.728512 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.725160 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 15 21:25:45.728512 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.725190 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 15 21:25:45.729877 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.729862 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 15 21:25:45.731122 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.731101 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 15 21:25:45.737979 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.737956 2573 log.go:25] "Validated CRI v1 runtime API" Sep 15 21:25:45.740769 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.740753 2573 log.go:25] "Validated CRI v1 image API" Sep 15 21:25:45.741563 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.741539 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 15 21:25:45.745489 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.745469 2573 fs.go:135] Filesystem UUIDs: map[4afb0038-cfcd-42f3-a3bc-e4b79cadfac7:/dev/nvme0n1p3 5caf628e-ac67-4404-9229-e6198ecff58c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 15 21:25:45.745552 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.745488 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 15 21:25:45.751209 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.751087 2573 manager.go:216] Machine: {Timestamp:2026-09-15 21:25:45.749188832 +0000 UTC m=+0.335786414 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102324 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20a2c552d513b33b916492d4d723b5 SystemUUID:ec20a2c5-52d5-13b3-3b91-6492d4d723b5 BootID:8d1f45de-3c72-4569-b271-dd088b4ded27 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d8:d5:a6:cb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d8:d5:a6:cb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:66:c9:0e:6d:4f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 15 21:25:45.751209 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.751204 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 15 21:25:45.751334 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.751313 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 15 21:25:45.753475 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.753449 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 15 21:25:45.753647 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.753478 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-42.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 15 21:25:45.754676 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.754663 2573 topology_manager.go:138] "Creating topology manager with none policy" Sep 15 21:25:45.754742 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.754681 2573 container_manager_linux.go:309] "Creating device plugin manager" Sep 15 21:25:45.754742 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.754695 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 15 21:25:45.757038 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.757025 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 15 21:25:45.758428 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.758416 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 15 21:25:45.758973 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.758956 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 15 21:25:45.763988 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.763974 2573 state_mem.go:36] "Initialized new in-memory state store" Sep 15 21:25:45.764144 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.764132 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 15 21:25:45.764205 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.764170 2573 kubelet.go:486] "Attempting to sync node with API server" Sep 15 21:25:45.764205 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.764186 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 15 21:25:45.764205 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.764205 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 15 21:25:45.764330 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.764220 2573 kubelet.go:398] "Adding apiserver pod source" Sep 15 21:25:45.764330 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.764233 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 15 21:25:45.764728 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.764699 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 15 21:25:45.764802 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.764737 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 15 21:25:45.766805 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.766790 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 15 21:25:45.768694 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.768681 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 15 21:25:45.768738 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.768712 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 15 21:25:45.770646 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.770634 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 15 21:25:45.770695 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.770651 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 15 21:25:45.770695 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.770657 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 15 21:25:45.770695 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.770664 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 15 21:25:45.770695 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.770676 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 15 21:25:45.770695 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.770684 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 15 21:25:45.770838 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.770698 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 15 21:25:45.770838 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.770703 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 15 21:25:45.770838 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.770711 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 15 21:25:45.770838 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.770717 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 15 21:25:45.770838 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.770732 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 15 21:25:45.770838 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.770737 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 15 21:25:45.771432 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.771421 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 15 21:25:45.771463 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.771436 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 15 21:25:45.774112 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.774090 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-42.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 15 21:25:45.774761 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:45.774739 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 15 21:25:45.774761 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:45.774746 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-42.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 15 21:25:45.775715 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.775701 2573 server.go:1268] "Started kubelet" Sep 15 21:25:45.775812 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.775788 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 15 21:25:45.775920 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.775864 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 15 21:25:45.775977 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.775938 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 15 21:25:45.777482 ip-10-0-133-42 systemd[1]: Started Kubernetes Kubelet. Sep 15 21:25:45.781134 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.780544 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 15 21:25:45.783006 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:45.782980 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 15 21:25:45.783524 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.783510 2573 server.go:310] "Adding debug handlers to kubelet server" Sep 15 21:25:45.784786 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:45.783632 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-42.ec2.internal.18d59ba1b4d6ff4e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-42.ec2.internal,UID:ip-10-0-133-42.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-42.ec2.internal,},FirstTimestamp:2026-09-15 21:25:45.77566907 +0000 UTC m=+0.362266653,LastTimestamp:2026-09-15 21:25:45.77566907 +0000 UTC m=+0.362266653,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-42.ec2.internal,}" Sep 15 21:25:45.784926 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.784912 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 15 21:25:45.784971 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.784922 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 15 21:25:45.785038 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:45.785021 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-42.ec2.internal\" not found" Sep 15 21:25:45.785585 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.785571 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 15 21:25:45.785667 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.785596 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 15 21:25:45.785667 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.785621 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 15 21:25:45.785761 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.785710 2573 reconstruct.go:97] "Volume reconstruction finished" Sep 15 21:25:45.785761 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.785719 2573 reconciler.go:29] "Reconciler: start to sync state" Sep 15 21:25:45.785933 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.785918 2573 factory.go:55] Registering systemd factory Sep 15 21:25:45.785998 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.785938 2573 factory.go:223] Registration of the systemd container factory successfully Sep 15 21:25:45.786813 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.786792 2573 factory.go:153] Registering CRI-O factory Sep 15 21:25:45.786930 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.786919 2573 factory.go:223] Registration of the crio container factory successfully Sep 15 21:25:45.787087 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.787062 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 15 21:25:45.787199 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.787177 2573 factory.go:103] Registering Raw factory Sep 15 21:25:45.787199 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.787200 2573 manager.go:1196] Started watching for new ooms in manager Sep 15 21:25:45.787783 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.787662 2573 manager.go:349] Starting recovery of all containers Sep 15 21:25:45.792799 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:45.792773 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-42.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 15 21:25:45.792957 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:45.792938 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 15 21:25:45.798352 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.798310 2573 manager.go:354] Recovery completed Sep 15 21:25:45.803952 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.803937 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 21:25:45.804960 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.804941 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gg2df" Sep 15 21:25:45.806213 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.806199 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeHasSufficientMemory" Sep 15 21:25:45.806294 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.806225 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 21:25:45.806294 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.806235 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeHasSufficientPID" Sep 15 21:25:45.806945 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.806928 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 15 21:25:45.806945 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.806945 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 15 21:25:45.807070 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.806963 2573 state_mem.go:36] "Initialized new in-memory state store" Sep 15 21:25:45.807070 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.806964 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 21:25:45.807790 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.807772 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeHasSufficientMemory" Sep 15 21:25:45.807897 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.807806 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 21:25:45.807897 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.807823 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeHasSufficientPID" Sep 15 21:25:45.807897 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:45.807773 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-42.ec2.internal.18d59ba1b6a90bb5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-42.ec2.internal,UID:ip-10-0-133-42.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-42.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-42.ec2.internal,},FirstTimestamp:2026-09-15 21:25:45.806212021 +0000 UTC m=+0.392809604,LastTimestamp:2026-09-15 21:25:45.806212021 +0000 UTC m=+0.392809604,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-42.ec2.internal,}" Sep 15 21:25:45.809166 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.809148 2573 policy_none.go:49] "None policy: Start" Sep 15 21:25:45.809166 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.809167 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 15 21:25:45.809269 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.809177 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 15 21:25:45.811122 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.811111 2573 policy_none.go:47] "Start" Sep 15 21:25:45.812773 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.812755 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gg2df" Sep 15 21:25:45.818530 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:45.818465 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-42.ec2.internal.18d59ba1b6a94eba default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-42.ec2.internal,UID:ip-10-0-133-42.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-42.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-42.ec2.internal,},FirstTimestamp:2026-09-15 21:25:45.806229178 +0000 UTC m=+0.392826762,LastTimestamp:2026-09-15 21:25:45.806229178 +0000 UTC m=+0.392826762,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-42.ec2.internal,}" Sep 15 21:25:45.841549 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.841529 2573 manager.go:337] "Starting Device Plugin manager" Sep 15 21:25:45.866384 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:45.841570 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 15 21:25:45.866384 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.841584 2573 server.go:87] "Starting device plugin registration server" Sep 15 21:25:45.866384 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.841878 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 15 21:25:45.866384 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.841891 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 15 21:25:45.866384 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.842076 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 15 21:25:45.866384 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.842145 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 15 21:25:45.866384 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.842153 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 15 21:25:45.866384 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:45.842682 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 15 21:25:45.866384 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:45.842728 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-42.ec2.internal\" not found" Sep 15 21:25:45.925919 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.925880 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 15 21:25:45.927099 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.927073 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 15 21:25:45.927223 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.927138 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 15 21:25:45.927223 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.927166 2573 kubelet.go:2448] "Starting kubelet main sync loop" Sep 15 21:25:45.927319 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:45.927270 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 15 21:25:45.929241 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.929218 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 21:25:45.942841 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.942819 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 21:25:45.943823 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.943802 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeHasSufficientMemory" Sep 15 21:25:45.943969 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.943840 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 21:25:45.943969 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.943873 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeHasSufficientPID" Sep 15 21:25:45.943969 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.943910 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-42.ec2.internal" Sep 15 21:25:45.952912 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:45.952892 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-42.ec2.internal" Sep 15 21:25:45.953003 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:45.952919 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-42.ec2.internal\": node \"ip-10-0-133-42.ec2.internal\" not found" Sep 15 21:25:45.983002 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:45.982933 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-42.ec2.internal\" not found" Sep 15 21:25:46.028071 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.028038 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-42.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-42.ec2.internal"] Sep 15 21:25:46.028179 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.028122 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 21:25:46.029137 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.029123 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeHasSufficientMemory" Sep 15 21:25:46.029204 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.029149 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 21:25:46.029204 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.029159 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeHasSufficientPID" Sep 15 21:25:46.031502 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.031489 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 21:25:46.031663 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.031649 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-42.ec2.internal" Sep 15 21:25:46.031699 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.031679 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 21:25:46.032308 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.032289 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeHasSufficientMemory" Sep 15 21:25:46.032419 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.032322 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 21:25:46.032419 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.032335 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeHasSufficientPID" Sep 15 21:25:46.032419 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.032291 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeHasSufficientMemory" Sep 15 21:25:46.032419 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.032392 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 21:25:46.032419 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.032403 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeHasSufficientPID" Sep 15 21:25:46.034511 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.034495 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-42.ec2.internal" Sep 15 21:25:46.034564 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.034527 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 21:25:46.035200 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.035181 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeHasSufficientMemory" Sep 15 21:25:46.035288 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.035216 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 21:25:46.035288 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.035228 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeHasSufficientPID" Sep 15 21:25:46.058718 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:46.058692 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-42.ec2.internal\" not found" node="ip-10-0-133-42.ec2.internal" Sep 15 21:25:46.063244 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:46.063228 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-42.ec2.internal\" not found" node="ip-10-0-133-42.ec2.internal" Sep 15 21:25:46.083515 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:46.083492 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-42.ec2.internal\" not found" Sep 15 21:25:46.087837 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.087821 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ebda7109db35594966aa86204551c00-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-42.ec2.internal\" (UID: \"8ebda7109db35594966aa86204551c00\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-42.ec2.internal" Sep 15 21:25:46.087913 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.087858 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ebda7109db35594966aa86204551c00-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-42.ec2.internal\" (UID: \"8ebda7109db35594966aa86204551c00\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-42.ec2.internal" Sep 15 21:25:46.087913 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.087876 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc2afcdcc5cf9fb90dbda3c38c71226a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-42.ec2.internal\" (UID: \"fc2afcdcc5cf9fb90dbda3c38c71226a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-42.ec2.internal" Sep 15 21:25:46.184056 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:46.183877 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-42.ec2.internal\" not found" Sep 15 21:25:46.188255 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.188236 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ebda7109db35594966aa86204551c00-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-42.ec2.internal\" (UID: \"8ebda7109db35594966aa86204551c00\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-42.ec2.internal" Sep 15 21:25:46.188314 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.188263 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ebda7109db35594966aa86204551c00-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-42.ec2.internal\" (UID: \"8ebda7109db35594966aa86204551c00\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-42.ec2.internal" Sep 15 21:25:46.188314 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.188282 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc2afcdcc5cf9fb90dbda3c38c71226a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-42.ec2.internal\" (UID: \"fc2afcdcc5cf9fb90dbda3c38c71226a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-42.ec2.internal" Sep 15 21:25:46.188375 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.188353 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ebda7109db35594966aa86204551c00-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-42.ec2.internal\" (UID: \"8ebda7109db35594966aa86204551c00\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-42.ec2.internal" Sep 15 21:25:46.188411 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.188400 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc2afcdcc5cf9fb90dbda3c38c71226a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-42.ec2.internal\" (UID: \"fc2afcdcc5cf9fb90dbda3c38c71226a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-42.ec2.internal" Sep 15 21:25:46.188451 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.188439 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ebda7109db35594966aa86204551c00-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-42.ec2.internal\" (UID: \"8ebda7109db35594966aa86204551c00\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-42.ec2.internal" Sep 15 21:25:46.284299 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:46.284263 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-42.ec2.internal\" not found" Sep 15 21:25:46.362721 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.362673 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-42.ec2.internal" Sep 15 21:25:46.366055 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.366028 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-42.ec2.internal" Sep 15 21:25:46.385181 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:46.385146 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-42.ec2.internal\" not found" Sep 15 21:25:46.489551 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:46.489508 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-42.ec2.internal\" not found" Sep 15 21:25:46.590361 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:46.590245 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-42.ec2.internal\" not found" Sep 15 21:25:46.595998 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.595971 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 21:25:46.690797 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:46.690760 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-42.ec2.internal\" not found" Sep 15 21:25:46.726239 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.726193 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 15 21:25:46.727014 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.726432 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 15 21:25:46.727014 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.726437 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 15 21:25:46.791147 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:46.791115 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-42.ec2.internal\" not found" Sep 15 21:25:46.799188 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.799165 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 21:25:46.817396 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.817351 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 21:20:46 +0000 UTC" deadline="2028-04-12 10:55:48.901011721 +0000 UTC" Sep 15 21:25:46.817396 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.817389 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13789h30m2.08362723s" Sep 15 21:25:46.874701 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.874638 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 21:25:46.875820 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.875802 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeHasSufficientMemory" Sep 15 21:25:46.875941 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.875835 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 21:25:46.875941 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.875854 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeHasSufficientPID" Sep 15 21:25:46.891555 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:46.891530 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-42.ec2.internal\" not found" Sep 15 21:25:46.918444 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.918421 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 21:25:46.985365 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.985327 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-42.ec2.internal" Sep 15 21:25:46.992824 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.992794 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 15 21:25:46.993820 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:46.993792 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-42.ec2.internal" Sep 15 21:25:47.005509 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.005486 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 15 21:25:47.109550 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:47.109508 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ebda7109db35594966aa86204551c00.slice/crio-16b1d670aa518c0b38903c8ab6431c88a6d1eac23bcc7e40bfa251a47bfad66c WatchSource:0}: Error finding container 16b1d670aa518c0b38903c8ab6431c88a6d1eac23bcc7e40bfa251a47bfad66c: Status 404 returned error can't find the container with id 16b1d670aa518c0b38903c8ab6431c88a6d1eac23bcc7e40bfa251a47bfad66c Sep 15 21:25:47.109803 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:47.109785 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc2afcdcc5cf9fb90dbda3c38c71226a.slice/crio-a354e125b9c9a9bf71945eb2afd65a896d51d6efdea69f75de63cb0788206a33 WatchSource:0}: Error finding container a354e125b9c9a9bf71945eb2afd65a896d51d6efdea69f75de63cb0788206a33: Status 404 returned error can't find the container with id a354e125b9c9a9bf71945eb2afd65a896d51d6efdea69f75de63cb0788206a33 Sep 15 21:25:47.118101 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.118084 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 21:25:47.601778 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.601741 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 21:25:47.766383 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.766340 2573 apiserver.go:52] "Watching apiserver" Sep 15 21:25:47.779800 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.779769 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 15 21:25:47.780183 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.780157 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-5xbf5","openshift-multus/network-metrics-daemon-852v2","openshift-network-diagnostics/network-check-target-tvvlc","kube-system/global-pull-secret-syncer-z22rp","openshift-cluster-node-tuning-operator/tuned-9mmbr","openshift-dns/node-resolver-6pvrb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-42.ec2.internal","openshift-network-operator/iptables-alerter-zxk5d","openshift-ovn-kubernetes/ovnkube-node-f8w9j","kube-system/konnectivity-agent-cc5cc","kube-system/kube-apiserver-proxy-ip-10-0-133-42.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp","openshift-image-registry/node-ca-8qm2x","openshift-multus/multus-5vskw"] Sep 15 21:25:47.784271 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.784246 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cc5cc" Sep 15 21:25:47.786316 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.786291 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 15 21:25:47.786434 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.786421 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8qm2x" Sep 15 21:25:47.786911 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.786876 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 15 21:25:47.787064 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.787048 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tm8hk\"" Sep 15 21:25:47.787165 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.787151 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 15 21:25:47.788708 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.788685 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:25:47.788826 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.788760 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 15 21:25:47.788826 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.788794 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-h5x6x\"" Sep 15 21:25:47.788969 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:47.788756 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvlc" podUID="23c8693a-bbba-4f16-951a-9f0516862649" Sep 15 21:25:47.789063 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.789048 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 15 21:25:47.789122 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.789079 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 15 21:25:47.790904 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.790882 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:25:47.791003 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:47.790953 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z22rp" podUID="ef06c19b-a992-4624-948e-2d0db582f824" Sep 15 21:25:47.793212 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.793195 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:47.795676 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.795655 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6pvrb" Sep 15 21:25:47.795771 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.795697 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mb6wk\"" Sep 15 21:25:47.795964 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.795939 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 15 21:25:47.796213 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.796199 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 15 21:25:47.797942 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.797916 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d-agent-certs\") pod \"konnectivity-agent-cc5cc\" (UID: \"9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d\") " pod="kube-system/konnectivity-agent-cc5cc" Sep 15 21:25:47.798024 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.797973 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d-konnectivity-ca\") pod \"konnectivity-agent-cc5cc\" (UID: \"9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d\") " pod="kube-system/konnectivity-agent-cc5cc" Sep 15 21:25:47.798024 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.797997 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2da7d8f4-3fa7-4d76-86b9-1f22852adcef-host\") pod \"node-ca-8qm2x\" (UID: \"2da7d8f4-3fa7-4d76-86b9-1f22852adcef\") " pod="openshift-image-registry/node-ca-8qm2x" Sep 15 21:25:47.798024 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.798019 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2da7d8f4-3fa7-4d76-86b9-1f22852adcef-serviceca\") pod \"node-ca-8qm2x\" (UID: \"2da7d8f4-3fa7-4d76-86b9-1f22852adcef\") " pod="openshift-image-registry/node-ca-8qm2x" Sep 15 21:25:47.798193 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.798040 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5vv7\" (UniqueName: \"kubernetes.io/projected/23c8693a-bbba-4f16-951a-9f0516862649-kube-api-access-p5vv7\") pod \"network-check-target-tvvlc\" (UID: \"23c8693a-bbba-4f16-951a-9f0516862649\") " pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:25:47.798193 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.798104 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg9xk\" (UniqueName: \"kubernetes.io/projected/2da7d8f4-3fa7-4d76-86b9-1f22852adcef-kube-api-access-mg9xk\") pod \"node-ca-8qm2x\" (UID: \"2da7d8f4-3fa7-4d76-86b9-1f22852adcef\") " pod="openshift-image-registry/node-ca-8qm2x" Sep 15 21:25:47.798193 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.798172 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 15 21:25:47.798357 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.798237 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 15 21:25:47.798357 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.798274 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7rgs9\"" Sep 15 21:25:47.798357 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.798288 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:47.798502 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.798274 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 15 21:25:47.800854 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.800836 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5vskw" Sep 15 21:25:47.800963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.800883 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 15 21:25:47.801944 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.801913 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 15 21:25:47.801944 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.801927 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 15 21:25:47.801944 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.801933 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 15 21:25:47.801944 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.801914 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-25bms\"" Sep 15 21:25:47.802187 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.801954 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 15 21:25:47.802187 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.801955 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 15 21:25:47.803036 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.803021 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 15 21:25:47.803374 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.803338 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:25:47.803374 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.803363 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 15 21:25:47.803517 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.803411 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wfls6\"" Sep 15 21:25:47.803517 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:47.803415 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-852v2" podUID="9c225a82-b10a-42c0-8491-d3a70e1fb117" Sep 15 21:25:47.803517 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.803364 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 15 21:25:47.804055 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.804035 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 15 21:25:47.806472 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.806450 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5xbf5" Sep 15 21:25:47.809147 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.809128 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nzw9t\"" Sep 15 21:25:47.809258 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.809148 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zxk5d" Sep 15 21:25:47.809258 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.809166 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 15 21:25:47.809412 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.809258 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 15 21:25:47.812369 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.812343 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 15 21:25:47.812552 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.812531 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" Sep 15 21:25:47.812696 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.812676 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 15 21:25:47.813873 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.813846 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 15 21:25:47.814079 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.814062 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pb8bj\"" Sep 15 21:25:47.816618 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.816595 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 15 21:25:47.816618 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.816613 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 15 21:25:47.816765 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.816695 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7nrtm\"" Sep 15 21:25:47.816891 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.816873 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 15 21:25:47.827660 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.827641 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gppt9" Sep 15 21:25:47.835905 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.835880 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gppt9" Sep 15 21:25:47.886915 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.886834 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 15 21:25:47.899017 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.898991 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-multus-cni-dir\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:47.899130 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899020 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-etc-systemd\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:47.899130 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899038 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-run\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:47.899130 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899058 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-lib-modules\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:47.899130 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899080 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-run-openvswitch\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:47.899260 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899135 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-log-socket\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:47.899260 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899167 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2da7d8f4-3fa7-4d76-86b9-1f22852adcef-host\") pod \"node-ca-8qm2x\" (UID: \"2da7d8f4-3fa7-4d76-86b9-1f22852adcef\") " pod="openshift-image-registry/node-ca-8qm2x" Sep 15 21:25:47.899260 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899193 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/47acebf0-6334-4091-8f05-726f7dccd8fc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5xbf5\" (UID: \"47acebf0-6334-4091-8f05-726f7dccd8fc\") " pod="openshift-multus/multus-additional-cni-plugins-5xbf5" Sep 15 21:25:47.899260 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899220 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-etc-openvswitch\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:47.899260 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899239 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2da7d8f4-3fa7-4d76-86b9-1f22852adcef-host\") pod \"node-ca-8qm2x\" (UID: \"2da7d8f4-3fa7-4d76-86b9-1f22852adcef\") " pod="openshift-image-registry/node-ca-8qm2x" Sep 15 21:25:47.899260 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899249 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-host-run-ovn-kubernetes\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:47.899450 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899277 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-host-cni-bin\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:47.899450 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899293 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bfa4b609-5081-473c-99ad-3371ea123f62-env-overrides\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:47.899450 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899308 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bfa4b609-5081-473c-99ad-3371ea123f62-ovn-node-metrics-cert\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:47.899450 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899325 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg9xk\" (UniqueName: \"kubernetes.io/projected/2da7d8f4-3fa7-4d76-86b9-1f22852adcef-kube-api-access-mg9xk\") pod \"node-ca-8qm2x\" (UID: \"2da7d8f4-3fa7-4d76-86b9-1f22852adcef\") " pod="openshift-image-registry/node-ca-8qm2x" Sep 15 21:25:47.899450 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899340 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c225a82-b10a-42c0-8491-d3a70e1fb117-metrics-certs\") pod \"network-metrics-daemon-852v2\" (UID: \"9c225a82-b10a-42c0-8491-d3a70e1fb117\") " pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:25:47.899450 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899354 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bfa4b609-5081-473c-99ad-3371ea123f62-ovnkube-config\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:47.899450 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899384 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2da7d8f4-3fa7-4d76-86b9-1f22852adcef-serviceca\") pod \"node-ca-8qm2x\" (UID: \"2da7d8f4-3fa7-4d76-86b9-1f22852adcef\") " pod="openshift-image-registry/node-ca-8qm2x" Sep 15 21:25:47.899450 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899448 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-host-var-lib-cni-bin\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:47.899694 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899503 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-host-var-lib-cni-multus\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:47.899694 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899529 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-host-var-lib-kubelet\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:47.899694 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899563 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-969bh\" (UniqueName: \"kubernetes.io/projected/47acebf0-6334-4091-8f05-726f7dccd8fc-kube-api-access-969bh\") pod \"multus-additional-cni-plugins-5xbf5\" (UID: \"47acebf0-6334-4091-8f05-726f7dccd8fc\") " pod="openshift-multus/multus-additional-cni-plugins-5xbf5" Sep 15 21:25:47.899694 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899578 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/90ded5f5-da0a-4177-93b0-5cd1b21f495c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-48mzp\" (UID: \"90ded5f5-da0a-4177-93b0-5cd1b21f495c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" Sep 15 21:25:47.899694 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899600 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/90ded5f5-da0a-4177-93b0-5cd1b21f495c-sys-fs\") pod \"aws-ebs-csi-driver-node-48mzp\" (UID: \"90ded5f5-da0a-4177-93b0-5cd1b21f495c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" Sep 15 21:25:47.899694 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899615 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-host-run-netns\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:47.899694 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899630 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-host-run-multus-certs\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:47.899694 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899664 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ef06c19b-a992-4624-948e-2d0db582f824-dbus\") pod \"global-pull-secret-syncer-z22rp\" (UID: \"ef06c19b-a992-4624-948e-2d0db582f824\") " pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:25:47.899694 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899692 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3df5fab-3b41-4274-ba5f-dff5143b9192-tmp-dir\") pod \"node-resolver-6pvrb\" (UID: \"e3df5fab-3b41-4274-ba5f-dff5143b9192\") " pod="openshift-dns/node-resolver-6pvrb" Sep 15 21:25:47.900009 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899710 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1bd338b0-a780-4a53-8ba5-bee6ac944e0c-iptables-alerter-script\") pod \"iptables-alerter-zxk5d\" (UID: \"1bd338b0-a780-4a53-8ba5-bee6ac944e0c\") " pod="openshift-network-operator/iptables-alerter-zxk5d" Sep 15 21:25:47.900009 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899727 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-var-lib-openvswitch\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:47.900009 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899763 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d-konnectivity-ca\") pod \"konnectivity-agent-cc5cc\" (UID: \"9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d\") " pod="kube-system/konnectivity-agent-cc5cc" Sep 15 21:25:47.900009 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899796 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbpln\" (UniqueName: \"kubernetes.io/projected/9c225a82-b10a-42c0-8491-d3a70e1fb117-kube-api-access-jbpln\") pod \"network-metrics-daemon-852v2\" (UID: \"9c225a82-b10a-42c0-8491-d3a70e1fb117\") " pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:25:47.900009 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899823 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/90ded5f5-da0a-4177-93b0-5cd1b21f495c-device-dir\") pod \"aws-ebs-csi-driver-node-48mzp\" (UID: \"90ded5f5-da0a-4177-93b0-5cd1b21f495c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" Sep 15 21:25:47.900009 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899849 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw2xz\" (UniqueName: \"kubernetes.io/projected/90ded5f5-da0a-4177-93b0-5cd1b21f495c-kube-api-access-mw2xz\") pod \"aws-ebs-csi-driver-node-48mzp\" (UID: \"90ded5f5-da0a-4177-93b0-5cd1b21f495c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" Sep 15 21:25:47.900009 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899864 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2da7d8f4-3fa7-4d76-86b9-1f22852adcef-serviceca\") pod \"node-ca-8qm2x\" (UID: \"2da7d8f4-3fa7-4d76-86b9-1f22852adcef\") " pod="openshift-image-registry/node-ca-8qm2x" Sep 15 21:25:47.900009 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899891 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjvcj\" (UniqueName: \"kubernetes.io/projected/bfa4b609-5081-473c-99ad-3371ea123f62-kube-api-access-zjvcj\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:47.900009 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899914 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-hostroot\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:47.900009 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899939 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/90ded5f5-da0a-4177-93b0-5cd1b21f495c-etc-selinux\") pod \"aws-ebs-csi-driver-node-48mzp\" (UID: \"90ded5f5-da0a-4177-93b0-5cd1b21f495c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" Sep 15 21:25:47.900009 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899962 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-run-systemd\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:47.900009 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.899986 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-run-ovn\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:47.900009 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900010 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-node-log\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:47.900498 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900072 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bfa4b609-5081-473c-99ad-3371ea123f62-ovnkube-script-lib\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:47.900498 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900099 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-multus-socket-dir-parent\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:47.900498 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900123 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/04c2e99d-ecdc-440d-847f-c443e6111773-multus-daemon-config\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:47.900498 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900152 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef06c19b-a992-4624-948e-2d0db582f824-original-pull-secret\") pod \"global-pull-secret-syncer-z22rp\" (UID: \"ef06c19b-a992-4624-948e-2d0db582f824\") " pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:25:47.900498 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900191 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvm6c\" (UniqueName: \"kubernetes.io/projected/e3df5fab-3b41-4274-ba5f-dff5143b9192-kube-api-access-hvm6c\") pod \"node-resolver-6pvrb\" (UID: \"e3df5fab-3b41-4274-ba5f-dff5143b9192\") " pod="openshift-dns/node-resolver-6pvrb" Sep 15 21:25:47.900498 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900226 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-etc-kubernetes\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:47.900498 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900258 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:47.900498 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900292 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/90ded5f5-da0a-4177-93b0-5cd1b21f495c-registration-dir\") pod \"aws-ebs-csi-driver-node-48mzp\" (UID: \"90ded5f5-da0a-4177-93b0-5cd1b21f495c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" Sep 15 21:25:47.900498 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900315 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-etc-sysctl-conf\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:47.900498 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900331 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b132d136-68e9-45bc-b66e-997a34382d84-etc-tuned\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:47.900498 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900346 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b132d136-68e9-45bc-b66e-997a34382d84-tmp\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:47.900498 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900365 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d-agent-certs\") pod \"konnectivity-agent-cc5cc\" (UID: \"9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d\") " pod="kube-system/konnectivity-agent-cc5cc" Sep 15 21:25:47.900498 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900382 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-cnibin\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:47.900498 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900398 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/47acebf0-6334-4091-8f05-726f7dccd8fc-cnibin\") pod \"multus-additional-cni-plugins-5xbf5\" (UID: \"47acebf0-6334-4091-8f05-726f7dccd8fc\") " pod="openshift-multus/multus-additional-cni-plugins-5xbf5" Sep 15 21:25:47.900498 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900413 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-host-slash\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:47.900498 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900430 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvfqs\" (UniqueName: \"kubernetes.io/projected/04c2e99d-ecdc-440d-847f-c443e6111773-kube-api-access-kvfqs\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:47.901246 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900458 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e3df5fab-3b41-4274-ba5f-dff5143b9192-hosts-file\") pod \"node-resolver-6pvrb\" (UID: \"e3df5fab-3b41-4274-ba5f-dff5143b9192\") " pod="openshift-dns/node-resolver-6pvrb" Sep 15 21:25:47.901246 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900485 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-etc-modprobe-d\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:47.901246 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900502 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-etc-sysctl-d\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:47.901246 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900525 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-var-lib-kubelet\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:47.901246 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900552 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-host\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:47.901246 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900578 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-host-run-k8s-cni-cncf-io\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:47.901246 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900623 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/47acebf0-6334-4091-8f05-726f7dccd8fc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5xbf5\" (UID: \"47acebf0-6334-4091-8f05-726f7dccd8fc\") " pod="openshift-multus/multus-additional-cni-plugins-5xbf5" Sep 15 21:25:47.901246 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900650 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1bd338b0-a780-4a53-8ba5-bee6ac944e0c-host-slash\") pod \"iptables-alerter-zxk5d\" (UID: \"1bd338b0-a780-4a53-8ba5-bee6ac944e0c\") " pod="openshift-network-operator/iptables-alerter-zxk5d" Sep 15 21:25:47.901246 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900675 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-systemd-units\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:47.901246 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900700 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04c2e99d-ecdc-440d-847f-c443e6111773-cni-binary-copy\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:47.901246 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900720 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-host-run-netns\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:47.901246 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900740 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-host-cni-netd\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:47.901246 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900765 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5vv7\" (UniqueName: \"kubernetes.io/projected/23c8693a-bbba-4f16-951a-9f0516862649-kube-api-access-p5vv7\") pod \"network-check-target-tvvlc\" (UID: \"23c8693a-bbba-4f16-951a-9f0516862649\") " pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:25:47.901246 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900787 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47acebf0-6334-4091-8f05-726f7dccd8fc-system-cni-dir\") pod \"multus-additional-cni-plugins-5xbf5\" (UID: \"47acebf0-6334-4091-8f05-726f7dccd8fc\") " pod="openshift-multus/multus-additional-cni-plugins-5xbf5" Sep 15 21:25:47.901246 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900822 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwlfk\" (UniqueName: \"kubernetes.io/projected/1bd338b0-a780-4a53-8ba5-bee6ac944e0c-kube-api-access-vwlfk\") pod \"iptables-alerter-zxk5d\" (UID: \"1bd338b0-a780-4a53-8ba5-bee6ac944e0c\") " pod="openshift-network-operator/iptables-alerter-zxk5d" Sep 15 21:25:47.901246 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900847 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-system-cni-dir\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:47.901246 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900850 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 15 21:25:47.901756 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900892 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/47acebf0-6334-4091-8f05-726f7dccd8fc-cni-binary-copy\") pod \"multus-additional-cni-plugins-5xbf5\" (UID: \"47acebf0-6334-4091-8f05-726f7dccd8fc\") " pod="openshift-multus/multus-additional-cni-plugins-5xbf5" Sep 15 21:25:47.901756 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900918 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/47acebf0-6334-4091-8f05-726f7dccd8fc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5xbf5\" (UID: \"47acebf0-6334-4091-8f05-726f7dccd8fc\") " pod="openshift-multus/multus-additional-cni-plugins-5xbf5" Sep 15 21:25:47.901756 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900943 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-etc-sysconfig\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:47.901756 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900965 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57cqv\" (UniqueName: \"kubernetes.io/projected/b132d136-68e9-45bc-b66e-997a34382d84-kube-api-access-57cqv\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:47.901756 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.900986 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-host-kubelet\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:47.901756 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.901007 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-multus-conf-dir\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:47.901756 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.901027 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-etc-kubernetes\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:47.901756 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.901055 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d-konnectivity-ca\") pod \"konnectivity-agent-cc5cc\" (UID: \"9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d\") " pod="kube-system/konnectivity-agent-cc5cc" Sep 15 21:25:47.901756 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.901062 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ef06c19b-a992-4624-948e-2d0db582f824-kubelet-config\") pod \"global-pull-secret-syncer-z22rp\" (UID: \"ef06c19b-a992-4624-948e-2d0db582f824\") " pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:25:47.901756 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.901093 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/90ded5f5-da0a-4177-93b0-5cd1b21f495c-socket-dir\") pod \"aws-ebs-csi-driver-node-48mzp\" (UID: \"90ded5f5-da0a-4177-93b0-5cd1b21f495c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" Sep 15 21:25:47.901756 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.901141 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-sys\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:47.903958 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.903942 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d-agent-certs\") pod \"konnectivity-agent-cc5cc\" (UID: \"9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d\") " pod="kube-system/konnectivity-agent-cc5cc" Sep 15 21:25:47.909295 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:47.909275 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 21:25:47.909295 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:47.909295 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 21:25:47.909426 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:47.909308 2573 projected.go:196] Error preparing data for projected volume kube-api-access-p5vv7 for pod openshift-network-diagnostics/network-check-target-tvvlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 21:25:47.909426 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:47.909360 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23c8693a-bbba-4f16-951a-9f0516862649-kube-api-access-p5vv7 podName:23c8693a-bbba-4f16-951a-9f0516862649 nodeName:}" failed. No retries permitted until 2026-09-15 21:25:48.409345479 +0000 UTC m=+2.995943054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p5vv7" (UniqueName: "kubernetes.io/projected/23c8693a-bbba-4f16-951a-9f0516862649-kube-api-access-p5vv7") pod "network-check-target-tvvlc" (UID: "23c8693a-bbba-4f16-951a-9f0516862649") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 21:25:47.912389 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.912366 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg9xk\" (UniqueName: \"kubernetes.io/projected/2da7d8f4-3fa7-4d76-86b9-1f22852adcef-kube-api-access-mg9xk\") pod \"node-ca-8qm2x\" (UID: \"2da7d8f4-3fa7-4d76-86b9-1f22852adcef\") " pod="openshift-image-registry/node-ca-8qm2x" Sep 15 21:25:47.932446 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.932400 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-42.ec2.internal" event={"ID":"8ebda7109db35594966aa86204551c00","Type":"ContainerStarted","Data":"16b1d670aa518c0b38903c8ab6431c88a6d1eac23bcc7e40bfa251a47bfad66c"} Sep 15 21:25:47.933871 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:47.933833 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-42.ec2.internal" event={"ID":"fc2afcdcc5cf9fb90dbda3c38c71226a","Type":"ContainerStarted","Data":"a354e125b9c9a9bf71945eb2afd65a896d51d6efdea69f75de63cb0788206a33"} Sep 15 21:25:48.001598 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.001564 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b132d136-68e9-45bc-b66e-997a34382d84-tmp\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.001598 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.001602 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-cnibin\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.001844 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.001625 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/47acebf0-6334-4091-8f05-726f7dccd8fc-cnibin\") pod \"multus-additional-cni-plugins-5xbf5\" (UID: \"47acebf0-6334-4091-8f05-726f7dccd8fc\") " pod="openshift-multus/multus-additional-cni-plugins-5xbf5" Sep 15 21:25:48.001844 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.001712 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-cnibin\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.001844 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.001758 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-host-slash\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.001844 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.001799 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvfqs\" (UniqueName: \"kubernetes.io/projected/04c2e99d-ecdc-440d-847f-c443e6111773-kube-api-access-kvfqs\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.001844 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.001802 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-host-slash\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.001844 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.001828 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e3df5fab-3b41-4274-ba5f-dff5143b9192-hosts-file\") pod \"node-resolver-6pvrb\" (UID: \"e3df5fab-3b41-4274-ba5f-dff5143b9192\") " pod="openshift-dns/node-resolver-6pvrb" Sep 15 21:25:48.001844 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.001768 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/47acebf0-6334-4091-8f05-726f7dccd8fc-cnibin\") pod \"multus-additional-cni-plugins-5xbf5\" (UID: \"47acebf0-6334-4091-8f05-726f7dccd8fc\") " pod="openshift-multus/multus-additional-cni-plugins-5xbf5" Sep 15 21:25:48.002283 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.001870 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-etc-modprobe-d\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.002283 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.001926 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e3df5fab-3b41-4274-ba5f-dff5143b9192-hosts-file\") pod \"node-resolver-6pvrb\" (UID: \"e3df5fab-3b41-4274-ba5f-dff5143b9192\") " pod="openshift-dns/node-resolver-6pvrb" Sep 15 21:25:48.002283 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.002142 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-etc-modprobe-d\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.002443 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.002374 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-etc-sysctl-d\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.002443 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.002404 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-var-lib-kubelet\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.002443 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.002432 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-host\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.002601 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.002459 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-host-run-k8s-cni-cncf-io\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.002601 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.002487 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/47acebf0-6334-4091-8f05-726f7dccd8fc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5xbf5\" (UID: \"47acebf0-6334-4091-8f05-726f7dccd8fc\") " pod="openshift-multus/multus-additional-cni-plugins-5xbf5" Sep 15 21:25:48.002601 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.002518 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1bd338b0-a780-4a53-8ba5-bee6ac944e0c-host-slash\") pod \"iptables-alerter-zxk5d\" (UID: \"1bd338b0-a780-4a53-8ba5-bee6ac944e0c\") " pod="openshift-network-operator/iptables-alerter-zxk5d" Sep 15 21:25:48.002601 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.002525 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-etc-sysctl-d\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.002601 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.002546 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-systemd-units\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.002601 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.002575 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04c2e99d-ecdc-440d-847f-c443e6111773-cni-binary-copy\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.002601 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.002585 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-host\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.002601 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.002599 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-host-run-netns\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.003060 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.002635 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-var-lib-kubelet\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.003060 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.002626 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-host-cni-netd\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.003060 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.002699 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-host-run-k8s-cni-cncf-io\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.003060 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.002753 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-systemd-units\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.003060 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.002791 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47acebf0-6334-4091-8f05-726f7dccd8fc-system-cni-dir\") pod \"multus-additional-cni-plugins-5xbf5\" (UID: \"47acebf0-6334-4091-8f05-726f7dccd8fc\") " pod="openshift-multus/multus-additional-cni-plugins-5xbf5" Sep 15 21:25:48.003060 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.002828 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-host-cni-netd\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.003060 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003020 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/47acebf0-6334-4091-8f05-726f7dccd8fc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5xbf5\" (UID: \"47acebf0-6334-4091-8f05-726f7dccd8fc\") " pod="openshift-multus/multus-additional-cni-plugins-5xbf5" Sep 15 21:25:48.003426 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003071 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1bd338b0-a780-4a53-8ba5-bee6ac944e0c-host-slash\") pod \"iptables-alerter-zxk5d\" (UID: \"1bd338b0-a780-4a53-8ba5-bee6ac944e0c\") " pod="openshift-network-operator/iptables-alerter-zxk5d" Sep 15 21:25:48.003426 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003114 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-host-run-netns\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.003426 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.002694 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47acebf0-6334-4091-8f05-726f7dccd8fc-system-cni-dir\") pod \"multus-additional-cni-plugins-5xbf5\" (UID: \"47acebf0-6334-4091-8f05-726f7dccd8fc\") " pod="openshift-multus/multus-additional-cni-plugins-5xbf5" Sep 15 21:25:48.003426 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003152 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwlfk\" (UniqueName: \"kubernetes.io/projected/1bd338b0-a780-4a53-8ba5-bee6ac944e0c-kube-api-access-vwlfk\") pod \"iptables-alerter-zxk5d\" (UID: \"1bd338b0-a780-4a53-8ba5-bee6ac944e0c\") " pod="openshift-network-operator/iptables-alerter-zxk5d" Sep 15 21:25:48.003426 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003180 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-system-cni-dir\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.003426 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003205 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/47acebf0-6334-4091-8f05-726f7dccd8fc-cni-binary-copy\") pod \"multus-additional-cni-plugins-5xbf5\" (UID: \"47acebf0-6334-4091-8f05-726f7dccd8fc\") " pod="openshift-multus/multus-additional-cni-plugins-5xbf5" Sep 15 21:25:48.003426 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003231 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/47acebf0-6334-4091-8f05-726f7dccd8fc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5xbf5\" (UID: \"47acebf0-6334-4091-8f05-726f7dccd8fc\") " pod="openshift-multus/multus-additional-cni-plugins-5xbf5" Sep 15 21:25:48.003426 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003257 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-etc-sysconfig\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.003426 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003282 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57cqv\" (UniqueName: \"kubernetes.io/projected/b132d136-68e9-45bc-b66e-997a34382d84-kube-api-access-57cqv\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.003426 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003308 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-host-kubelet\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.003426 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003332 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-multus-conf-dir\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.003426 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003342 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04c2e99d-ecdc-440d-847f-c443e6111773-cni-binary-copy\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.003426 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003356 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-etc-kubernetes\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.003426 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003382 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ef06c19b-a992-4624-948e-2d0db582f824-kubelet-config\") pod \"global-pull-secret-syncer-z22rp\" (UID: \"ef06c19b-a992-4624-948e-2d0db582f824\") " pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:25:48.003426 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003406 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/90ded5f5-da0a-4177-93b0-5cd1b21f495c-socket-dir\") pod \"aws-ebs-csi-driver-node-48mzp\" (UID: \"90ded5f5-da0a-4177-93b0-5cd1b21f495c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" Sep 15 21:25:48.004209 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003430 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-sys\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.004209 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003469 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-multus-cni-dir\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.004209 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003494 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-etc-systemd\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.004209 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003521 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-run\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.004209 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003544 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-lib-modules\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.004209 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003573 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-run-openvswitch\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.004209 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003602 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-log-socket\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.004209 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003631 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/47acebf0-6334-4091-8f05-726f7dccd8fc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5xbf5\" (UID: \"47acebf0-6334-4091-8f05-726f7dccd8fc\") " pod="openshift-multus/multus-additional-cni-plugins-5xbf5" Sep 15 21:25:48.004209 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003659 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-etc-openvswitch\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.004209 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003687 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-host-run-ovn-kubernetes\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.004209 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003710 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-host-cni-bin\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.004209 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003735 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bfa4b609-5081-473c-99ad-3371ea123f62-env-overrides\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.004209 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003761 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bfa4b609-5081-473c-99ad-3371ea123f62-ovn-node-metrics-cert\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.004209 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003788 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c225a82-b10a-42c0-8491-d3a70e1fb117-metrics-certs\") pod \"network-metrics-daemon-852v2\" (UID: \"9c225a82-b10a-42c0-8491-d3a70e1fb117\") " pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:25:48.004209 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003813 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bfa4b609-5081-473c-99ad-3371ea123f62-ovnkube-config\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.004209 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003840 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-host-var-lib-cni-bin\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.004209 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003865 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-host-var-lib-cni-multus\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.005046 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003873 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/47acebf0-6334-4091-8f05-726f7dccd8fc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5xbf5\" (UID: \"47acebf0-6334-4091-8f05-726f7dccd8fc\") " pod="openshift-multus/multus-additional-cni-plugins-5xbf5" Sep 15 21:25:48.005046 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003891 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-host-var-lib-kubelet\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.005046 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.003965 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-etc-sysconfig\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.005046 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.004132 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-host-kubelet\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.005046 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.004174 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-multus-conf-dir\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.005046 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.004198 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-etc-kubernetes\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.005046 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.004244 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ef06c19b-a992-4624-948e-2d0db582f824-kubelet-config\") pod \"global-pull-secret-syncer-z22rp\" (UID: \"ef06c19b-a992-4624-948e-2d0db582f824\") " pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:25:48.005046 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.004317 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-etc-openvswitch\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.005046 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.004375 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-host-run-ovn-kubernetes\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.005046 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.004421 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-host-cni-bin\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.005046 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.004420 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/90ded5f5-da0a-4177-93b0-5cd1b21f495c-socket-dir\") pod \"aws-ebs-csi-driver-node-48mzp\" (UID: \"90ded5f5-da0a-4177-93b0-5cd1b21f495c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" Sep 15 21:25:48.005046 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.004440 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b132d136-68e9-45bc-b66e-997a34382d84-tmp\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.005046 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.004471 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-sys\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.005046 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.004546 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-multus-cni-dir\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.005046 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.004585 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-etc-systemd\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.005046 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.004612 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-run\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.005046 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.004669 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/47acebf0-6334-4091-8f05-726f7dccd8fc-cni-binary-copy\") pod \"multus-additional-cni-plugins-5xbf5\" (UID: \"47acebf0-6334-4091-8f05-726f7dccd8fc\") " pod="openshift-multus/multus-additional-cni-plugins-5xbf5" Sep 15 21:25:48.005885 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.005152 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-lib-modules\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.005885 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.005185 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-969bh\" (UniqueName: \"kubernetes.io/projected/47acebf0-6334-4091-8f05-726f7dccd8fc-kube-api-access-969bh\") pod \"multus-additional-cni-plugins-5xbf5\" (UID: \"47acebf0-6334-4091-8f05-726f7dccd8fc\") " pod="openshift-multus/multus-additional-cni-plugins-5xbf5" Sep 15 21:25:48.005885 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.005197 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-system-cni-dir\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.005885 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.005292 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-host-var-lib-cni-bin\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.005885 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.005330 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bfa4b609-5081-473c-99ad-3371ea123f62-env-overrides\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.005885 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.005373 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-host-var-lib-kubelet\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.005885 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.005438 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-run-openvswitch\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.005885 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:48.005477 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 21:25:48.005885 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.005473 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bfa4b609-5081-473c-99ad-3371ea123f62-ovnkube-config\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.005885 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.005566 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-log-socket\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.005885 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:48.005573 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c225a82-b10a-42c0-8491-d3a70e1fb117-metrics-certs podName:9c225a82-b10a-42c0-8491-d3a70e1fb117 nodeName:}" failed. No retries permitted until 2026-09-15 21:25:48.505550641 +0000 UTC m=+3.092148218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c225a82-b10a-42c0-8491-d3a70e1fb117-metrics-certs") pod "network-metrics-daemon-852v2" (UID: "9c225a82-b10a-42c0-8491-d3a70e1fb117") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 21:25:48.005885 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.005821 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/90ded5f5-da0a-4177-93b0-5cd1b21f495c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-48mzp\" (UID: \"90ded5f5-da0a-4177-93b0-5cd1b21f495c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" Sep 15 21:25:48.005885 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.005865 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/90ded5f5-da0a-4177-93b0-5cd1b21f495c-sys-fs\") pod \"aws-ebs-csi-driver-node-48mzp\" (UID: \"90ded5f5-da0a-4177-93b0-5cd1b21f495c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" Sep 15 21:25:48.006585 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.005919 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/90ded5f5-da0a-4177-93b0-5cd1b21f495c-sys-fs\") pod \"aws-ebs-csi-driver-node-48mzp\" (UID: \"90ded5f5-da0a-4177-93b0-5cd1b21f495c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" Sep 15 21:25:48.006585 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.005939 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-host-var-lib-cni-multus\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.006585 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.005960 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/47acebf0-6334-4091-8f05-726f7dccd8fc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5xbf5\" (UID: \"47acebf0-6334-4091-8f05-726f7dccd8fc\") " pod="openshift-multus/multus-additional-cni-plugins-5xbf5" Sep 15 21:25:48.006585 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.005968 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/90ded5f5-da0a-4177-93b0-5cd1b21f495c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-48mzp\" (UID: \"90ded5f5-da0a-4177-93b0-5cd1b21f495c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" Sep 15 21:25:48.006585 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.006006 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-host-run-netns\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.006585 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.006063 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-host-run-multus-certs\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.006585 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.006100 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ef06c19b-a992-4624-948e-2d0db582f824-dbus\") pod \"global-pull-secret-syncer-z22rp\" (UID: \"ef06c19b-a992-4624-948e-2d0db582f824\") " pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:25:48.006585 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.006103 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-host-run-netns\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.006585 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.006129 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-host-run-multus-certs\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.006585 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.006131 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3df5fab-3b41-4274-ba5f-dff5143b9192-tmp-dir\") pod \"node-resolver-6pvrb\" (UID: \"e3df5fab-3b41-4274-ba5f-dff5143b9192\") " pod="openshift-dns/node-resolver-6pvrb" Sep 15 21:25:48.006585 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.006290 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ef06c19b-a992-4624-948e-2d0db582f824-dbus\") pod \"global-pull-secret-syncer-z22rp\" (UID: \"ef06c19b-a992-4624-948e-2d0db582f824\") " pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:25:48.006585 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.006216 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1bd338b0-a780-4a53-8ba5-bee6ac944e0c-iptables-alerter-script\") pod \"iptables-alerter-zxk5d\" (UID: \"1bd338b0-a780-4a53-8ba5-bee6ac944e0c\") " pod="openshift-network-operator/iptables-alerter-zxk5d" Sep 15 21:25:48.006585 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.006369 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-var-lib-openvswitch\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.006585 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.006440 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3df5fab-3b41-4274-ba5f-dff5143b9192-tmp-dir\") pod \"node-resolver-6pvrb\" (UID: \"e3df5fab-3b41-4274-ba5f-dff5143b9192\") " pod="openshift-dns/node-resolver-6pvrb" Sep 15 21:25:48.007387 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.006829 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-var-lib-openvswitch\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.007387 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.007122 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbpln\" (UniqueName: \"kubernetes.io/projected/9c225a82-b10a-42c0-8491-d3a70e1fb117-kube-api-access-jbpln\") pod \"network-metrics-daemon-852v2\" (UID: \"9c225a82-b10a-42c0-8491-d3a70e1fb117\") " pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:25:48.007387 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.007153 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1bd338b0-a780-4a53-8ba5-bee6ac944e0c-iptables-alerter-script\") pod \"iptables-alerter-zxk5d\" (UID: \"1bd338b0-a780-4a53-8ba5-bee6ac944e0c\") " pod="openshift-network-operator/iptables-alerter-zxk5d" Sep 15 21:25:48.007387 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.007163 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/90ded5f5-da0a-4177-93b0-5cd1b21f495c-device-dir\") pod \"aws-ebs-csi-driver-node-48mzp\" (UID: \"90ded5f5-da0a-4177-93b0-5cd1b21f495c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" Sep 15 21:25:48.007387 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.007329 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw2xz\" (UniqueName: \"kubernetes.io/projected/90ded5f5-da0a-4177-93b0-5cd1b21f495c-kube-api-access-mw2xz\") pod \"aws-ebs-csi-driver-node-48mzp\" (UID: \"90ded5f5-da0a-4177-93b0-5cd1b21f495c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" Sep 15 21:25:48.007387 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.007343 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/90ded5f5-da0a-4177-93b0-5cd1b21f495c-device-dir\") pod \"aws-ebs-csi-driver-node-48mzp\" (UID: \"90ded5f5-da0a-4177-93b0-5cd1b21f495c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" Sep 15 21:25:48.007387 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.007368 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjvcj\" (UniqueName: \"kubernetes.io/projected/bfa4b609-5081-473c-99ad-3371ea123f62-kube-api-access-zjvcj\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.007732 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.007395 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-hostroot\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.007732 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.007506 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/90ded5f5-da0a-4177-93b0-5cd1b21f495c-etc-selinux\") pod \"aws-ebs-csi-driver-node-48mzp\" (UID: \"90ded5f5-da0a-4177-93b0-5cd1b21f495c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" Sep 15 21:25:48.007732 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.007539 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-run-systemd\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.007732 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.007667 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-run-ovn\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.007732 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.007699 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-node-log\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.007732 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.007724 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bfa4b609-5081-473c-99ad-3371ea123f62-ovnkube-script-lib\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.007967 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.007803 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/90ded5f5-da0a-4177-93b0-5cd1b21f495c-etc-selinux\") pod \"aws-ebs-csi-driver-node-48mzp\" (UID: \"90ded5f5-da0a-4177-93b0-5cd1b21f495c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" Sep 15 21:25:48.007967 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.007811 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-multus-socket-dir-parent\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.007967 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.007844 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/04c2e99d-ecdc-440d-847f-c443e6111773-multus-daemon-config\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.010299 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.008197 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-run-ovn\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.010299 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.008220 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-run-systemd\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.010299 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.008234 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-multus-socket-dir-parent\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.010299 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.008282 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef06c19b-a992-4624-948e-2d0db582f824-original-pull-secret\") pod \"global-pull-secret-syncer-z22rp\" (UID: \"ef06c19b-a992-4624-948e-2d0db582f824\") " pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:25:48.010299 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.008322 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvm6c\" (UniqueName: \"kubernetes.io/projected/e3df5fab-3b41-4274-ba5f-dff5143b9192-kube-api-access-hvm6c\") pod \"node-resolver-6pvrb\" (UID: \"e3df5fab-3b41-4274-ba5f-dff5143b9192\") " pod="openshift-dns/node-resolver-6pvrb" Sep 15 21:25:48.010299 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.008358 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-etc-kubernetes\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.010299 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.008393 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.010299 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:48.008411 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 21:25:48.010299 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.008428 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/90ded5f5-da0a-4177-93b0-5cd1b21f495c-registration-dir\") pod \"aws-ebs-csi-driver-node-48mzp\" (UID: \"90ded5f5-da0a-4177-93b0-5cd1b21f495c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" Sep 15 21:25:48.010299 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:48.008468 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef06c19b-a992-4624-948e-2d0db582f824-original-pull-secret podName:ef06c19b-a992-4624-948e-2d0db582f824 nodeName:}" failed. No retries permitted until 2026-09-15 21:25:48.508445073 +0000 UTC m=+3.095042661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef06c19b-a992-4624-948e-2d0db582f824-original-pull-secret") pod "global-pull-secret-syncer-z22rp" (UID: "ef06c19b-a992-4624-948e-2d0db582f824") : object "kube-system"/"original-pull-secret" not registered Sep 15 21:25:48.010299 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.008512 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-etc-sysctl-conf\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.010299 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.008544 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b132d136-68e9-45bc-b66e-997a34382d84-etc-tuned\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.010299 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.008632 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/90ded5f5-da0a-4177-93b0-5cd1b21f495c-registration-dir\") pod \"aws-ebs-csi-driver-node-48mzp\" (UID: \"90ded5f5-da0a-4177-93b0-5cd1b21f495c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" Sep 15 21:25:48.010299 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.008652 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/04c2e99d-ecdc-440d-847f-c443e6111773-multus-daemon-config\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.010299 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.008772 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.010299 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.008797 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-etc-kubernetes\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.010299 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.008818 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bfa4b609-5081-473c-99ad-3371ea123f62-node-log\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.011554 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.008850 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/04c2e99d-ecdc-440d-847f-c443e6111773-hostroot\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.011554 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.008979 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b132d136-68e9-45bc-b66e-997a34382d84-etc-sysctl-conf\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.011554 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.009387 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bfa4b609-5081-473c-99ad-3371ea123f62-ovnkube-script-lib\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.011554 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.010640 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bfa4b609-5081-473c-99ad-3371ea123f62-ovn-node-metrics-cert\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.012240 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.011962 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b132d136-68e9-45bc-b66e-997a34382d84-etc-tuned\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.012991 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.012928 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvfqs\" (UniqueName: \"kubernetes.io/projected/04c2e99d-ecdc-440d-847f-c443e6111773-kube-api-access-kvfqs\") pod \"multus-5vskw\" (UID: \"04c2e99d-ecdc-440d-847f-c443e6111773\") " pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.014508 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.014489 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57cqv\" (UniqueName: \"kubernetes.io/projected/b132d136-68e9-45bc-b66e-997a34382d84-kube-api-access-57cqv\") pod \"tuned-9mmbr\" (UID: \"b132d136-68e9-45bc-b66e-997a34382d84\") " pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.014646 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.014624 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwlfk\" (UniqueName: \"kubernetes.io/projected/1bd338b0-a780-4a53-8ba5-bee6ac944e0c-kube-api-access-vwlfk\") pod \"iptables-alerter-zxk5d\" (UID: \"1bd338b0-a780-4a53-8ba5-bee6ac944e0c\") " pod="openshift-network-operator/iptables-alerter-zxk5d" Sep 15 21:25:48.020715 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.020693 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-969bh\" (UniqueName: \"kubernetes.io/projected/47acebf0-6334-4091-8f05-726f7dccd8fc-kube-api-access-969bh\") pod \"multus-additional-cni-plugins-5xbf5\" (UID: \"47acebf0-6334-4091-8f05-726f7dccd8fc\") " pod="openshift-multus/multus-additional-cni-plugins-5xbf5" Sep 15 21:25:48.023151 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.023123 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw2xz\" (UniqueName: \"kubernetes.io/projected/90ded5f5-da0a-4177-93b0-5cd1b21f495c-kube-api-access-mw2xz\") pod \"aws-ebs-csi-driver-node-48mzp\" (UID: \"90ded5f5-da0a-4177-93b0-5cd1b21f495c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" Sep 15 21:25:48.023621 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.023599 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbpln\" (UniqueName: \"kubernetes.io/projected/9c225a82-b10a-42c0-8491-d3a70e1fb117-kube-api-access-jbpln\") pod \"network-metrics-daemon-852v2\" (UID: \"9c225a82-b10a-42c0-8491-d3a70e1fb117\") " pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:25:48.024405 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.024382 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjvcj\" (UniqueName: \"kubernetes.io/projected/bfa4b609-5081-473c-99ad-3371ea123f62-kube-api-access-zjvcj\") pod \"ovnkube-node-f8w9j\" (UID: \"bfa4b609-5081-473c-99ad-3371ea123f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.024405 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.024391 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvm6c\" (UniqueName: \"kubernetes.io/projected/e3df5fab-3b41-4274-ba5f-dff5143b9192-kube-api-access-hvm6c\") pod \"node-resolver-6pvrb\" (UID: \"e3df5fab-3b41-4274-ba5f-dff5143b9192\") " pod="openshift-dns/node-resolver-6pvrb" Sep 15 21:25:48.094811 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.094777 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cc5cc" Sep 15 21:25:48.101358 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.101336 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8qm2x" Sep 15 21:25:48.105262 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:48.105235 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9adb4f33_9fb6_4e7d_99cc_d6d31ad11a5d.slice/crio-56de20e36f88a1c04d4be364c5186e842a3816ed0bdc9c987e0687a6dfb1efbf WatchSource:0}: Error finding container 56de20e36f88a1c04d4be364c5186e842a3816ed0bdc9c987e0687a6dfb1efbf: Status 404 returned error can't find the container with id 56de20e36f88a1c04d4be364c5186e842a3816ed0bdc9c987e0687a6dfb1efbf Sep 15 21:25:48.110034 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.110011 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" Sep 15 21:25:48.111020 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:48.110959 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2da7d8f4_3fa7_4d76_86b9_1f22852adcef.slice/crio-be556f4119a3a7c1722ad681c6a06a4f84aa05d80f5150b49fa0f65735b90970 WatchSource:0}: Error finding container be556f4119a3a7c1722ad681c6a06a4f84aa05d80f5150b49fa0f65735b90970: Status 404 returned error can't find the container with id be556f4119a3a7c1722ad681c6a06a4f84aa05d80f5150b49fa0f65735b90970 Sep 15 21:25:48.117468 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.117440 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6pvrb" Sep 15 21:25:48.122757 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.122733 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:25:48.123253 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:48.123226 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb132d136_68e9_45bc_b66e_997a34382d84.slice/crio-55bce01088dd098d2af3f62bad5f451be52e455581cb29c8e912214e747ae7d2 WatchSource:0}: Error finding container 55bce01088dd098d2af3f62bad5f451be52e455581cb29c8e912214e747ae7d2: Status 404 returned error can't find the container with id 55bce01088dd098d2af3f62bad5f451be52e455581cb29c8e912214e747ae7d2 Sep 15 21:25:48.127714 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.127688 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5vskw" Sep 15 21:25:48.128040 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:48.128012 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3df5fab_3b41_4274_ba5f_dff5143b9192.slice/crio-cca4b42a03f464c231e118980b89e37fc690b911100212edab45a8de7fbfb5e0 WatchSource:0}: Error finding container cca4b42a03f464c231e118980b89e37fc690b911100212edab45a8de7fbfb5e0: Status 404 returned error can't find the container with id cca4b42a03f464c231e118980b89e37fc690b911100212edab45a8de7fbfb5e0 Sep 15 21:25:48.133679 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.133660 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5xbf5" Sep 15 21:25:48.134206 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:48.134186 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfa4b609_5081_473c_99ad_3371ea123f62.slice/crio-c9aa9cdeeb60f1e8cdbfefefce1cf6dd6a0a63a857fd53659bc6ec04d3b31b9f WatchSource:0}: Error finding container c9aa9cdeeb60f1e8cdbfefefce1cf6dd6a0a63a857fd53659bc6ec04d3b31b9f: Status 404 returned error can't find the container with id c9aa9cdeeb60f1e8cdbfefefce1cf6dd6a0a63a857fd53659bc6ec04d3b31b9f Sep 15 21:25:48.140051 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.139887 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zxk5d" Sep 15 21:25:48.141152 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:48.141122 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04c2e99d_ecdc_440d_847f_c443e6111773.slice/crio-c1a2a92e71019de0131718e27261ca6c805f71d1eb2f6ed0495d9171f255d20c WatchSource:0}: Error finding container c1a2a92e71019de0131718e27261ca6c805f71d1eb2f6ed0495d9171f255d20c: Status 404 returned error can't find the container with id c1a2a92e71019de0131718e27261ca6c805f71d1eb2f6ed0495d9171f255d20c Sep 15 21:25:48.144172 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.144141 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" Sep 15 21:25:48.148835 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:48.148810 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47acebf0_6334_4091_8f05_726f7dccd8fc.slice/crio-ab281b991e282a5bb894bed728950004736fa140f85919a75714c8dada5ff6aa WatchSource:0}: Error finding container ab281b991e282a5bb894bed728950004736fa140f85919a75714c8dada5ff6aa: Status 404 returned error can't find the container with id ab281b991e282a5bb894bed728950004736fa140f85919a75714c8dada5ff6aa Sep 15 21:25:48.153572 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:48.153451 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd338b0_a780_4a53_8ba5_bee6ac944e0c.slice/crio-d439f41c9991e8c07c3b892442622fe2f90bfd87a2cda784143b5f78562fe374 WatchSource:0}: Error finding container d439f41c9991e8c07c3b892442622fe2f90bfd87a2cda784143b5f78562fe374: Status 404 returned error can't find the container with id d439f41c9991e8c07c3b892442622fe2f90bfd87a2cda784143b5f78562fe374 Sep 15 21:25:48.155999 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:25:48.155968 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ded5f5_da0a_4177_93b0_5cd1b21f495c.slice/crio-ffdc02432ef395a248eb5cb8e9037b52f86bca40c360590d50eb6b6d407f92df WatchSource:0}: Error finding container ffdc02432ef395a248eb5cb8e9037b52f86bca40c360590d50eb6b6d407f92df: Status 404 returned error can't find the container with id ffdc02432ef395a248eb5cb8e9037b52f86bca40c360590d50eb6b6d407f92df Sep 15 21:25:48.411441 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.411348 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5vv7\" (UniqueName: \"kubernetes.io/projected/23c8693a-bbba-4f16-951a-9f0516862649-kube-api-access-p5vv7\") pod \"network-check-target-tvvlc\" (UID: \"23c8693a-bbba-4f16-951a-9f0516862649\") " pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:25:48.411621 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:48.411517 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 21:25:48.411621 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:48.411543 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 21:25:48.411621 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:48.411557 2573 projected.go:196] Error preparing data for projected volume kube-api-access-p5vv7 for pod openshift-network-diagnostics/network-check-target-tvvlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 21:25:48.411621 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:48.411620 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23c8693a-bbba-4f16-951a-9f0516862649-kube-api-access-p5vv7 podName:23c8693a-bbba-4f16-951a-9f0516862649 nodeName:}" failed. No retries permitted until 2026-09-15 21:25:49.411601219 +0000 UTC m=+3.998198807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p5vv7" (UniqueName: "kubernetes.io/projected/23c8693a-bbba-4f16-951a-9f0516862649-kube-api-access-p5vv7") pod "network-check-target-tvvlc" (UID: "23c8693a-bbba-4f16-951a-9f0516862649") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 21:25:48.513407 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.512749 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef06c19b-a992-4624-948e-2d0db582f824-original-pull-secret\") pod \"global-pull-secret-syncer-z22rp\" (UID: \"ef06c19b-a992-4624-948e-2d0db582f824\") " pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:25:48.513407 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.512890 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c225a82-b10a-42c0-8491-d3a70e1fb117-metrics-certs\") pod \"network-metrics-daemon-852v2\" (UID: \"9c225a82-b10a-42c0-8491-d3a70e1fb117\") " pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:25:48.513407 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:48.512949 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 21:25:48.513407 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:48.513029 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef06c19b-a992-4624-948e-2d0db582f824-original-pull-secret podName:ef06c19b-a992-4624-948e-2d0db582f824 nodeName:}" failed. No retries permitted until 2026-09-15 21:25:49.513007298 +0000 UTC m=+4.099604891 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef06c19b-a992-4624-948e-2d0db582f824-original-pull-secret") pod "global-pull-secret-syncer-z22rp" (UID: "ef06c19b-a992-4624-948e-2d0db582f824") : object "kube-system"/"original-pull-secret" not registered Sep 15 21:25:48.513407 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:48.513029 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 21:25:48.513407 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:48.513073 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c225a82-b10a-42c0-8491-d3a70e1fb117-metrics-certs podName:9c225a82-b10a-42c0-8491-d3a70e1fb117 nodeName:}" failed. No retries permitted until 2026-09-15 21:25:49.51306255 +0000 UTC m=+4.099660123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c225a82-b10a-42c0-8491-d3a70e1fb117-metrics-certs") pod "network-metrics-daemon-852v2" (UID: "9c225a82-b10a-42c0-8491-d3a70e1fb117") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 21:25:48.839085 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.838989 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 21:20:48 +0000 UTC" deadline="2028-04-05 20:42:17.919315943 +0000 UTC" Sep 15 21:25:48.839085 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.839029 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13631h16m29.080291258s" Sep 15 21:25:48.928347 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.927784 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:25:48.928347 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:48.927969 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-852v2" podUID="9c225a82-b10a-42c0-8491-d3a70e1fb117" Sep 15 21:25:48.939505 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.939469 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zxk5d" event={"ID":"1bd338b0-a780-4a53-8ba5-bee6ac944e0c","Type":"ContainerStarted","Data":"d439f41c9991e8c07c3b892442622fe2f90bfd87a2cda784143b5f78562fe374"} Sep 15 21:25:48.941986 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.941882 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" event={"ID":"bfa4b609-5081-473c-99ad-3371ea123f62","Type":"ContainerStarted","Data":"c9aa9cdeeb60f1e8cdbfefefce1cf6dd6a0a63a857fd53659bc6ec04d3b31b9f"} Sep 15 21:25:48.943475 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.943454 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6pvrb" event={"ID":"e3df5fab-3b41-4274-ba5f-dff5143b9192","Type":"ContainerStarted","Data":"cca4b42a03f464c231e118980b89e37fc690b911100212edab45a8de7fbfb5e0"} Sep 15 21:25:48.945649 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.945590 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" event={"ID":"90ded5f5-da0a-4177-93b0-5cd1b21f495c","Type":"ContainerStarted","Data":"ffdc02432ef395a248eb5cb8e9037b52f86bca40c360590d50eb6b6d407f92df"} Sep 15 21:25:48.947171 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.947139 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xbf5" event={"ID":"47acebf0-6334-4091-8f05-726f7dccd8fc","Type":"ContainerStarted","Data":"ab281b991e282a5bb894bed728950004736fa140f85919a75714c8dada5ff6aa"} Sep 15 21:25:48.949544 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.949518 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5vskw" event={"ID":"04c2e99d-ecdc-440d-847f-c443e6111773","Type":"ContainerStarted","Data":"c1a2a92e71019de0131718e27261ca6c805f71d1eb2f6ed0495d9171f255d20c"} Sep 15 21:25:48.951352 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.951329 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" event={"ID":"b132d136-68e9-45bc-b66e-997a34382d84","Type":"ContainerStarted","Data":"55bce01088dd098d2af3f62bad5f451be52e455581cb29c8e912214e747ae7d2"} Sep 15 21:25:48.953006 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.952959 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8qm2x" event={"ID":"2da7d8f4-3fa7-4d76-86b9-1f22852adcef","Type":"ContainerStarted","Data":"be556f4119a3a7c1722ad681c6a06a4f84aa05d80f5150b49fa0f65735b90970"} Sep 15 21:25:48.954645 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:48.954593 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cc5cc" event={"ID":"9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d","Type":"ContainerStarted","Data":"56de20e36f88a1c04d4be364c5186e842a3816ed0bdc9c987e0687a6dfb1efbf"} Sep 15 21:25:49.422469 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:49.421713 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5vv7\" (UniqueName: \"kubernetes.io/projected/23c8693a-bbba-4f16-951a-9f0516862649-kube-api-access-p5vv7\") pod \"network-check-target-tvvlc\" (UID: \"23c8693a-bbba-4f16-951a-9f0516862649\") " pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:25:49.422469 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:49.421984 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 21:25:49.422469 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:49.422010 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 21:25:49.422469 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:49.422032 2573 projected.go:196] Error preparing data for projected volume kube-api-access-p5vv7 for pod openshift-network-diagnostics/network-check-target-tvvlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 21:25:49.422469 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:49.422090 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23c8693a-bbba-4f16-951a-9f0516862649-kube-api-access-p5vv7 podName:23c8693a-bbba-4f16-951a-9f0516862649 nodeName:}" failed. No retries permitted until 2026-09-15 21:25:51.422072412 +0000 UTC m=+6.008669998 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p5vv7" (UniqueName: "kubernetes.io/projected/23c8693a-bbba-4f16-951a-9f0516862649-kube-api-access-p5vv7") pod "network-check-target-tvvlc" (UID: "23c8693a-bbba-4f16-951a-9f0516862649") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 21:25:49.523230 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:49.523187 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c225a82-b10a-42c0-8491-d3a70e1fb117-metrics-certs\") pod \"network-metrics-daemon-852v2\" (UID: \"9c225a82-b10a-42c0-8491-d3a70e1fb117\") " pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:25:49.523445 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:49.523261 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef06c19b-a992-4624-948e-2d0db582f824-original-pull-secret\") pod \"global-pull-secret-syncer-z22rp\" (UID: \"ef06c19b-a992-4624-948e-2d0db582f824\") " pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:25:49.523445 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:49.523400 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 21:25:49.523584 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:49.523466 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef06c19b-a992-4624-948e-2d0db582f824-original-pull-secret podName:ef06c19b-a992-4624-948e-2d0db582f824 nodeName:}" failed. No retries permitted until 2026-09-15 21:25:51.523447658 +0000 UTC m=+6.110045236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef06c19b-a992-4624-948e-2d0db582f824-original-pull-secret") pod "global-pull-secret-syncer-z22rp" (UID: "ef06c19b-a992-4624-948e-2d0db582f824") : object "kube-system"/"original-pull-secret" not registered Sep 15 21:25:49.524017 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:49.523903 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 21:25:49.524017 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:49.523976 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c225a82-b10a-42c0-8491-d3a70e1fb117-metrics-certs podName:9c225a82-b10a-42c0-8491-d3a70e1fb117 nodeName:}" failed. No retries permitted until 2026-09-15 21:25:51.523959442 +0000 UTC m=+6.110557029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c225a82-b10a-42c0-8491-d3a70e1fb117-metrics-certs") pod "network-metrics-daemon-852v2" (UID: "9c225a82-b10a-42c0-8491-d3a70e1fb117") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 21:25:49.839328 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:49.839225 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 21:20:48 +0000 UTC" deadline="2028-03-16 09:09:05.550561415 +0000 UTC" Sep 15 21:25:49.839328 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:49.839273 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13139h43m15.711293002s" Sep 15 21:25:49.914874 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:49.914838 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 21:25:49.930982 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:49.930359 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:25:49.930982 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:49.930476 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvlc" podUID="23c8693a-bbba-4f16-951a-9f0516862649" Sep 15 21:25:49.930982 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:49.930822 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:25:49.930982 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:49.930910 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z22rp" podUID="ef06c19b-a992-4624-948e-2d0db582f824" Sep 15 21:25:50.927955 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:50.927615 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:25:50.928731 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:50.928040 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-852v2" podUID="9c225a82-b10a-42c0-8491-d3a70e1fb117" Sep 15 21:25:50.972020 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:50.971979 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-42.ec2.internal" event={"ID":"fc2afcdcc5cf9fb90dbda3c38c71226a","Type":"ContainerStarted","Data":"455889d8740e8fd261fc9c5929a29cdba20217cad21115e72b05e9bd9d1de1a0"} Sep 15 21:25:51.441465 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:51.441427 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5vv7\" (UniqueName: \"kubernetes.io/projected/23c8693a-bbba-4f16-951a-9f0516862649-kube-api-access-p5vv7\") pod \"network-check-target-tvvlc\" (UID: \"23c8693a-bbba-4f16-951a-9f0516862649\") " pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:25:51.441658 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:51.441646 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 21:25:51.441725 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:51.441667 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 21:25:51.441725 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:51.441681 2573 projected.go:196] Error preparing data for projected volume kube-api-access-p5vv7 for pod openshift-network-diagnostics/network-check-target-tvvlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 21:25:51.441832 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:51.441748 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23c8693a-bbba-4f16-951a-9f0516862649-kube-api-access-p5vv7 podName:23c8693a-bbba-4f16-951a-9f0516862649 nodeName:}" failed. No retries permitted until 2026-09-15 21:25:55.441728346 +0000 UTC m=+10.028325936 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p5vv7" (UniqueName: "kubernetes.io/projected/23c8693a-bbba-4f16-951a-9f0516862649-kube-api-access-p5vv7") pod "network-check-target-tvvlc" (UID: "23c8693a-bbba-4f16-951a-9f0516862649") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 21:25:51.542767 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:51.542734 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c225a82-b10a-42c0-8491-d3a70e1fb117-metrics-certs\") pod \"network-metrics-daemon-852v2\" (UID: \"9c225a82-b10a-42c0-8491-d3a70e1fb117\") " pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:25:51.542891 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:51.542802 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef06c19b-a992-4624-948e-2d0db582f824-original-pull-secret\") pod \"global-pull-secret-syncer-z22rp\" (UID: \"ef06c19b-a992-4624-948e-2d0db582f824\") " pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:25:51.543027 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:51.543008 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 21:25:51.543091 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:51.543075 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c225a82-b10a-42c0-8491-d3a70e1fb117-metrics-certs podName:9c225a82-b10a-42c0-8491-d3a70e1fb117 nodeName:}" failed. No retries permitted until 2026-09-15 21:25:55.543055226 +0000 UTC m=+10.129652799 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c225a82-b10a-42c0-8491-d3a70e1fb117-metrics-certs") pod "network-metrics-daemon-852v2" (UID: "9c225a82-b10a-42c0-8491-d3a70e1fb117") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 21:25:51.543588 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:51.543568 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 21:25:51.543662 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:51.543635 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef06c19b-a992-4624-948e-2d0db582f824-original-pull-secret podName:ef06c19b-a992-4624-948e-2d0db582f824 nodeName:}" failed. No retries permitted until 2026-09-15 21:25:55.543617908 +0000 UTC m=+10.130215483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef06c19b-a992-4624-948e-2d0db582f824-original-pull-secret") pod "global-pull-secret-syncer-z22rp" (UID: "ef06c19b-a992-4624-948e-2d0db582f824") : object "kube-system"/"original-pull-secret" not registered Sep 15 21:25:51.929031 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:51.928957 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:25:51.929472 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:51.929089 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvlc" podUID="23c8693a-bbba-4f16-951a-9f0516862649" Sep 15 21:25:51.929472 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:51.929133 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:25:51.929472 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:51.929245 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z22rp" podUID="ef06c19b-a992-4624-948e-2d0db582f824" Sep 15 21:25:51.978497 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:51.978371 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-42.ec2.internal" event={"ID":"8ebda7109db35594966aa86204551c00","Type":"ContainerStarted","Data":"66f77dd9ba2fb14f57f37219b17ab821fb1fb1dd57ea5d8e80e27699ed24ced1"} Sep 15 21:25:52.009412 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:52.008533 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-42.ec2.internal" podStartSLOduration=5.008510512 podStartE2EDuration="5.008510512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:25:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:25:50.989651285 +0000 UTC m=+5.576248899" watchObservedRunningTime="2026-09-15 21:25:52.008510512 +0000 UTC m=+6.595108105" Sep 15 21:25:52.927834 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:52.927328 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:25:52.927834 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:52.927467 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-852v2" podUID="9c225a82-b10a-42c0-8491-d3a70e1fb117" Sep 15 21:25:53.927865 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:53.927371 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:25:53.927865 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:53.927407 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:25:53.927865 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:53.927490 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvlc" podUID="23c8693a-bbba-4f16-951a-9f0516862649" Sep 15 21:25:53.927865 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:53.927597 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z22rp" podUID="ef06c19b-a992-4624-948e-2d0db582f824" Sep 15 21:25:53.984142 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:53.984104 2573 generic.go:356] "Generic (PLEG): container finished" podID="8ebda7109db35594966aa86204551c00" containerID="66f77dd9ba2fb14f57f37219b17ab821fb1fb1dd57ea5d8e80e27699ed24ced1" exitCode=0 Sep 15 21:25:53.984311 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:53.984167 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-42.ec2.internal" event={"ID":"8ebda7109db35594966aa86204551c00","Type":"ContainerDied","Data":"66f77dd9ba2fb14f57f37219b17ab821fb1fb1dd57ea5d8e80e27699ed24ced1"} Sep 15 21:25:54.928020 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:54.927988 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:25:54.928587 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:54.928127 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-852v2" podUID="9c225a82-b10a-42c0-8491-d3a70e1fb117" Sep 15 21:25:55.474651 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:55.474500 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5vv7\" (UniqueName: \"kubernetes.io/projected/23c8693a-bbba-4f16-951a-9f0516862649-kube-api-access-p5vv7\") pod \"network-check-target-tvvlc\" (UID: \"23c8693a-bbba-4f16-951a-9f0516862649\") " pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:25:55.474837 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:55.474670 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 21:25:55.474837 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:55.474688 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 21:25:55.474837 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:55.474699 2573 projected.go:196] Error preparing data for projected volume kube-api-access-p5vv7 for pod openshift-network-diagnostics/network-check-target-tvvlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 21:25:55.474837 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:55.474756 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23c8693a-bbba-4f16-951a-9f0516862649-kube-api-access-p5vv7 podName:23c8693a-bbba-4f16-951a-9f0516862649 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:03.47473866 +0000 UTC m=+18.061336244 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p5vv7" (UniqueName: "kubernetes.io/projected/23c8693a-bbba-4f16-951a-9f0516862649-kube-api-access-p5vv7") pod "network-check-target-tvvlc" (UID: "23c8693a-bbba-4f16-951a-9f0516862649") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 21:25:55.575176 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:55.575128 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c225a82-b10a-42c0-8491-d3a70e1fb117-metrics-certs\") pod \"network-metrics-daemon-852v2\" (UID: \"9c225a82-b10a-42c0-8491-d3a70e1fb117\") " pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:25:55.575355 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:55.575202 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef06c19b-a992-4624-948e-2d0db582f824-original-pull-secret\") pod \"global-pull-secret-syncer-z22rp\" (UID: \"ef06c19b-a992-4624-948e-2d0db582f824\") " pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:25:55.575355 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:55.575313 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 21:25:55.575355 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:55.575314 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 21:25:55.575512 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:55.575372 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef06c19b-a992-4624-948e-2d0db582f824-original-pull-secret podName:ef06c19b-a992-4624-948e-2d0db582f824 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:03.575352393 +0000 UTC m=+18.161949970 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef06c19b-a992-4624-948e-2d0db582f824-original-pull-secret") pod "global-pull-secret-syncer-z22rp" (UID: "ef06c19b-a992-4624-948e-2d0db582f824") : object "kube-system"/"original-pull-secret" not registered Sep 15 21:25:55.575512 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:55.575390 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c225a82-b10a-42c0-8491-d3a70e1fb117-metrics-certs podName:9c225a82-b10a-42c0-8491-d3a70e1fb117 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:03.575380709 +0000 UTC m=+18.161978286 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c225a82-b10a-42c0-8491-d3a70e1fb117-metrics-certs") pod "network-metrics-daemon-852v2" (UID: "9c225a82-b10a-42c0-8491-d3a70e1fb117") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 21:25:55.928978 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:55.928899 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:25:55.929410 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:55.929007 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvlc" podUID="23c8693a-bbba-4f16-951a-9f0516862649" Sep 15 21:25:55.929410 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:55.929379 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:25:55.929515 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:55.929496 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z22rp" podUID="ef06c19b-a992-4624-948e-2d0db582f824" Sep 15 21:25:56.928479 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:56.928444 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:25:56.928617 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:56.928591 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-852v2" podUID="9c225a82-b10a-42c0-8491-d3a70e1fb117" Sep 15 21:25:57.928085 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:57.927462 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:25:57.928085 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:57.927589 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvlc" podUID="23c8693a-bbba-4f16-951a-9f0516862649" Sep 15 21:25:57.928085 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:57.927462 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:25:57.928085 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:57.928038 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z22rp" podUID="ef06c19b-a992-4624-948e-2d0db582f824" Sep 15 21:25:58.927409 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:58.927374 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:25:58.927590 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:58.927516 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-852v2" podUID="9c225a82-b10a-42c0-8491-d3a70e1fb117" Sep 15 21:25:59.927767 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:59.927732 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:25:59.928238 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:25:59.927737 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:25:59.928238 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:59.927888 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvlc" podUID="23c8693a-bbba-4f16-951a-9f0516862649" Sep 15 21:25:59.928238 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:25:59.927958 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z22rp" podUID="ef06c19b-a992-4624-948e-2d0db582f824" Sep 15 21:26:00.927436 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:00.927400 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:26:00.927627 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:00.927530 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-852v2" podUID="9c225a82-b10a-42c0-8491-d3a70e1fb117" Sep 15 21:26:01.928451 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:01.928228 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:26:01.928451 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:01.928361 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvlc" podUID="23c8693a-bbba-4f16-951a-9f0516862649" Sep 15 21:26:01.928451 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:01.928418 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:26:01.929119 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:01.928529 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z22rp" podUID="ef06c19b-a992-4624-948e-2d0db582f824" Sep 15 21:26:02.927947 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:02.927914 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:26:02.928188 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:02.928040 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-852v2" podUID="9c225a82-b10a-42c0-8491-d3a70e1fb117" Sep 15 21:26:03.535701 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:03.535671 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5vv7\" (UniqueName: \"kubernetes.io/projected/23c8693a-bbba-4f16-951a-9f0516862649-kube-api-access-p5vv7\") pod \"network-check-target-tvvlc\" (UID: \"23c8693a-bbba-4f16-951a-9f0516862649\") " pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:26:03.536151 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:03.535882 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 21:26:03.536151 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:03.535913 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 21:26:03.536151 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:03.535927 2573 projected.go:196] Error preparing data for projected volume kube-api-access-p5vv7 for pod openshift-network-diagnostics/network-check-target-tvvlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 21:26:03.536151 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:03.535997 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23c8693a-bbba-4f16-951a-9f0516862649-kube-api-access-p5vv7 podName:23c8693a-bbba-4f16-951a-9f0516862649 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:19.535974769 +0000 UTC m=+34.122572360 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p5vv7" (UniqueName: "kubernetes.io/projected/23c8693a-bbba-4f16-951a-9f0516862649-kube-api-access-p5vv7") pod "network-check-target-tvvlc" (UID: "23c8693a-bbba-4f16-951a-9f0516862649") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 21:26:03.636758 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:03.636723 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c225a82-b10a-42c0-8491-d3a70e1fb117-metrics-certs\") pod \"network-metrics-daemon-852v2\" (UID: \"9c225a82-b10a-42c0-8491-d3a70e1fb117\") " pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:26:03.636758 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:03.636770 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef06c19b-a992-4624-948e-2d0db582f824-original-pull-secret\") pod \"global-pull-secret-syncer-z22rp\" (UID: \"ef06c19b-a992-4624-948e-2d0db582f824\") " pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:26:03.636994 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:03.636901 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 21:26:03.636994 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:03.636905 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 21:26:03.636994 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:03.636962 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef06c19b-a992-4624-948e-2d0db582f824-original-pull-secret podName:ef06c19b-a992-4624-948e-2d0db582f824 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:19.636946038 +0000 UTC m=+34.223543608 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef06c19b-a992-4624-948e-2d0db582f824-original-pull-secret") pod "global-pull-secret-syncer-z22rp" (UID: "ef06c19b-a992-4624-948e-2d0db582f824") : object "kube-system"/"original-pull-secret" not registered Sep 15 21:26:03.636994 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:03.636982 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c225a82-b10a-42c0-8491-d3a70e1fb117-metrics-certs podName:9c225a82-b10a-42c0-8491-d3a70e1fb117 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:19.636971826 +0000 UTC m=+34.223569399 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c225a82-b10a-42c0-8491-d3a70e1fb117-metrics-certs") pod "network-metrics-daemon-852v2" (UID: "9c225a82-b10a-42c0-8491-d3a70e1fb117") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 21:26:03.927798 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:03.927715 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:26:03.927976 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:03.927721 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:26:03.927976 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:03.927866 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvlc" podUID="23c8693a-bbba-4f16-951a-9f0516862649" Sep 15 21:26:03.927976 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:03.927936 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z22rp" podUID="ef06c19b-a992-4624-948e-2d0db582f824" Sep 15 21:26:04.927714 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:04.927673 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:26:04.928135 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:04.927785 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-852v2" podUID="9c225a82-b10a-42c0-8491-d3a70e1fb117" Sep 15 21:26:05.928193 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:05.928154 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:26:05.928649 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:05.928260 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvlc" podUID="23c8693a-bbba-4f16-951a-9f0516862649" Sep 15 21:26:05.928649 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:05.928619 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:26:05.928744 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:05.928704 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z22rp" podUID="ef06c19b-a992-4624-948e-2d0db582f824" Sep 15 21:26:06.927775 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:06.927741 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:26:06.927912 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:06.927882 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-852v2" podUID="9c225a82-b10a-42c0-8491-d3a70e1fb117" Sep 15 21:26:07.012827 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:07.012794 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cc5cc" event={"ID":"9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d","Type":"ContainerStarted","Data":"2d359933a20d5ffdff93f75357ef4da232a55ddcce2ec71990ddf8205e9ccf38"} Sep 15 21:26:07.015692 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:07.015655 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-42.ec2.internal" event={"ID":"8ebda7109db35594966aa86204551c00","Type":"ContainerStarted","Data":"14a2b7b4e590d3893a8a95cda197fdc38b4ee842a31f25c85b67ca03468884c9"} Sep 15 21:26:07.018779 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:07.018754 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" event={"ID":"90ded5f5-da0a-4177-93b0-5cd1b21f495c","Type":"ContainerStarted","Data":"3cc59497fd22bfe23652b74a2f927eb9660f00e773b1c04f1e57a92876dc4499"} Sep 15 21:26:07.020138 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:07.020118 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xbf5" event={"ID":"47acebf0-6334-4091-8f05-726f7dccd8fc","Type":"ContainerStarted","Data":"3bf4733ca67708921b816c58e5d066f69c545b49b28a8bf8712d8ae0241633ac"} Sep 15 21:26:07.022718 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:07.022699 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8qm2x" event={"ID":"2da7d8f4-3fa7-4d76-86b9-1f22852adcef","Type":"ContainerStarted","Data":"9e90d16214749de31925be0c03ecf91813b1e7ef5ed5059112fb884b2ac59d70"} Sep 15 21:26:07.027603 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:07.027553 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cc5cc" podStartSLOduration=2.447227837 podStartE2EDuration="21.027536996s" totalImagesPullingTime="18.580309159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:25:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:07.027174665 +0000 UTC m=+21.613772257" watchObservedRunningTime="2026-09-15 21:26:07.027536996 +0000 UTC m=+21.614134590" Sep 15 21:26:07.041471 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:07.041426 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-42.ec2.internal" podStartSLOduration=20.041410626 podStartE2EDuration="20.041410626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:25:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:07.041172833 +0000 UTC m=+21.627770426" watchObservedRunningTime="2026-09-15 21:26:07.041410626 +0000 UTC m=+21.628008217" Sep 15 21:26:07.055151 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:07.055095 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8qm2x" podStartSLOduration=2.480372247 podStartE2EDuration="21.055074196s" totalImagesPullingTime="18.574701949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:25:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:07.054371238 +0000 UTC m=+21.640968831" watchObservedRunningTime="2026-09-15 21:26:07.055074196 +0000 UTC m=+21.641671812" Sep 15 21:26:07.654732 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:07.654558 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cc5cc" Sep 15 21:26:07.928467 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:07.928379 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:26:07.928467 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:07.928426 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:26:07.928659 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:07.928514 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvlc" podUID="23c8693a-bbba-4f16-951a-9f0516862649" Sep 15 21:26:07.928714 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:07.928665 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z22rp" podUID="ef06c19b-a992-4624-948e-2d0db582f824" Sep 15 21:26:08.026989 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:08.026949 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6pvrb" event={"ID":"e3df5fab-3b41-4274-ba5f-dff5143b9192","Type":"ContainerStarted","Data":"cc2daedbf58bd60665e73ca1a91535cb59f1d267e91a3efc74444db50ea4660c"} Sep 15 21:26:08.028684 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:08.028658 2573 generic.go:356] "Generic (PLEG): container finished" podID="47acebf0-6334-4091-8f05-726f7dccd8fc" containerID="3bf4733ca67708921b816c58e5d066f69c545b49b28a8bf8712d8ae0241633ac" exitCode=0 Sep 15 21:26:08.028830 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:08.028731 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xbf5" event={"ID":"47acebf0-6334-4091-8f05-726f7dccd8fc","Type":"ContainerDied","Data":"3bf4733ca67708921b816c58e5d066f69c545b49b28a8bf8712d8ae0241633ac"} Sep 15 21:26:08.030521 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:08.030494 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5vskw" event={"ID":"04c2e99d-ecdc-440d-847f-c443e6111773","Type":"ContainerStarted","Data":"c6aa2b9ce5a6fdc0c5b88860fa6c424874c8a11c7c4d425a0bb26eccca744196"} Sep 15 21:26:08.032356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:08.032335 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" event={"ID":"b132d136-68e9-45bc-b66e-997a34382d84","Type":"ContainerStarted","Data":"5cf8ca3395059ba2422c036d3ca8795d0892ec38aac1d6dac6778d0a3f0e9da4"} Sep 15 21:26:08.036109 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:08.036086 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" event={"ID":"bfa4b609-5081-473c-99ad-3371ea123f62","Type":"ContainerStarted","Data":"132ef51ad03e1aa06ad95d53785ca12045dec0bfd417aa16a5d5294d701f0158"} Sep 15 21:26:08.036219 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:08.036168 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" event={"ID":"bfa4b609-5081-473c-99ad-3371ea123f62","Type":"ContainerStarted","Data":"a10a37cbe668c17c8e1937c60239683cb9e5b9d9479ab7ed6c6f29aedc76374b"} Sep 15 21:26:08.036283 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:08.036223 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" event={"ID":"bfa4b609-5081-473c-99ad-3371ea123f62","Type":"ContainerStarted","Data":"c83db2a4e68bc543691199c3f7dc0e516a8d4db8e5ff3194318ed72a4a198ab7"} Sep 15 21:26:08.036283 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:08.036256 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" event={"ID":"bfa4b609-5081-473c-99ad-3371ea123f62","Type":"ContainerStarted","Data":"13519d07875f3b23afe3982f942af3315969fc463830edbfa9d8f75cb0eac11d"} Sep 15 21:26:08.036360 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:08.036302 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" event={"ID":"bfa4b609-5081-473c-99ad-3371ea123f62","Type":"ContainerStarted","Data":"af94b52b0c9fa0507821b33b720ac868683e4e7a48a8aaa6662a6e128a9d123b"} Sep 15 21:26:08.036360 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:08.036340 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" event={"ID":"bfa4b609-5081-473c-99ad-3371ea123f62","Type":"ContainerStarted","Data":"c6d4ca159ee8a1edb506fa328b95442dc14bd8acffda4fbc549076702add0ded"} Sep 15 21:26:08.083092 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:08.083041 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6pvrb" podStartSLOduration=3.5206643509999997 podStartE2EDuration="22.083025588s" totalImagesPullingTime="18.562361237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:25:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:08.04745881 +0000 UTC m=+22.634056404" watchObservedRunningTime="2026-09-15 21:26:08.083025588 +0000 UTC m=+22.669623180" Sep 15 21:26:08.106651 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:08.106599 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9mmbr" podStartSLOduration=3.537194631 podStartE2EDuration="22.106582323s" totalImagesPullingTime="18.569387692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:25:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:08.106220302 +0000 UTC m=+22.692817896" watchObservedRunningTime="2026-09-15 21:26:08.106582323 +0000 UTC m=+22.693179963" Sep 15 21:26:08.136535 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:08.136483 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5vskw" podStartSLOduration=3.189721669 podStartE2EDuration="22.136469185s" totalImagesPullingTime="18.946747516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:25:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:08.135935879 +0000 UTC m=+22.722533468" watchObservedRunningTime="2026-09-15 21:26:08.136469185 +0000 UTC m=+22.723066774" Sep 15 21:26:08.243509 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:08.243487 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 15 21:26:08.855745 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:08.855639 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T21:26:08.243505787Z","UUID":"c54e84ff-bdc4-434b-a45c-aa249d13d3fc","Handler":null,"Name":"","Endpoint":""} Sep 15 21:26:08.857398 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:08.857373 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 15 21:26:08.857498 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:08.857411 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 15 21:26:08.926298 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:08.926264 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cc5cc" Sep 15 21:26:08.926793 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:08.926771 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cc5cc" Sep 15 21:26:08.927899 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:08.927880 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:26:08.928032 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:08.928005 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-852v2" podUID="9c225a82-b10a-42c0-8491-d3a70e1fb117" Sep 15 21:26:09.040802 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:09.040765 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" event={"ID":"90ded5f5-da0a-4177-93b0-5cd1b21f495c","Type":"ContainerStarted","Data":"4fbfe0eb322544c8a361862cc3f85d22b8e8b41b9aef7e14f3727c409b8ac33f"} Sep 15 21:26:09.042641 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:09.042579 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zxk5d" event={"ID":"1bd338b0-a780-4a53-8ba5-bee6ac944e0c","Type":"ContainerStarted","Data":"75de12c726c8e774c76766e4b9c3e292da61495ee1cf82bd828fa4ebed81b5d0"} Sep 15 21:26:09.043758 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:09.043740 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cc5cc" Sep 15 21:26:09.062641 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:09.062582 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zxk5d" podStartSLOduration=4.525449996 podStartE2EDuration="23.062563145s" totalImagesPullingTime="18.537113149s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:25:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:09.062250517 +0000 UTC m=+23.648848109" watchObservedRunningTime="2026-09-15 21:26:09.062563145 +0000 UTC m=+23.649160739" Sep 15 21:26:09.927962 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:09.927881 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:26:09.928126 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:09.927977 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvlc" podUID="23c8693a-bbba-4f16-951a-9f0516862649" Sep 15 21:26:09.928126 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:09.928032 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:26:09.928237 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:09.928122 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z22rp" podUID="ef06c19b-a992-4624-948e-2d0db582f824" Sep 15 21:26:10.046387 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:10.046347 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" event={"ID":"90ded5f5-da0a-4177-93b0-5cd1b21f495c","Type":"ContainerStarted","Data":"997b7dad6e3b89811493638258349362e9224207a97cd197c42303a8b2e75e38"} Sep 15 21:26:10.049634 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:10.049608 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" event={"ID":"bfa4b609-5081-473c-99ad-3371ea123f62","Type":"ContainerStarted","Data":"d065f95f2b0609f8814d708bc5505184b49eb69f7e553577c821934899cd938f"} Sep 15 21:26:10.927444 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:10.927406 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:26:10.927605 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:10.927510 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-852v2" podUID="9c225a82-b10a-42c0-8491-d3a70e1fb117" Sep 15 21:26:11.928406 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:11.928128 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:26:11.928406 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:11.928139 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:26:11.929090 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:11.928427 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvlc" podUID="23c8693a-bbba-4f16-951a-9f0516862649" Sep 15 21:26:11.929090 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:11.928536 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z22rp" podUID="ef06c19b-a992-4624-948e-2d0db582f824" Sep 15 21:26:12.058865 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:12.058822 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" event={"ID":"bfa4b609-5081-473c-99ad-3371ea123f62","Type":"ContainerStarted","Data":"11c384f1d3c613be0a7051335130d8004e132ca6ba4428e82f274986f42134a6"} Sep 15 21:26:12.059227 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:12.059207 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:26:12.076342 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:12.076313 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:26:12.095671 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:12.095627 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" podStartSLOduration=7.50926379 podStartE2EDuration="26.095611244s" totalImagesPullingTime="18.586347454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:25:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:12.09546088 +0000 UTC m=+26.682058496" watchObservedRunningTime="2026-09-15 21:26:12.095611244 +0000 UTC m=+26.682208838" Sep 15 21:26:12.095964 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:12.095930 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48mzp" podStartSLOduration=9.100400884999999 podStartE2EDuration="26.095917152s" totalImagesPullingTime="16.995516267s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:25:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:10.068323697 +0000 UTC m=+24.654921290" watchObservedRunningTime="2026-09-15 21:26:12.095917152 +0000 UTC m=+26.682514745" Sep 15 21:26:12.928098 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:12.928065 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:26:12.928281 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:12.928214 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-852v2" podUID="9c225a82-b10a-42c0-8491-d3a70e1fb117" Sep 15 21:26:13.062178 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:13.062133 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:26:13.062642 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:13.062243 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:26:13.079478 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:13.079453 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:26:13.570218 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:13.570189 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z22rp"] Sep 15 21:26:13.570382 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:13.570354 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:26:13.570483 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:13.570457 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z22rp" podUID="ef06c19b-a992-4624-948e-2d0db582f824" Sep 15 21:26:13.573256 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:13.573232 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tvvlc"] Sep 15 21:26:13.573395 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:13.573332 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:26:13.573460 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:13.573418 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvlc" podUID="23c8693a-bbba-4f16-951a-9f0516862649" Sep 15 21:26:13.576546 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:13.576518 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-852v2"] Sep 15 21:26:13.576665 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:13.576639 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:26:13.576757 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:13.576736 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-852v2" podUID="9c225a82-b10a-42c0-8491-d3a70e1fb117" Sep 15 21:26:14.927749 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:14.927572 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:26:14.928138 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:14.927825 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-852v2" podUID="9c225a82-b10a-42c0-8491-d3a70e1fb117" Sep 15 21:26:15.068094 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:15.068061 2573 generic.go:356] "Generic (PLEG): container finished" podID="47acebf0-6334-4091-8f05-726f7dccd8fc" containerID="e511b10b2733b40581723b51df9cb0fb0d96b51346d262f77351248d29deb7e7" exitCode=0 Sep 15 21:26:15.068270 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:15.068148 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xbf5" event={"ID":"47acebf0-6334-4091-8f05-726f7dccd8fc","Type":"ContainerDied","Data":"e511b10b2733b40581723b51df9cb0fb0d96b51346d262f77351248d29deb7e7"} Sep 15 21:26:15.928779 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:15.928748 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:26:15.929233 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:15.928867 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvlc" podUID="23c8693a-bbba-4f16-951a-9f0516862649" Sep 15 21:26:15.929233 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:15.928907 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:26:15.929233 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:15.928994 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z22rp" podUID="ef06c19b-a992-4624-948e-2d0db582f824" Sep 15 21:26:16.928241 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:16.928215 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:26:16.928408 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:16.928339 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-852v2" podUID="9c225a82-b10a-42c0-8491-d3a70e1fb117" Sep 15 21:26:17.074491 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:17.074458 2573 generic.go:356] "Generic (PLEG): container finished" podID="47acebf0-6334-4091-8f05-726f7dccd8fc" containerID="b867cafe640342dc7371f37a4c25a74911b3775cc78d0ea75c106cac019960ce" exitCode=0 Sep 15 21:26:17.075136 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:17.074501 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xbf5" event={"ID":"47acebf0-6334-4091-8f05-726f7dccd8fc","Type":"ContainerDied","Data":"b867cafe640342dc7371f37a4c25a74911b3775cc78d0ea75c106cac019960ce"} Sep 15 21:26:17.928073 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:17.928037 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:26:17.928249 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:17.928149 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvvlc" podUID="23c8693a-bbba-4f16-951a-9f0516862649" Sep 15 21:26:17.928249 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:17.928217 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:26:17.928358 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:17.928301 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z22rp" podUID="ef06c19b-a992-4624-948e-2d0db582f824" Sep 15 21:26:18.927808 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:18.927531 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:26:18.928204 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:18.927840 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-852v2" podUID="9c225a82-b10a-42c0-8491-d3a70e1fb117" Sep 15 21:26:19.081911 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.081877 2573 generic.go:356] "Generic (PLEG): container finished" podID="47acebf0-6334-4091-8f05-726f7dccd8fc" containerID="3d12457a47c12fb4a23cebfeac8ea89a3562edab29a2ad5cd844e584b134d934" exitCode=0 Sep 15 21:26:19.082076 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.081919 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xbf5" event={"ID":"47acebf0-6334-4091-8f05-726f7dccd8fc","Type":"ContainerDied","Data":"3d12457a47c12fb4a23cebfeac8ea89a3562edab29a2ad5cd844e584b134d934"} Sep 15 21:26:19.549308 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.549280 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5vv7\" (UniqueName: \"kubernetes.io/projected/23c8693a-bbba-4f16-951a-9f0516862649-kube-api-access-p5vv7\") pod \"network-check-target-tvvlc\" (UID: \"23c8693a-bbba-4f16-951a-9f0516862649\") " pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:26:19.549474 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:19.549451 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 21:26:19.549519 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:19.549480 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 21:26:19.549519 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:19.549492 2573 projected.go:196] Error preparing data for projected volume kube-api-access-p5vv7 for pod openshift-network-diagnostics/network-check-target-tvvlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 21:26:19.549596 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:19.549543 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23c8693a-bbba-4f16-951a-9f0516862649-kube-api-access-p5vv7 podName:23c8693a-bbba-4f16-951a-9f0516862649 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:51.549529329 +0000 UTC m=+66.136126911 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-p5vv7" (UniqueName: "kubernetes.io/projected/23c8693a-bbba-4f16-951a-9f0516862649-kube-api-access-p5vv7") pod "network-check-target-tvvlc" (UID: "23c8693a-bbba-4f16-951a-9f0516862649") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 21:26:19.650113 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.650079 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef06c19b-a992-4624-948e-2d0db582f824-original-pull-secret\") pod \"global-pull-secret-syncer-z22rp\" (UID: \"ef06c19b-a992-4624-948e-2d0db582f824\") " pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:26:19.650242 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.650154 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c225a82-b10a-42c0-8491-d3a70e1fb117-metrics-certs\") pod \"network-metrics-daemon-852v2\" (UID: \"9c225a82-b10a-42c0-8491-d3a70e1fb117\") " pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:26:19.650242 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:19.650233 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 21:26:19.650332 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:19.650285 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c225a82-b10a-42c0-8491-d3a70e1fb117-metrics-certs podName:9c225a82-b10a-42c0-8491-d3a70e1fb117 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:51.650272634 +0000 UTC m=+66.236870204 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c225a82-b10a-42c0-8491-d3a70e1fb117-metrics-certs") pod "network-metrics-daemon-852v2" (UID: "9c225a82-b10a-42c0-8491-d3a70e1fb117") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 21:26:19.650332 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:19.650233 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 21:26:19.650399 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:19.650349 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef06c19b-a992-4624-948e-2d0db582f824-original-pull-secret podName:ef06c19b-a992-4624-948e-2d0db582f824 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:51.650337569 +0000 UTC m=+66.236935150 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef06c19b-a992-4624-948e-2d0db582f824-original-pull-secret") pod "global-pull-secret-syncer-z22rp" (UID: "ef06c19b-a992-4624-948e-2d0db582f824") : object "kube-system"/"original-pull-secret" not registered Sep 15 21:26:19.651185 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.651168 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-42.ec2.internal" event="NodeReady" Sep 15 21:26:19.651284 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.651275 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 15 21:26:19.685115 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.685090 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-tzq4z"] Sep 15 21:26:19.686774 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.686759 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-tzq4z" Sep 15 21:26:19.688265 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.688241 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67fc7b5f45-9sq89"] Sep 15 21:26:19.689199 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.689182 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-lmnfx\"" Sep 15 21:26:19.689243 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.689209 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 15 21:26:19.689476 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.689463 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 15 21:26:19.690552 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.690537 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:19.702651 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.702633 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jjzfj\"" Sep 15 21:26:19.708285 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.708260 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 15 21:26:19.708360 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.708294 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 15 21:26:19.708360 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.708294 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 15 21:26:19.719630 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.719609 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-g74kn"] Sep 15 21:26:19.721381 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.721367 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-tzq4z"] Sep 15 21:26:19.721451 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.721442 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-g74kn" Sep 15 21:26:19.726136 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.726116 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-65c7764bf8-c5p5m"] Sep 15 21:26:19.728556 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.728534 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:19.748568 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.748516 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-pbvpl"] Sep 15 21:26:19.748789 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.748774 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 15 21:26:19.748894 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.748824 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 15 21:26:19.748959 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.748864 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 15 21:26:19.749046 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.749030 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-v4tz5\"" Sep 15 21:26:19.749103 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.749067 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 15 21:26:19.749334 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.749320 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 15 21:26:19.749378 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.749323 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 15 21:26:19.749783 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.749731 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 15 21:26:19.749783 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.749762 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 15 21:26:19.749783 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.749773 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 15 21:26:19.750010 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.749766 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 15 21:26:19.750010 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.750004 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-n2fmf\"" Sep 15 21:26:19.750331 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.750316 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ts2j5"] Sep 15 21:26:19.750444 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.750430 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-pbvpl" Sep 15 21:26:19.752295 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.752278 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-kc9ll"] Sep 15 21:26:19.752420 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.752406 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ts2j5" Sep 15 21:26:19.756603 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.756558 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hs9tw"] Sep 15 21:26:19.756911 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.756892 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kc9ll" Sep 15 21:26:19.759098 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.759079 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-4mqs2"] Sep 15 21:26:19.759351 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.759335 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hs9tw" Sep 15 21:26:19.762643 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.762414 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-r2j9t"] Sep 15 21:26:19.763066 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.763048 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-4mqs2" Sep 15 21:26:19.764337 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.764320 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-4d7d5"] Sep 15 21:26:19.764455 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.764440 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-r2j9t" Sep 15 21:26:19.766638 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.766620 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67fc7b5f45-9sq89"] Sep 15 21:26:19.766785 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.766771 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-nq4tk"] Sep 15 21:26:19.767735 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.766799 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-4d7d5" Sep 15 21:26:19.768752 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.768733 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d88qc"] Sep 15 21:26:19.768886 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.768826 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" Sep 15 21:26:19.771093 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.771077 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d88qc" Sep 15 21:26:19.773655 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.773639 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 15 21:26:19.773817 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.773796 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 15 21:26:19.773916 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.773655 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 15 21:26:19.773916 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.773741 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 15 21:26:19.773916 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.773644 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 15 21:26:19.774515 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.774494 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-pbvpl"] Sep 15 21:26:19.775000 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.774985 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hs9tw"] Sep 15 21:26:19.784925 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.784527 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 15 21:26:19.784925 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.784638 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zp7tz\"" Sep 15 21:26:19.785921 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.785218 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-49t7w\"" Sep 15 21:26:19.785921 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.785671 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 15 21:26:19.786023 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.785943 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 15 21:26:19.786023 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.785998 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 15 21:26:19.786193 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.786179 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 15 21:26:19.786249 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.786221 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 15 21:26:19.786358 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.786342 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 15 21:26:19.786411 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.786388 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-65c7764bf8-c5p5m"] Sep 15 21:26:19.786457 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.786446 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 15 21:26:19.786534 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.786518 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 15 21:26:19.786588 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.786572 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 15 21:26:19.786636 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.786604 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 15 21:26:19.786683 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.786576 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 15 21:26:19.790974 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.790955 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 15 21:26:19.791669 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.791652 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 15 21:26:19.791669 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.791664 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 15 21:26:19.792796 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.792781 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 15 21:26:19.793437 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.793416 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 15 21:26:19.793543 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.793483 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 15 21:26:19.793543 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.793486 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-g9cfm\"" Sep 15 21:26:19.793650 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.793491 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 15 21:26:19.793772 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.793756 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 15 21:26:19.796771 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.796501 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 15 21:26:19.796771 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.796526 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7jz98\"" Sep 15 21:26:19.796771 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.796600 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gmh69\"" Sep 15 21:26:19.796771 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.796627 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 15 21:26:19.796771 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.796636 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 15 21:26:19.796771 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.796726 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wtwmk\"" Sep 15 21:26:19.796771 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.796764 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-646rb\"" Sep 15 21:26:19.797218 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.796796 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 15 21:26:19.797218 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.797124 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-kl6x9\"" Sep 15 21:26:19.797768 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.797701 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7gcfd\"" Sep 15 21:26:19.797951 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.797932 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-g74kn"] Sep 15 21:26:19.799299 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.799002 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-4mqs2"] Sep 15 21:26:19.800747 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.800727 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-kc9ll"] Sep 15 21:26:19.801608 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.801560 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-r2j9t"] Sep 15 21:26:19.802408 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.802245 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-nq4tk"] Sep 15 21:26:19.803243 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.803223 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-4d7d5"] Sep 15 21:26:19.810805 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.806774 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ts2j5"] Sep 15 21:26:19.811400 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.811302 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 15 21:26:19.811837 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.811817 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d88qc"] Sep 15 21:26:19.812478 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.812456 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 15 21:26:19.851392 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851362 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2006e792-d99b-4fe3-a377-80a44d71bed4-tmp-dir\") pod \"dns-default-d88qc\" (UID: \"2006e792-d99b-4fe3-a377-80a44d71bed4\") " pod="openshift-dns/dns-default-d88qc" Sep 15 21:26:19.851392 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851390 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-stats-auth\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:19.851586 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851409 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d4711a1-1b97-4fe8-b382-8a810c3a1a5d-trusted-ca-bundle\") pod \"insights-operator-5844b856db-4d7d5\" (UID: \"0d4711a1-1b97-4fe8-b382-8a810c3a1a5d\") " pod="openshift-insights/insights-operator-5844b856db-4d7d5" Sep 15 21:26:19.851586 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851424 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-certificates\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:19.851586 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851440 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3072d881-886e-44a9-ae4a-b33bd9dba717-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ts2j5\" (UID: \"3072d881-886e-44a9-ae4a-b33bd9dba717\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ts2j5" Sep 15 21:26:19.851586 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851465 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g2m8\" (UniqueName: \"kubernetes.io/projected/fe5b8a05-c75a-48ae-9a1e-9b5d91630b89-kube-api-access-4g2m8\") pod \"console-operator-696884fb9c-nq4tk\" (UID: \"fe5b8a05-c75a-48ae-9a1e-9b5d91630b89\") " pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" Sep 15 21:26:19.851586 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851482 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/335e21be-9627-4187-939e-a6680c2b6733-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-4mqs2\" (UID: \"335e21be-9627-4187-939e-a6680c2b6733\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-4mqs2" Sep 15 21:26:19.851586 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851508 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b05dc56b-1d26-4765-b191-85bfc180c33c-ca-trust-extracted\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:19.851586 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851532 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fe5b8a05-c75a-48ae-9a1e-9b5d91630b89-config\") pod \"console-operator-696884fb9c-nq4tk\" (UID: \"fe5b8a05-c75a-48ae-9a1e-9b5d91630b89\") " pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" Sep 15 21:26:19.851586 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851556 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe5b8a05-c75a-48ae-9a1e-9b5d91630b89-trusted-ca\") pod \"console-operator-696884fb9c-nq4tk\" (UID: \"fe5b8a05-c75a-48ae-9a1e-9b5d91630b89\") " pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" Sep 15 21:26:19.851817 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851618 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fe5b8a05-c75a-48ae-9a1e-9b5d91630b89-serving-cert\") pod \"console-operator-696884fb9c-nq4tk\" (UID: \"fe5b8a05-c75a-48ae-9a1e-9b5d91630b89\") " pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" Sep 15 21:26:19.851817 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851660 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b05dc56b-1d26-4765-b191-85bfc180c33c-installation-pull-secrets\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:19.851817 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851692 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-default-certificate\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:19.851817 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851715 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4eee406f-4302-4f6d-b025-0ffeb454b0c1-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-kc9ll\" (UID: \"4eee406f-4302-4f6d-b025-0ffeb454b0c1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kc9ll" Sep 15 21:26:19.851817 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851733 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d4711a1-1b97-4fe8-b382-8a810c3a1a5d-tmp\") pod \"insights-operator-5844b856db-4d7d5\" (UID: \"0d4711a1-1b97-4fe8-b382-8a810c3a1a5d\") " pod="openshift-insights/insights-operator-5844b856db-4d7d5" Sep 15 21:26:19.851817 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851764 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e761257-cdb3-4046-a183-152c58a95cf3-service-ca-bundle\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:19.851817 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851789 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrvpt\" (UniqueName: \"kubernetes.io/projected/4eee406f-4302-4f6d-b025-0ffeb454b0c1-kube-api-access-qrvpt\") pod \"cluster-monitoring-operator-6cd954b897-kc9ll\" (UID: \"4eee406f-4302-4f6d-b025-0ffeb454b0c1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kc9ll" Sep 15 21:26:19.851817 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851805 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb2bl\" (UniqueName: \"kubernetes.io/projected/d54abead-997a-4566-ab01-681e14dffe15-kube-api-access-lb2bl\") pod \"service-ca-operator-cf7c776b7-g74kn\" (UID: \"d54abead-997a-4566-ab01-681e14dffe15\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-g74kn" Sep 15 21:26:19.852076 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851820 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5l47\" (UniqueName: \"kubernetes.io/projected/335e21be-9627-4187-939e-a6680c2b6733-kube-api-access-w5l47\") pod \"kube-storage-version-migrator-operator-6c8f84f897-4mqs2\" (UID: \"335e21be-9627-4187-939e-a6680c2b6733\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-4mqs2" Sep 15 21:26:19.852076 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851856 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/335e21be-9627-4187-939e-a6680c2b6733-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-4mqs2\" (UID: \"335e21be-9627-4187-939e-a6680c2b6733\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-4mqs2" Sep 15 21:26:19.852076 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851891 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcfns\" (UniqueName: \"kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-kube-api-access-rcfns\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:19.852076 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851906 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d54abead-997a-4566-ab01-681e14dffe15-serving-cert\") pod \"service-ca-operator-cf7c776b7-g74kn\" (UID: \"d54abead-997a-4566-ab01-681e14dffe15\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-g74kn" Sep 15 21:26:19.852076 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851922 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d54abead-997a-4566-ab01-681e14dffe15-config\") pod \"service-ca-operator-cf7c776b7-g74kn\" (UID: \"d54abead-997a-4566-ab01-681e14dffe15\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-g74kn" Sep 15 21:26:19.852076 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851948 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c63672d5-4ee5-4a51-98e2-b430944567b8-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-r2j9t\" (UID: \"c63672d5-4ee5-4a51-98e2-b430944567b8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-r2j9t" Sep 15 21:26:19.852076 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851966 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2006e792-d99b-4fe3-a377-80a44d71bed4-metrics-tls\") pod \"dns-default-d88qc\" (UID: \"2006e792-d99b-4fe3-a377-80a44d71bed4\") " pod="openshift-dns/dns-default-d88qc" Sep 15 21:26:19.852076 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851980 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srfdw\" (UniqueName: \"kubernetes.io/projected/0d4711a1-1b97-4fe8-b382-8a810c3a1a5d-kube-api-access-srfdw\") pod \"insights-operator-5844b856db-4d7d5\" (UID: \"0d4711a1-1b97-4fe8-b382-8a810c3a1a5d\") " pod="openshift-insights/insights-operator-5844b856db-4d7d5" Sep 15 21:26:19.852076 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.851996 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c63672d5-4ee5-4a51-98e2-b430944567b8-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-r2j9t\" (UID: \"c63672d5-4ee5-4a51-98e2-b430944567b8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-r2j9t" Sep 15 21:26:19.852076 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.852029 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eee406f-4302-4f6d-b025-0ffeb454b0c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-kc9ll\" (UID: \"4eee406f-4302-4f6d-b025-0ffeb454b0c1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kc9ll" Sep 15 21:26:19.852076 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.852054 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq4qc\" (UniqueName: \"kubernetes.io/projected/a0d9e799-32d3-4a7b-8b28-a0c9f806e1af-kube-api-access-pq4qc\") pod \"volume-data-source-validator-86695b7cc7-tzq4z\" (UID: \"a0d9e799-32d3-4a7b-8b28-a0c9f806e1af\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-tzq4z" Sep 15 21:26:19.852076 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.852072 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b05dc56b-1d26-4765-b191-85bfc180c33c-image-registry-private-configuration\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:19.852563 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.852092 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-tls\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:19.852563 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.852120 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d4711a1-1b97-4fe8-b382-8a810c3a1a5d-serving-cert\") pod \"insights-operator-5844b856db-4d7d5\" (UID: \"0d4711a1-1b97-4fe8-b382-8a810c3a1a5d\") " pod="openshift-insights/insights-operator-5844b856db-4d7d5" Sep 15 21:26:19.852563 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.852142 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d4711a1-1b97-4fe8-b382-8a810c3a1a5d-service-ca-bundle\") pod \"insights-operator-5844b856db-4d7d5\" (UID: \"0d4711a1-1b97-4fe8-b382-8a810c3a1a5d\") " pod="openshift-insights/insights-operator-5844b856db-4d7d5" Sep 15 21:26:19.852563 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.852158 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26svq\" (UniqueName: \"kubernetes.io/projected/3072d881-886e-44a9-ae4a-b33bd9dba717-kube-api-access-26svq\") pod \"cluster-samples-operator-86499c89c4-ts2j5\" (UID: \"3072d881-886e-44a9-ae4a-b33bd9dba717\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ts2j5" Sep 15 21:26:19.852563 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.852210 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe233237-a6a8-4b91-9457-25bf748485fa-cert\") pod \"ingress-canary-hs9tw\" (UID: \"fe233237-a6a8-4b91-9457-25bf748485fa\") " pod="openshift-ingress-canary/ingress-canary-hs9tw" Sep 15 21:26:19.852563 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.852252 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chrxh\" (UniqueName: \"kubernetes.io/projected/fe233237-a6a8-4b91-9457-25bf748485fa-kube-api-access-chrxh\") pod \"ingress-canary-hs9tw\" (UID: \"fe233237-a6a8-4b91-9457-25bf748485fa\") " pod="openshift-ingress-canary/ingress-canary-hs9tw" Sep 15 21:26:19.852563 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.852282 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sssrr\" (UniqueName: \"kubernetes.io/projected/2006e792-d99b-4fe3-a377-80a44d71bed4-kube-api-access-sssrr\") pod \"dns-default-d88qc\" (UID: \"2006e792-d99b-4fe3-a377-80a44d71bed4\") " pod="openshift-dns/dns-default-d88qc" Sep 15 21:26:19.852563 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.852304 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkp69\" (UniqueName: \"kubernetes.io/projected/7e761257-cdb3-4046-a183-152c58a95cf3-kube-api-access-pkp69\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:19.852563 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.852334 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0d4711a1-1b97-4fe8-b382-8a810c3a1a5d-snapshots\") pod \"insights-operator-5844b856db-4d7d5\" (UID: \"0d4711a1-1b97-4fe8-b382-8a810c3a1a5d\") " pod="openshift-insights/insights-operator-5844b856db-4d7d5" Sep 15 21:26:19.852563 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.852358 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-bound-sa-token\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:19.852563 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.852399 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcnzp\" (UniqueName: \"kubernetes.io/projected/406137ed-4bb6-4f35-884f-539e9fe9b6cf-kube-api-access-kcnzp\") pod \"network-check-source-6f8b768455-pbvpl\" (UID: \"406137ed-4bb6-4f35-884f-539e9fe9b6cf\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-pbvpl" Sep 15 21:26:19.852563 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.852423 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2006e792-d99b-4fe3-a377-80a44d71bed4-config-volume\") pod \"dns-default-d88qc\" (UID: \"2006e792-d99b-4fe3-a377-80a44d71bed4\") " pod="openshift-dns/dns-default-d88qc" Sep 15 21:26:19.852563 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.852445 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b05dc56b-1d26-4765-b191-85bfc180c33c-trusted-ca\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:19.852563 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.852473 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-metrics-certs\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:19.927763 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.927728 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:26:19.927938 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.927728 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:26:19.930239 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.930219 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pqjdv\"" Sep 15 21:26:19.930901 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.930881 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 15 21:26:19.932488 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.932465 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:19.953289 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.953270 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2006e792-d99b-4fe3-a377-80a44d71bed4-tmp-dir\") pod \"dns-default-d88qc\" (UID: \"2006e792-d99b-4fe3-a377-80a44d71bed4\") " pod="openshift-dns/dns-default-d88qc" Sep 15 21:26:19.953289 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.953294 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-stats-auth\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:19.953426 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.953313 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d4711a1-1b97-4fe8-b382-8a810c3a1a5d-trusted-ca-bundle\") pod \"insights-operator-5844b856db-4d7d5\" (UID: \"0d4711a1-1b97-4fe8-b382-8a810c3a1a5d\") " pod="openshift-insights/insights-operator-5844b856db-4d7d5" Sep 15 21:26:19.953426 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.953330 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-certificates\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:19.953426 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.953348 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3072d881-886e-44a9-ae4a-b33bd9dba717-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ts2j5\" (UID: \"3072d881-886e-44a9-ae4a-b33bd9dba717\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ts2j5" Sep 15 21:26:19.953426 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.953369 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g2m8\" (UniqueName: \"kubernetes.io/projected/fe5b8a05-c75a-48ae-9a1e-9b5d91630b89-kube-api-access-4g2m8\") pod \"console-operator-696884fb9c-nq4tk\" (UID: \"fe5b8a05-c75a-48ae-9a1e-9b5d91630b89\") " pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" Sep 15 21:26:19.953426 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.953395 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/335e21be-9627-4187-939e-a6680c2b6733-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-4mqs2\" (UID: \"335e21be-9627-4187-939e-a6680c2b6733\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-4mqs2" Sep 15 21:26:19.953656 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.953432 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b05dc56b-1d26-4765-b191-85bfc180c33c-ca-trust-extracted\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:19.953656 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:19.953455 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 21:26:19.953656 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:19.953522 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3072d881-886e-44a9-ae4a-b33bd9dba717-samples-operator-tls podName:3072d881-886e-44a9-ae4a-b33bd9dba717 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:20.453504854 +0000 UTC m=+35.040102438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3072d881-886e-44a9-ae4a-b33bd9dba717-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-ts2j5" (UID: "3072d881-886e-44a9-ae4a-b33bd9dba717") : secret "samples-operator-tls" not found Sep 15 21:26:19.953801 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.953683 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fe5b8a05-c75a-48ae-9a1e-9b5d91630b89-config\") pod \"console-operator-696884fb9c-nq4tk\" (UID: \"fe5b8a05-c75a-48ae-9a1e-9b5d91630b89\") " pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" Sep 15 21:26:19.953801 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.953722 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe5b8a05-c75a-48ae-9a1e-9b5d91630b89-trusted-ca\") pod \"console-operator-696884fb9c-nq4tk\" (UID: \"fe5b8a05-c75a-48ae-9a1e-9b5d91630b89\") " pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" Sep 15 21:26:19.953801 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.953753 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fe5b8a05-c75a-48ae-9a1e-9b5d91630b89-serving-cert\") pod \"console-operator-696884fb9c-nq4tk\" (UID: \"fe5b8a05-c75a-48ae-9a1e-9b5d91630b89\") " pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" Sep 15 21:26:19.953967 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.953826 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b05dc56b-1d26-4765-b191-85bfc180c33c-ca-trust-extracted\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:19.954044 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954023 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-certificates\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:19.954295 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954265 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d4711a1-1b97-4fe8-b382-8a810c3a1a5d-trusted-ca-bundle\") pod \"insights-operator-5844b856db-4d7d5\" (UID: \"0d4711a1-1b97-4fe8-b382-8a810c3a1a5d\") " pod="openshift-insights/insights-operator-5844b856db-4d7d5" Sep 15 21:26:19.954399 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954377 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2006e792-d99b-4fe3-a377-80a44d71bed4-tmp-dir\") pod \"dns-default-d88qc\" (UID: \"2006e792-d99b-4fe3-a377-80a44d71bed4\") " pod="openshift-dns/dns-default-d88qc" Sep 15 21:26:19.954452 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954387 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b05dc56b-1d26-4765-b191-85bfc180c33c-installation-pull-secrets\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:19.954452 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954439 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-default-certificate\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:19.954544 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954467 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4eee406f-4302-4f6d-b025-0ffeb454b0c1-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-kc9ll\" (UID: \"4eee406f-4302-4f6d-b025-0ffeb454b0c1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kc9ll" Sep 15 21:26:19.954544 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954495 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d4711a1-1b97-4fe8-b382-8a810c3a1a5d-tmp\") pod \"insights-operator-5844b856db-4d7d5\" (UID: \"0d4711a1-1b97-4fe8-b382-8a810c3a1a5d\") " pod="openshift-insights/insights-operator-5844b856db-4d7d5" Sep 15 21:26:19.954924 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954563 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e761257-cdb3-4046-a183-152c58a95cf3-service-ca-bundle\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:19.954924 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954590 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrvpt\" (UniqueName: \"kubernetes.io/projected/4eee406f-4302-4f6d-b025-0ffeb454b0c1-kube-api-access-qrvpt\") pod \"cluster-monitoring-operator-6cd954b897-kc9ll\" (UID: \"4eee406f-4302-4f6d-b025-0ffeb454b0c1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kc9ll" Sep 15 21:26:19.954924 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954616 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb2bl\" (UniqueName: \"kubernetes.io/projected/d54abead-997a-4566-ab01-681e14dffe15-kube-api-access-lb2bl\") pod \"service-ca-operator-cf7c776b7-g74kn\" (UID: \"d54abead-997a-4566-ab01-681e14dffe15\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-g74kn" Sep 15 21:26:19.954924 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954634 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe5b8a05-c75a-48ae-9a1e-9b5d91630b89-trusted-ca\") pod \"console-operator-696884fb9c-nq4tk\" (UID: \"fe5b8a05-c75a-48ae-9a1e-9b5d91630b89\") " pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" Sep 15 21:26:19.954924 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954643 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5l47\" (UniqueName: \"kubernetes.io/projected/335e21be-9627-4187-939e-a6680c2b6733-kube-api-access-w5l47\") pod \"kube-storage-version-migrator-operator-6c8f84f897-4mqs2\" (UID: \"335e21be-9627-4187-939e-a6680c2b6733\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-4mqs2" Sep 15 21:26:19.954924 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954689 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/335e21be-9627-4187-939e-a6680c2b6733-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-4mqs2\" (UID: \"335e21be-9627-4187-939e-a6680c2b6733\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-4mqs2" Sep 15 21:26:19.954924 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954718 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcfns\" (UniqueName: \"kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-kube-api-access-rcfns\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:19.954924 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954746 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d54abead-997a-4566-ab01-681e14dffe15-serving-cert\") pod \"service-ca-operator-cf7c776b7-g74kn\" (UID: \"d54abead-997a-4566-ab01-681e14dffe15\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-g74kn" Sep 15 21:26:19.954924 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954767 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d54abead-997a-4566-ab01-681e14dffe15-config\") pod \"service-ca-operator-cf7c776b7-g74kn\" (UID: \"d54abead-997a-4566-ab01-681e14dffe15\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-g74kn" Sep 15 21:26:19.954924 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954794 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c63672d5-4ee5-4a51-98e2-b430944567b8-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-r2j9t\" (UID: \"c63672d5-4ee5-4a51-98e2-b430944567b8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-r2j9t" Sep 15 21:26:19.954924 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954817 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2006e792-d99b-4fe3-a377-80a44d71bed4-metrics-tls\") pod \"dns-default-d88qc\" (UID: \"2006e792-d99b-4fe3-a377-80a44d71bed4\") " pod="openshift-dns/dns-default-d88qc" Sep 15 21:26:19.954924 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954840 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srfdw\" (UniqueName: \"kubernetes.io/projected/0d4711a1-1b97-4fe8-b382-8a810c3a1a5d-kube-api-access-srfdw\") pod \"insights-operator-5844b856db-4d7d5\" (UID: \"0d4711a1-1b97-4fe8-b382-8a810c3a1a5d\") " pod="openshift-insights/insights-operator-5844b856db-4d7d5" Sep 15 21:26:19.954924 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954888 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c63672d5-4ee5-4a51-98e2-b430944567b8-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-r2j9t\" (UID: \"c63672d5-4ee5-4a51-98e2-b430944567b8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-r2j9t" Sep 15 21:26:19.954924 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954913 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eee406f-4302-4f6d-b025-0ffeb454b0c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-kc9ll\" (UID: \"4eee406f-4302-4f6d-b025-0ffeb454b0c1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kc9ll" Sep 15 21:26:19.955520 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954942 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq4qc\" (UniqueName: \"kubernetes.io/projected/a0d9e799-32d3-4a7b-8b28-a0c9f806e1af-kube-api-access-pq4qc\") pod \"volume-data-source-validator-86695b7cc7-tzq4z\" (UID: \"a0d9e799-32d3-4a7b-8b28-a0c9f806e1af\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-tzq4z" Sep 15 21:26:19.955520 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954969 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b05dc56b-1d26-4765-b191-85bfc180c33c-image-registry-private-configuration\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:19.955520 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954990 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-tls\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:19.955520 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.955015 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d4711a1-1b97-4fe8-b382-8a810c3a1a5d-serving-cert\") pod \"insights-operator-5844b856db-4d7d5\" (UID: \"0d4711a1-1b97-4fe8-b382-8a810c3a1a5d\") " pod="openshift-insights/insights-operator-5844b856db-4d7d5" Sep 15 21:26:19.955520 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.955040 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d4711a1-1b97-4fe8-b382-8a810c3a1a5d-service-ca-bundle\") pod \"insights-operator-5844b856db-4d7d5\" (UID: \"0d4711a1-1b97-4fe8-b382-8a810c3a1a5d\") " pod="openshift-insights/insights-operator-5844b856db-4d7d5" Sep 15 21:26:19.955520 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.955061 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26svq\" (UniqueName: \"kubernetes.io/projected/3072d881-886e-44a9-ae4a-b33bd9dba717-kube-api-access-26svq\") pod \"cluster-samples-operator-86499c89c4-ts2j5\" (UID: \"3072d881-886e-44a9-ae4a-b33bd9dba717\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ts2j5" Sep 15 21:26:19.955520 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.955083 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe233237-a6a8-4b91-9457-25bf748485fa-cert\") pod \"ingress-canary-hs9tw\" (UID: \"fe233237-a6a8-4b91-9457-25bf748485fa\") " pod="openshift-ingress-canary/ingress-canary-hs9tw" Sep 15 21:26:19.955520 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.955103 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chrxh\" (UniqueName: \"kubernetes.io/projected/fe233237-a6a8-4b91-9457-25bf748485fa-kube-api-access-chrxh\") pod \"ingress-canary-hs9tw\" (UID: \"fe233237-a6a8-4b91-9457-25bf748485fa\") " pod="openshift-ingress-canary/ingress-canary-hs9tw" Sep 15 21:26:19.955520 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.955126 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sssrr\" (UniqueName: \"kubernetes.io/projected/2006e792-d99b-4fe3-a377-80a44d71bed4-kube-api-access-sssrr\") pod \"dns-default-d88qc\" (UID: \"2006e792-d99b-4fe3-a377-80a44d71bed4\") " pod="openshift-dns/dns-default-d88qc" Sep 15 21:26:19.955520 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.955148 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkp69\" (UniqueName: \"kubernetes.io/projected/7e761257-cdb3-4046-a183-152c58a95cf3-kube-api-access-pkp69\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:19.955520 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.955175 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0d4711a1-1b97-4fe8-b382-8a810c3a1a5d-snapshots\") pod \"insights-operator-5844b856db-4d7d5\" (UID: \"0d4711a1-1b97-4fe8-b382-8a810c3a1a5d\") " pod="openshift-insights/insights-operator-5844b856db-4d7d5" Sep 15 21:26:19.955520 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.955195 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-bound-sa-token\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:19.955520 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.955233 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcnzp\" (UniqueName: \"kubernetes.io/projected/406137ed-4bb6-4f35-884f-539e9fe9b6cf-kube-api-access-kcnzp\") pod \"network-check-source-6f8b768455-pbvpl\" (UID: \"406137ed-4bb6-4f35-884f-539e9fe9b6cf\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-pbvpl" Sep 15 21:26:19.955520 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.955255 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2006e792-d99b-4fe3-a377-80a44d71bed4-config-volume\") pod \"dns-default-d88qc\" (UID: \"2006e792-d99b-4fe3-a377-80a44d71bed4\") " pod="openshift-dns/dns-default-d88qc" Sep 15 21:26:19.955520 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.955275 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b05dc56b-1d26-4765-b191-85bfc180c33c-trusted-ca\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:19.955520 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.955301 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-metrics-certs\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:19.955520 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:19.955418 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 21:26:19.956368 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:19.955473 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-metrics-certs podName:7e761257-cdb3-4046-a183-152c58a95cf3 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:20.455457475 +0000 UTC m=+35.042055062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-metrics-certs") pod "router-default-65c7764bf8-c5p5m" (UID: "7e761257-cdb3-4046-a183-152c58a95cf3") : secret "router-metrics-certs-default" not found Sep 15 21:26:19.956368 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.955510 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4eee406f-4302-4f6d-b025-0ffeb454b0c1-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-kc9ll\" (UID: \"4eee406f-4302-4f6d-b025-0ffeb454b0c1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kc9ll" Sep 15 21:26:19.956368 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.954467 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fe5b8a05-c75a-48ae-9a1e-9b5d91630b89-config\") pod \"console-operator-696884fb9c-nq4tk\" (UID: \"fe5b8a05-c75a-48ae-9a1e-9b5d91630b89\") " pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" Sep 15 21:26:19.956368 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.955734 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d4711a1-1b97-4fe8-b382-8a810c3a1a5d-tmp\") pod \"insights-operator-5844b856db-4d7d5\" (UID: \"0d4711a1-1b97-4fe8-b382-8a810c3a1a5d\") " pod="openshift-insights/insights-operator-5844b856db-4d7d5" Sep 15 21:26:19.956368 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:19.955811 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e761257-cdb3-4046-a183-152c58a95cf3-service-ca-bundle podName:7e761257-cdb3-4046-a183-152c58a95cf3 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:20.455801332 +0000 UTC m=+35.042398921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e761257-cdb3-4046-a183-152c58a95cf3-service-ca-bundle") pod "router-default-65c7764bf8-c5p5m" (UID: "7e761257-cdb3-4046-a183-152c58a95cf3") : configmap references non-existent config key: service-ca.crt Sep 15 21:26:19.956368 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.955994 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/335e21be-9627-4187-939e-a6680c2b6733-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-4mqs2\" (UID: \"335e21be-9627-4187-939e-a6680c2b6733\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-4mqs2" Sep 15 21:26:19.956733 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.956642 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d4711a1-1b97-4fe8-b382-8a810c3a1a5d-service-ca-bundle\") pod \"insights-operator-5844b856db-4d7d5\" (UID: \"0d4711a1-1b97-4fe8-b382-8a810c3a1a5d\") " pod="openshift-insights/insights-operator-5844b856db-4d7d5" Sep 15 21:26:19.958734 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.958316 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fe5b8a05-c75a-48ae-9a1e-9b5d91630b89-serving-cert\") pod \"console-operator-696884fb9c-nq4tk\" (UID: \"fe5b8a05-c75a-48ae-9a1e-9b5d91630b89\") " pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" Sep 15 21:26:19.958734 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.958333 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/335e21be-9627-4187-939e-a6680c2b6733-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-4mqs2\" (UID: \"335e21be-9627-4187-939e-a6680c2b6733\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-4mqs2" Sep 15 21:26:19.958734 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.958437 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-default-certificate\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:19.958734 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.958519 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b05dc56b-1d26-4765-b191-85bfc180c33c-installation-pull-secrets\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:19.958734 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.958553 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-stats-auth\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:19.958734 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.958614 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d4711a1-1b97-4fe8-b382-8a810c3a1a5d-serving-cert\") pod \"insights-operator-5844b856db-4d7d5\" (UID: \"0d4711a1-1b97-4fe8-b382-8a810c3a1a5d\") " pod="openshift-insights/insights-operator-5844b856db-4d7d5" Sep 15 21:26:19.958734 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:19.958712 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 15 21:26:19.958734 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.958730 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0d4711a1-1b97-4fe8-b382-8a810c3a1a5d-snapshots\") pod \"insights-operator-5844b856db-4d7d5\" (UID: \"0d4711a1-1b97-4fe8-b382-8a810c3a1a5d\") " pod="openshift-insights/insights-operator-5844b856db-4d7d5" Sep 15 21:26:19.960161 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:19.958767 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c63672d5-4ee5-4a51-98e2-b430944567b8-networking-console-plugin-cert podName:c63672d5-4ee5-4a51-98e2-b430944567b8 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:20.458752906 +0000 UTC m=+35.045350482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c63672d5-4ee5-4a51-98e2-b430944567b8-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-r2j9t" (UID: "c63672d5-4ee5-4a51-98e2-b430944567b8") : secret "networking-console-plugin-cert" not found Sep 15 21:26:19.960161 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:19.958968 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 15 21:26:19.960161 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.958989 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2006e792-d99b-4fe3-a377-80a44d71bed4-config-volume\") pod \"dns-default-d88qc\" (UID: \"2006e792-d99b-4fe3-a377-80a44d71bed4\") " pod="openshift-dns/dns-default-d88qc" Sep 15 21:26:19.960161 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:19.959025 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eee406f-4302-4f6d-b025-0ffeb454b0c1-cluster-monitoring-operator-tls podName:4eee406f-4302-4f6d-b025-0ffeb454b0c1 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:20.459010161 +0000 UTC m=+35.045607745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4eee406f-4302-4f6d-b025-0ffeb454b0c1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-kc9ll" (UID: "4eee406f-4302-4f6d-b025-0ffeb454b0c1") : secret "cluster-monitoring-operator-tls" not found Sep 15 21:26:19.960161 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.959330 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b05dc56b-1d26-4765-b191-85bfc180c33c-trusted-ca\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:19.960161 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.959477 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe233237-a6a8-4b91-9457-25bf748485fa-cert\") pod \"ingress-canary-hs9tw\" (UID: \"fe233237-a6a8-4b91-9457-25bf748485fa\") " pod="openshift-ingress-canary/ingress-canary-hs9tw" Sep 15 21:26:19.960161 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:19.959496 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 21:26:19.960161 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:19.959551 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2006e792-d99b-4fe3-a377-80a44d71bed4-metrics-tls podName:2006e792-d99b-4fe3-a377-80a44d71bed4 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:20.459535814 +0000 UTC m=+35.046133395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2006e792-d99b-4fe3-a377-80a44d71bed4-metrics-tls") pod "dns-default-d88qc" (UID: "2006e792-d99b-4fe3-a377-80a44d71bed4") : secret "dns-default-metrics-tls" not found Sep 15 21:26:19.960161 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:19.959660 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 21:26:19.960161 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:19.959678 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fc7b5f45-9sq89: secret "image-registry-tls" not found Sep 15 21:26:19.960161 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:19.959733 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-tls podName:b05dc56b-1d26-4765-b191-85bfc180c33c nodeName:}" failed. No retries permitted until 2026-09-15 21:26:20.459717765 +0000 UTC m=+35.046315342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-tls") pod "image-registry-67fc7b5f45-9sq89" (UID: "b05dc56b-1d26-4765-b191-85bfc180c33c") : secret "image-registry-tls" not found Sep 15 21:26:19.960161 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.959714 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c63672d5-4ee5-4a51-98e2-b430944567b8-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-r2j9t\" (UID: \"c63672d5-4ee5-4a51-98e2-b430944567b8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-r2j9t" Sep 15 21:26:19.960800 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.960262 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d54abead-997a-4566-ab01-681e14dffe15-config\") pod \"service-ca-operator-cf7c776b7-g74kn\" (UID: \"d54abead-997a-4566-ab01-681e14dffe15\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-g74kn" Sep 15 21:26:19.961041 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.961017 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d54abead-997a-4566-ab01-681e14dffe15-serving-cert\") pod \"service-ca-operator-cf7c776b7-g74kn\" (UID: \"d54abead-997a-4566-ab01-681e14dffe15\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-g74kn" Sep 15 21:26:19.961389 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.961373 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b05dc56b-1d26-4765-b191-85bfc180c33c-image-registry-private-configuration\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:19.966454 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.966406 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g2m8\" (UniqueName: \"kubernetes.io/projected/fe5b8a05-c75a-48ae-9a1e-9b5d91630b89-kube-api-access-4g2m8\") pod \"console-operator-696884fb9c-nq4tk\" (UID: \"fe5b8a05-c75a-48ae-9a1e-9b5d91630b89\") " pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" Sep 15 21:26:19.966836 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.966779 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcfns\" (UniqueName: \"kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-kube-api-access-rcfns\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:19.967098 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.967076 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb2bl\" (UniqueName: \"kubernetes.io/projected/d54abead-997a-4566-ab01-681e14dffe15-kube-api-access-lb2bl\") pod \"service-ca-operator-cf7c776b7-g74kn\" (UID: \"d54abead-997a-4566-ab01-681e14dffe15\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-g74kn" Sep 15 21:26:19.967831 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.967790 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrvpt\" (UniqueName: \"kubernetes.io/projected/4eee406f-4302-4f6d-b025-0ffeb454b0c1-kube-api-access-qrvpt\") pod \"cluster-monitoring-operator-6cd954b897-kc9ll\" (UID: \"4eee406f-4302-4f6d-b025-0ffeb454b0c1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kc9ll" Sep 15 21:26:19.968386 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.968363 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5l47\" (UniqueName: \"kubernetes.io/projected/335e21be-9627-4187-939e-a6680c2b6733-kube-api-access-w5l47\") pod \"kube-storage-version-migrator-operator-6c8f84f897-4mqs2\" (UID: \"335e21be-9627-4187-939e-a6680c2b6733\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-4mqs2" Sep 15 21:26:19.968777 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.968760 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26svq\" (UniqueName: \"kubernetes.io/projected/3072d881-886e-44a9-ae4a-b33bd9dba717-kube-api-access-26svq\") pod \"cluster-samples-operator-86499c89c4-ts2j5\" (UID: \"3072d881-886e-44a9-ae4a-b33bd9dba717\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ts2j5" Sep 15 21:26:19.970925 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.970903 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sssrr\" (UniqueName: \"kubernetes.io/projected/2006e792-d99b-4fe3-a377-80a44d71bed4-kube-api-access-sssrr\") pod \"dns-default-d88qc\" (UID: \"2006e792-d99b-4fe3-a377-80a44d71bed4\") " pod="openshift-dns/dns-default-d88qc" Sep 15 21:26:19.971302 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.971281 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-bound-sa-token\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:19.971475 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.971458 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcnzp\" (UniqueName: \"kubernetes.io/projected/406137ed-4bb6-4f35-884f-539e9fe9b6cf-kube-api-access-kcnzp\") pod \"network-check-source-6f8b768455-pbvpl\" (UID: \"406137ed-4bb6-4f35-884f-539e9fe9b6cf\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-pbvpl" Sep 15 21:26:19.971535 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.971521 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq4qc\" (UniqueName: \"kubernetes.io/projected/a0d9e799-32d3-4a7b-8b28-a0c9f806e1af-kube-api-access-pq4qc\") pod \"volume-data-source-validator-86695b7cc7-tzq4z\" (UID: \"a0d9e799-32d3-4a7b-8b28-a0c9f806e1af\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-tzq4z" Sep 15 21:26:19.973918 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.973892 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkp69\" (UniqueName: \"kubernetes.io/projected/7e761257-cdb3-4046-a183-152c58a95cf3-kube-api-access-pkp69\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:19.974087 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.974063 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chrxh\" (UniqueName: \"kubernetes.io/projected/fe233237-a6a8-4b91-9457-25bf748485fa-kube-api-access-chrxh\") pod \"ingress-canary-hs9tw\" (UID: \"fe233237-a6a8-4b91-9457-25bf748485fa\") " pod="openshift-ingress-canary/ingress-canary-hs9tw" Sep 15 21:26:19.974734 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.974714 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srfdw\" (UniqueName: \"kubernetes.io/projected/0d4711a1-1b97-4fe8-b382-8a810c3a1a5d-kube-api-access-srfdw\") pod \"insights-operator-5844b856db-4d7d5\" (UID: \"0d4711a1-1b97-4fe8-b382-8a810c3a1a5d\") " pod="openshift-insights/insights-operator-5844b856db-4d7d5" Sep 15 21:26:19.996464 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:19.996445 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-tzq4z" Sep 15 21:26:20.019010 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:20.018979 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:20.031148 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:20.031129 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-g74kn" Sep 15 21:26:20.072549 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:20.071383 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-pbvpl" Sep 15 21:26:20.087922 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:20.087736 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hs9tw" Sep 15 21:26:20.094659 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:20.094475 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-4mqs2" Sep 15 21:26:20.113401 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:20.113372 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-4d7d5" Sep 15 21:26:20.120143 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:20.120115 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" Sep 15 21:26:20.277632 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:20.277559 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-tzq4z"] Sep 15 21:26:20.281140 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:26:20.281116 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0d9e799_32d3_4a7b_8b28_a0c9f806e1af.slice/crio-998f07142f9d251f721c4d6abfeae64d43eed6c246c1190204343cec36707e96 WatchSource:0}: Error finding container 998f07142f9d251f721c4d6abfeae64d43eed6c246c1190204343cec36707e96: Status 404 returned error can't find the container with id 998f07142f9d251f721c4d6abfeae64d43eed6c246c1190204343cec36707e96 Sep 15 21:26:20.307193 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:20.307090 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-g74kn"] Sep 15 21:26:20.310434 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:26:20.310407 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd54abead_997a_4566_ab01_681e14dffe15.slice/crio-f3b3ae131cdbbdb9cd0ef584404f82d1bf931241cfc4d111fd84a120eb625337 WatchSource:0}: Error finding container f3b3ae131cdbbdb9cd0ef584404f82d1bf931241cfc4d111fd84a120eb625337: Status 404 returned error can't find the container with id f3b3ae131cdbbdb9cd0ef584404f82d1bf931241cfc4d111fd84a120eb625337 Sep 15 21:26:20.354741 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:20.354568 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-pbvpl"] Sep 15 21:26:20.357300 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:26:20.357267 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod406137ed_4bb6_4f35_884f_539e9fe9b6cf.slice/crio-f496b174ef317a63c9e3cd7f7416a126d98d829af77babc181eebb62b1d37b85 WatchSource:0}: Error finding container f496b174ef317a63c9e3cd7f7416a126d98d829af77babc181eebb62b1d37b85: Status 404 returned error can't find the container with id f496b174ef317a63c9e3cd7f7416a126d98d829af77babc181eebb62b1d37b85 Sep 15 21:26:20.387621 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:20.387590 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hs9tw"] Sep 15 21:26:20.390816 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:20.390794 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-4mqs2"] Sep 15 21:26:20.390920 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:26:20.390812 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe233237_a6a8_4b91_9457_25bf748485fa.slice/crio-6705fda70063a3790aa58fa17e0c50e6a478283be11d562f3083d5200d049747 WatchSource:0}: Error finding container 6705fda70063a3790aa58fa17e0c50e6a478283be11d562f3083d5200d049747: Status 404 returned error can't find the container with id 6705fda70063a3790aa58fa17e0c50e6a478283be11d562f3083d5200d049747 Sep 15 21:26:20.394040 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:26:20.394003 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod335e21be_9627_4187_939e_a6680c2b6733.slice/crio-bac0868accd1a04753bdc01ce1a0b9427ad5c9d43fa307e2b867a2d7efd78b2f WatchSource:0}: Error finding container bac0868accd1a04753bdc01ce1a0b9427ad5c9d43fa307e2b867a2d7efd78b2f: Status 404 returned error can't find the container with id bac0868accd1a04753bdc01ce1a0b9427ad5c9d43fa307e2b867a2d7efd78b2f Sep 15 21:26:20.417869 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:20.417833 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-nq4tk"] Sep 15 21:26:20.420492 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:26:20.420462 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe5b8a05_c75a_48ae_9a1e_9b5d91630b89.slice/crio-3ebf5958e4632e0084d61b6171395fff00dbced0d6729eeef6da055d8e5b8342 WatchSource:0}: Error finding container 3ebf5958e4632e0084d61b6171395fff00dbced0d6729eeef6da055d8e5b8342: Status 404 returned error can't find the container with id 3ebf5958e4632e0084d61b6171395fff00dbced0d6729eeef6da055d8e5b8342 Sep 15 21:26:20.420909 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:20.420893 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-4d7d5"] Sep 15 21:26:20.423488 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:26:20.423466 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d4711a1_1b97_4fe8_b382_8a810c3a1a5d.slice/crio-0f3acfe8d548f31c333266c335d78d7490520bfc41fba87d05e3f7791b19b8e7 WatchSource:0}: Error finding container 0f3acfe8d548f31c333266c335d78d7490520bfc41fba87d05e3f7791b19b8e7: Status 404 returned error can't find the container with id 0f3acfe8d548f31c333266c335d78d7490520bfc41fba87d05e3f7791b19b8e7 Sep 15 21:26:20.462521 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:20.462489 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-metrics-certs\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:20.462637 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:20.462526 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3072d881-886e-44a9-ae4a-b33bd9dba717-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ts2j5\" (UID: \"3072d881-886e-44a9-ae4a-b33bd9dba717\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ts2j5" Sep 15 21:26:20.462637 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:20.462580 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e761257-cdb3-4046-a183-152c58a95cf3-service-ca-bundle\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:20.462637 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:20.462607 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2006e792-d99b-4fe3-a377-80a44d71bed4-metrics-tls\") pod \"dns-default-d88qc\" (UID: \"2006e792-d99b-4fe3-a377-80a44d71bed4\") " pod="openshift-dns/dns-default-d88qc" Sep 15 21:26:20.462637 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:20.462633 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c63672d5-4ee5-4a51-98e2-b430944567b8-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-r2j9t\" (UID: \"c63672d5-4ee5-4a51-98e2-b430944567b8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-r2j9t" Sep 15 21:26:20.462811 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:20.462638 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 21:26:20.462811 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:20.462659 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eee406f-4302-4f6d-b025-0ffeb454b0c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-kc9ll\" (UID: \"4eee406f-4302-4f6d-b025-0ffeb454b0c1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kc9ll" Sep 15 21:26:20.462811 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:20.462696 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-metrics-certs podName:7e761257-cdb3-4046-a183-152c58a95cf3 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:21.46267781 +0000 UTC m=+36.049275389 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-metrics-certs") pod "router-default-65c7764bf8-c5p5m" (UID: "7e761257-cdb3-4046-a183-152c58a95cf3") : secret "router-metrics-certs-default" not found Sep 15 21:26:20.462811 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:20.462720 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e761257-cdb3-4046-a183-152c58a95cf3-service-ca-bundle podName:7e761257-cdb3-4046-a183-152c58a95cf3 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:21.462709393 +0000 UTC m=+36.049306978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e761257-cdb3-4046-a183-152c58a95cf3-service-ca-bundle") pod "router-default-65c7764bf8-c5p5m" (UID: "7e761257-cdb3-4046-a183-152c58a95cf3") : configmap references non-existent config key: service-ca.crt Sep 15 21:26:20.462811 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:20.462734 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 21:26:20.462811 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:20.462778 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2006e792-d99b-4fe3-a377-80a44d71bed4-metrics-tls podName:2006e792-d99b-4fe3-a377-80a44d71bed4 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:21.462764419 +0000 UTC m=+36.049361990 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2006e792-d99b-4fe3-a377-80a44d71bed4-metrics-tls") pod "dns-default-d88qc" (UID: "2006e792-d99b-4fe3-a377-80a44d71bed4") : secret "dns-default-metrics-tls" not found Sep 15 21:26:20.462811 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:20.462733 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 21:26:20.462811 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:20.462799 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 15 21:26:20.463123 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:20.462814 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 15 21:26:20.463123 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:20.462823 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-tls\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:20.463123 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:20.462822 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3072d881-886e-44a9-ae4a-b33bd9dba717-samples-operator-tls podName:3072d881-886e-44a9-ae4a-b33bd9dba717 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:21.462812002 +0000 UTC m=+36.049409587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3072d881-886e-44a9-ae4a-b33bd9dba717-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-ts2j5" (UID: "3072d881-886e-44a9-ae4a-b33bd9dba717") : secret "samples-operator-tls" not found Sep 15 21:26:20.463123 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:20.462896 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c63672d5-4ee5-4a51-98e2-b430944567b8-networking-console-plugin-cert podName:c63672d5-4ee5-4a51-98e2-b430944567b8 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:21.462879241 +0000 UTC m=+36.049476818 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c63672d5-4ee5-4a51-98e2-b430944567b8-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-r2j9t" (UID: "c63672d5-4ee5-4a51-98e2-b430944567b8") : secret "networking-console-plugin-cert" not found Sep 15 21:26:20.463123 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:20.462905 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 21:26:20.463123 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:20.462915 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fc7b5f45-9sq89: secret "image-registry-tls" not found Sep 15 21:26:20.463123 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:20.462917 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eee406f-4302-4f6d-b025-0ffeb454b0c1-cluster-monitoring-operator-tls podName:4eee406f-4302-4f6d-b025-0ffeb454b0c1 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:21.462908571 +0000 UTC m=+36.049506141 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4eee406f-4302-4f6d-b025-0ffeb454b0c1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-kc9ll" (UID: "4eee406f-4302-4f6d-b025-0ffeb454b0c1") : secret "cluster-monitoring-operator-tls" not found Sep 15 21:26:20.463123 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:20.462962 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-tls podName:b05dc56b-1d26-4765-b191-85bfc180c33c nodeName:}" failed. No retries permitted until 2026-09-15 21:26:21.462953099 +0000 UTC m=+36.049550672 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-tls") pod "image-registry-67fc7b5f45-9sq89" (UID: "b05dc56b-1d26-4765-b191-85bfc180c33c") : secret "image-registry-tls" not found Sep 15 21:26:20.928067 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:20.928036 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:26:20.930730 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:20.930699 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 15 21:26:20.931053 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:20.931030 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q9hj2\"" Sep 15 21:26:21.093142 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:21.093019 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-tzq4z" event={"ID":"a0d9e799-32d3-4a7b-8b28-a0c9f806e1af","Type":"ContainerStarted","Data":"998f07142f9d251f721c4d6abfeae64d43eed6c246c1190204343cec36707e96"} Sep 15 21:26:21.094656 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:21.094592 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" event={"ID":"fe5b8a05-c75a-48ae-9a1e-9b5d91630b89","Type":"ContainerStarted","Data":"3ebf5958e4632e0084d61b6171395fff00dbced0d6729eeef6da055d8e5b8342"} Sep 15 21:26:21.096304 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:21.096252 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-g74kn" event={"ID":"d54abead-997a-4566-ab01-681e14dffe15","Type":"ContainerStarted","Data":"f3b3ae131cdbbdb9cd0ef584404f82d1bf931241cfc4d111fd84a120eb625337"} Sep 15 21:26:21.098280 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:21.098218 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-4mqs2" event={"ID":"335e21be-9627-4187-939e-a6680c2b6733","Type":"ContainerStarted","Data":"bac0868accd1a04753bdc01ce1a0b9427ad5c9d43fa307e2b867a2d7efd78b2f"} Sep 15 21:26:21.101692 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:21.101662 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hs9tw" event={"ID":"fe233237-a6a8-4b91-9457-25bf748485fa","Type":"ContainerStarted","Data":"6705fda70063a3790aa58fa17e0c50e6a478283be11d562f3083d5200d049747"} Sep 15 21:26:21.104494 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:21.104436 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-4d7d5" event={"ID":"0d4711a1-1b97-4fe8-b382-8a810c3a1a5d","Type":"ContainerStarted","Data":"0f3acfe8d548f31c333266c335d78d7490520bfc41fba87d05e3f7791b19b8e7"} Sep 15 21:26:21.106239 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:21.106192 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-pbvpl" event={"ID":"406137ed-4bb6-4f35-884f-539e9fe9b6cf","Type":"ContainerStarted","Data":"f496b174ef317a63c9e3cd7f7416a126d98d829af77babc181eebb62b1d37b85"} Sep 15 21:26:21.475970 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:21.474395 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e761257-cdb3-4046-a183-152c58a95cf3-service-ca-bundle\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:21.475970 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:21.474463 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2006e792-d99b-4fe3-a377-80a44d71bed4-metrics-tls\") pod \"dns-default-d88qc\" (UID: \"2006e792-d99b-4fe3-a377-80a44d71bed4\") " pod="openshift-dns/dns-default-d88qc" Sep 15 21:26:21.475970 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:21.474495 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c63672d5-4ee5-4a51-98e2-b430944567b8-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-r2j9t\" (UID: \"c63672d5-4ee5-4a51-98e2-b430944567b8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-r2j9t" Sep 15 21:26:21.475970 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:21.474573 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eee406f-4302-4f6d-b025-0ffeb454b0c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-kc9ll\" (UID: \"4eee406f-4302-4f6d-b025-0ffeb454b0c1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kc9ll" Sep 15 21:26:21.475970 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:21.474609 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-tls\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:21.475970 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:21.474690 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-metrics-certs\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:21.475970 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:21.474725 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3072d881-886e-44a9-ae4a-b33bd9dba717-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ts2j5\" (UID: \"3072d881-886e-44a9-ae4a-b33bd9dba717\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ts2j5" Sep 15 21:26:21.475970 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:21.474950 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 21:26:21.475970 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:21.475012 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3072d881-886e-44a9-ae4a-b33bd9dba717-samples-operator-tls podName:3072d881-886e-44a9-ae4a-b33bd9dba717 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:23.474993557 +0000 UTC m=+38.061591134 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3072d881-886e-44a9-ae4a-b33bd9dba717-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-ts2j5" (UID: "3072d881-886e-44a9-ae4a-b33bd9dba717") : secret "samples-operator-tls" not found Sep 15 21:26:21.475970 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:21.475105 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e761257-cdb3-4046-a183-152c58a95cf3-service-ca-bundle podName:7e761257-cdb3-4046-a183-152c58a95cf3 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:23.475094605 +0000 UTC m=+38.061692189 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e761257-cdb3-4046-a183-152c58a95cf3-service-ca-bundle") pod "router-default-65c7764bf8-c5p5m" (UID: "7e761257-cdb3-4046-a183-152c58a95cf3") : configmap references non-existent config key: service-ca.crt Sep 15 21:26:21.475970 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:21.475161 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 21:26:21.475970 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:21.475210 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2006e792-d99b-4fe3-a377-80a44d71bed4-metrics-tls podName:2006e792-d99b-4fe3-a377-80a44d71bed4 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:23.475199782 +0000 UTC m=+38.061797357 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2006e792-d99b-4fe3-a377-80a44d71bed4-metrics-tls") pod "dns-default-d88qc" (UID: "2006e792-d99b-4fe3-a377-80a44d71bed4") : secret "dns-default-metrics-tls" not found Sep 15 21:26:21.475970 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:21.475264 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 15 21:26:21.475970 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:21.475293 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c63672d5-4ee5-4a51-98e2-b430944567b8-networking-console-plugin-cert podName:c63672d5-4ee5-4a51-98e2-b430944567b8 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:23.475282839 +0000 UTC m=+38.061880426 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c63672d5-4ee5-4a51-98e2-b430944567b8-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-r2j9t" (UID: "c63672d5-4ee5-4a51-98e2-b430944567b8") : secret "networking-console-plugin-cert" not found Sep 15 21:26:21.475970 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:21.475368 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 15 21:26:21.476888 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:21.475399 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eee406f-4302-4f6d-b025-0ffeb454b0c1-cluster-monitoring-operator-tls podName:4eee406f-4302-4f6d-b025-0ffeb454b0c1 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:23.475389727 +0000 UTC m=+38.061987302 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4eee406f-4302-4f6d-b025-0ffeb454b0c1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-kc9ll" (UID: "4eee406f-4302-4f6d-b025-0ffeb454b0c1") : secret "cluster-monitoring-operator-tls" not found Sep 15 21:26:21.476888 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:21.475454 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 21:26:21.476888 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:21.475466 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fc7b5f45-9sq89: secret "image-registry-tls" not found Sep 15 21:26:21.476888 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:21.475493 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-tls podName:b05dc56b-1d26-4765-b191-85bfc180c33c nodeName:}" failed. No retries permitted until 2026-09-15 21:26:23.475484486 +0000 UTC m=+38.062082062 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-tls") pod "image-registry-67fc7b5f45-9sq89" (UID: "b05dc56b-1d26-4765-b191-85bfc180c33c") : secret "image-registry-tls" not found Sep 15 21:26:21.476888 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:21.475541 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 21:26:21.476888 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:21.475567 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-metrics-certs podName:7e761257-cdb3-4046-a183-152c58a95cf3 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:23.475557329 +0000 UTC m=+38.062154903 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-metrics-certs") pod "router-default-65c7764bf8-c5p5m" (UID: "7e761257-cdb3-4046-a183-152c58a95cf3") : secret "router-metrics-certs-default" not found Sep 15 21:26:23.497686 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:23.497595 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e761257-cdb3-4046-a183-152c58a95cf3-service-ca-bundle\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:23.497686 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:23.497664 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2006e792-d99b-4fe3-a377-80a44d71bed4-metrics-tls\") pod \"dns-default-d88qc\" (UID: \"2006e792-d99b-4fe3-a377-80a44d71bed4\") " pod="openshift-dns/dns-default-d88qc" Sep 15 21:26:23.498356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:23.497698 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c63672d5-4ee5-4a51-98e2-b430944567b8-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-r2j9t\" (UID: \"c63672d5-4ee5-4a51-98e2-b430944567b8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-r2j9t" Sep 15 21:26:23.498356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:23.497722 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eee406f-4302-4f6d-b025-0ffeb454b0c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-kc9ll\" (UID: \"4eee406f-4302-4f6d-b025-0ffeb454b0c1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kc9ll" Sep 15 21:26:23.498356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:23.497754 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-tls\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:23.498356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:23.497814 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-metrics-certs\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:23.498356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:23.497868 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3072d881-886e-44a9-ae4a-b33bd9dba717-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ts2j5\" (UID: \"3072d881-886e-44a9-ae4a-b33bd9dba717\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ts2j5" Sep 15 21:26:23.498356 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:23.497871 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 15 21:26:23.498356 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:23.497912 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e761257-cdb3-4046-a183-152c58a95cf3-service-ca-bundle podName:7e761257-cdb3-4046-a183-152c58a95cf3 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:27.497883857 +0000 UTC m=+42.084481441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e761257-cdb3-4046-a183-152c58a95cf3-service-ca-bundle") pod "router-default-65c7764bf8-c5p5m" (UID: "7e761257-cdb3-4046-a183-152c58a95cf3") : configmap references non-existent config key: service-ca.crt Sep 15 21:26:23.498356 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:23.497933 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 21:26:23.498356 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:23.497953 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eee406f-4302-4f6d-b025-0ffeb454b0c1-cluster-monitoring-operator-tls podName:4eee406f-4302-4f6d-b025-0ffeb454b0c1 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:27.497942011 +0000 UTC m=+42.084539587 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4eee406f-4302-4f6d-b025-0ffeb454b0c1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-kc9ll" (UID: "4eee406f-4302-4f6d-b025-0ffeb454b0c1") : secret "cluster-monitoring-operator-tls" not found Sep 15 21:26:23.498356 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:23.497870 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 21:26:23.498356 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:23.497988 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 21:26:23.498356 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:23.497938 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 21:26:23.498356 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:23.498025 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fc7b5f45-9sq89: secret "image-registry-tls" not found Sep 15 21:26:23.498356 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:23.497980 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-metrics-certs podName:7e761257-cdb3-4046-a183-152c58a95cf3 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:27.497967719 +0000 UTC m=+42.084565288 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-metrics-certs") pod "router-default-65c7764bf8-c5p5m" (UID: "7e761257-cdb3-4046-a183-152c58a95cf3") : secret "router-metrics-certs-default" not found Sep 15 21:26:23.498356 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:23.498064 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-tls podName:b05dc56b-1d26-4765-b191-85bfc180c33c nodeName:}" failed. No retries permitted until 2026-09-15 21:26:27.498050423 +0000 UTC m=+42.084647997 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-tls") pod "image-registry-67fc7b5f45-9sq89" (UID: "b05dc56b-1d26-4765-b191-85bfc180c33c") : secret "image-registry-tls" not found Sep 15 21:26:23.498356 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:23.498105 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2006e792-d99b-4fe3-a377-80a44d71bed4-metrics-tls podName:2006e792-d99b-4fe3-a377-80a44d71bed4 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:27.498089157 +0000 UTC m=+42.084686736 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2006e792-d99b-4fe3-a377-80a44d71bed4-metrics-tls") pod "dns-default-d88qc" (UID: "2006e792-d99b-4fe3-a377-80a44d71bed4") : secret "dns-default-metrics-tls" not found Sep 15 21:26:23.499149 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:23.498124 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3072d881-886e-44a9-ae4a-b33bd9dba717-samples-operator-tls podName:3072d881-886e-44a9-ae4a-b33bd9dba717 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:27.498114662 +0000 UTC m=+42.084712231 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3072d881-886e-44a9-ae4a-b33bd9dba717-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-ts2j5" (UID: "3072d881-886e-44a9-ae4a-b33bd9dba717") : secret "samples-operator-tls" not found Sep 15 21:26:23.499149 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:23.498146 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 15 21:26:23.499149 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:23.498189 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c63672d5-4ee5-4a51-98e2-b430944567b8-networking-console-plugin-cert podName:c63672d5-4ee5-4a51-98e2-b430944567b8 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:27.498175581 +0000 UTC m=+42.084773180 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c63672d5-4ee5-4a51-98e2-b430944567b8-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-r2j9t" (UID: "c63672d5-4ee5-4a51-98e2-b430944567b8") : secret "networking-console-plugin-cert" not found Sep 15 21:26:23.964331 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:23.964253 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:24.019116 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:24.019072 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:26.012571 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:26.012536 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:26.093740 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:26.093699 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:26.157560 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:26.157526 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:27.024294 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:27.024244 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:27.077689 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:27.077635 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:27.535198 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:27.535165 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e761257-cdb3-4046-a183-152c58a95cf3-service-ca-bundle\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:27.535365 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:27.535231 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2006e792-d99b-4fe3-a377-80a44d71bed4-metrics-tls\") pod \"dns-default-d88qc\" (UID: \"2006e792-d99b-4fe3-a377-80a44d71bed4\") " pod="openshift-dns/dns-default-d88qc" Sep 15 21:26:27.535365 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:27.535255 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c63672d5-4ee5-4a51-98e2-b430944567b8-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-r2j9t\" (UID: \"c63672d5-4ee5-4a51-98e2-b430944567b8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-r2j9t" Sep 15 21:26:27.535365 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:27.535274 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eee406f-4302-4f6d-b025-0ffeb454b0c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-kc9ll\" (UID: \"4eee406f-4302-4f6d-b025-0ffeb454b0c1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kc9ll" Sep 15 21:26:27.535365 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:27.535307 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-tls\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:27.535365 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:27.535357 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e761257-cdb3-4046-a183-152c58a95cf3-service-ca-bundle podName:7e761257-cdb3-4046-a183-152c58a95cf3 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:35.535332814 +0000 UTC m=+50.121930389 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e761257-cdb3-4046-a183-152c58a95cf3-service-ca-bundle") pod "router-default-65c7764bf8-c5p5m" (UID: "7e761257-cdb3-4046-a183-152c58a95cf3") : configmap references non-existent config key: service-ca.crt Sep 15 21:26:27.535615 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:27.535415 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 21:26:27.535615 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:27.535426 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-metrics-certs\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:27.535615 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:27.535439 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 15 21:26:27.535615 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:27.535473 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2006e792-d99b-4fe3-a377-80a44d71bed4-metrics-tls podName:2006e792-d99b-4fe3-a377-80a44d71bed4 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:35.535456097 +0000 UTC m=+50.122053684 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2006e792-d99b-4fe3-a377-80a44d71bed4-metrics-tls") pod "dns-default-d88qc" (UID: "2006e792-d99b-4fe3-a377-80a44d71bed4") : secret "dns-default-metrics-tls" not found Sep 15 21:26:27.535615 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:27.535497 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eee406f-4302-4f6d-b025-0ffeb454b0c1-cluster-monitoring-operator-tls podName:4eee406f-4302-4f6d-b025-0ffeb454b0c1 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:35.535481201 +0000 UTC m=+50.122078790 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4eee406f-4302-4f6d-b025-0ffeb454b0c1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-kc9ll" (UID: "4eee406f-4302-4f6d-b025-0ffeb454b0c1") : secret "cluster-monitoring-operator-tls" not found Sep 15 21:26:27.535615 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:27.535500 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 15 21:26:27.535615 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:27.535518 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 21:26:27.535615 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:27.535523 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3072d881-886e-44a9-ae4a-b33bd9dba717-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ts2j5\" (UID: \"3072d881-886e-44a9-ae4a-b33bd9dba717\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ts2j5" Sep 15 21:26:27.535615 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:27.535590 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-metrics-certs podName:7e761257-cdb3-4046-a183-152c58a95cf3 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:35.535578028 +0000 UTC m=+50.122175599 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-metrics-certs") pod "router-default-65c7764bf8-c5p5m" (UID: "7e761257-cdb3-4046-a183-152c58a95cf3") : secret "router-metrics-certs-default" not found Sep 15 21:26:27.535615 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:27.535598 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 21:26:27.535615 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:27.535603 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 21:26:27.535615 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:27.535606 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c63672d5-4ee5-4a51-98e2-b430944567b8-networking-console-plugin-cert podName:c63672d5-4ee5-4a51-98e2-b430944567b8 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:35.535597927 +0000 UTC m=+50.122195497 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c63672d5-4ee5-4a51-98e2-b430944567b8-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-r2j9t" (UID: "c63672d5-4ee5-4a51-98e2-b430944567b8") : secret "networking-console-plugin-cert" not found Sep 15 21:26:27.535615 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:27.535609 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fc7b5f45-9sq89: secret "image-registry-tls" not found Sep 15 21:26:27.536113 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:27.535635 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3072d881-886e-44a9-ae4a-b33bd9dba717-samples-operator-tls podName:3072d881-886e-44a9-ae4a-b33bd9dba717 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:35.535623025 +0000 UTC m=+50.122220603 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3072d881-886e-44a9-ae4a-b33bd9dba717-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-ts2j5" (UID: "3072d881-886e-44a9-ae4a-b33bd9dba717") : secret "samples-operator-tls" not found Sep 15 21:26:27.536113 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:27.535647 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-tls podName:b05dc56b-1d26-4765-b191-85bfc180c33c nodeName:}" failed. No retries permitted until 2026-09-15 21:26:35.535641947 +0000 UTC m=+50.122239517 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-tls") pod "image-registry-67fc7b5f45-9sq89" (UID: "b05dc56b-1d26-4765-b191-85bfc180c33c") : secret "image-registry-tls" not found Sep 15 21:26:27.967699 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:27.967616 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:29.503759 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:29.503708 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:29.602216 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:29.602179 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:29.855462 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:29.855371 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:29.917274 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:29.917233 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:31.143501 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.143466 2573 generic.go:356] "Generic (PLEG): container finished" podID="47acebf0-6334-4091-8f05-726f7dccd8fc" containerID="11b01d5ec1ca5f0024ce7e76e695bc9eefb99a795affdf22a9d134f252d5d7c3" exitCode=0 Sep 15 21:26:31.143988 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.143519 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xbf5" event={"ID":"47acebf0-6334-4091-8f05-726f7dccd8fc","Type":"ContainerDied","Data":"11b01d5ec1ca5f0024ce7e76e695bc9eefb99a795affdf22a9d134f252d5d7c3"} Sep 15 21:26:31.146993 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.146508 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-4mqs2" event={"ID":"335e21be-9627-4187-939e-a6680c2b6733","Type":"ContainerStarted","Data":"179f9703be02af028b429b7f5ab85cbbc11543801e928681aa404d2ea2890d5d"} Sep 15 21:26:31.148428 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.148375 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hs9tw" event={"ID":"fe233237-a6a8-4b91-9457-25bf748485fa","Type":"ContainerStarted","Data":"79d69950827bf409a4b479af759c76d64b20d676c933fb8b2acec7d761a500ad"} Sep 15 21:26:31.150512 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.150475 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-4d7d5" event={"ID":"0d4711a1-1b97-4fe8-b382-8a810c3a1a5d","Type":"ContainerStarted","Data":"d9032877ddd921713928fa3b54840f53ef01318a2ace942977404db821618327"} Sep 15 21:26:31.152243 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.152220 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-pbvpl" event={"ID":"406137ed-4bb6-4f35-884f-539e9fe9b6cf","Type":"ContainerStarted","Data":"5cfe3c4048cd7375120d8fd5c04fadbe8019b4d8e5058e41c909a475ea6360b8"} Sep 15 21:26:31.153775 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.153748 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-tzq4z" event={"ID":"a0d9e799-32d3-4a7b-8b28-a0c9f806e1af","Type":"ContainerStarted","Data":"6168f1bb270a7219f1e2b2308bdf86f3a8f4cc5e45b2ee641bb5ceef32cc86c4"} Sep 15 21:26:31.155482 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.155465 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/0.log" Sep 15 21:26:31.155573 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.155499 2573 generic.go:356] "Generic (PLEG): container finished" podID="fe5b8a05-c75a-48ae-9a1e-9b5d91630b89" containerID="3f1f3d52cff460a5ec89f970fd94a30700fc6b84f84c3c9bf27c50db7189dfad" exitCode=255 Sep 15 21:26:31.155634 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.155583 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" event={"ID":"fe5b8a05-c75a-48ae-9a1e-9b5d91630b89","Type":"ContainerDied","Data":"3f1f3d52cff460a5ec89f970fd94a30700fc6b84f84c3c9bf27c50db7189dfad"} Sep 15 21:26:31.155750 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.155733 2573 scope.go:117] "RemoveContainer" containerID="3f1f3d52cff460a5ec89f970fd94a30700fc6b84f84c3c9bf27c50db7189dfad" Sep 15 21:26:31.157262 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.157233 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-g74kn" event={"ID":"d54abead-997a-4566-ab01-681e14dffe15","Type":"ContainerStarted","Data":"5277ce7f928a5598ac8867928d90820b7373f8b6188551e3baa21a5de0009011"} Sep 15 21:26:31.181538 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.181482 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hs9tw" podStartSLOduration=2.398593812 podStartE2EDuration="12.181462597s" totalImagesPullingTime="9.782868785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:31.1810147 +0000 UTC m=+45.767612294" watchObservedRunningTime="2026-09-15 21:26:31.181462597 +0000 UTC m=+45.768060184" Sep 15 21:26:31.192051 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.190310 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:31.231574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.231291 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-4mqs2" podStartSLOduration=6.491585809 podStartE2EDuration="16.231270604s" totalImagesPullingTime="9.739684795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:31.206049059 +0000 UTC m=+45.792646655" watchObservedRunningTime="2026-09-15 21:26:31.231270604 +0000 UTC m=+45.817868199" Sep 15 21:26:31.248534 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.247524 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-4d7d5" podStartSLOduration=6.498094919 podStartE2EDuration="16.247504331s" totalImagesPullingTime="9.749409412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:31.2471991 +0000 UTC m=+45.833796695" watchObservedRunningTime="2026-09-15 21:26:31.247504331 +0000 UTC m=+45.834101925" Sep 15 21:26:31.258035 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.257987 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:31.271657 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.271608 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-tzq4z" podStartSLOduration=6.380560362 podStartE2EDuration="16.271586899s" totalImagesPullingTime="9.891026537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:31.270018568 +0000 UTC m=+45.856616161" watchObservedRunningTime="2026-09-15 21:26:31.271586899 +0000 UTC m=+45.858184493" Sep 15 21:26:31.307310 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.306963 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-g74kn" podStartSLOduration=6.484291846 podStartE2EDuration="16.306941086s" totalImagesPullingTime="9.82264924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:31.293969162 +0000 UTC m=+45.880566759" watchObservedRunningTime="2026-09-15 21:26:31.306941086 +0000 UTC m=+45.893538693" Sep 15 21:26:31.317968 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.317832 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-pbvpl" podStartSLOduration=6.252506953 podStartE2EDuration="16.317816098s" totalImagesPullingTime="10.065309145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:31.317248149 +0000 UTC m=+45.903845741" watchObservedRunningTime="2026-09-15 21:26:31.317816098 +0000 UTC m=+45.904413695" Sep 15 21:26:31.367862 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.367812 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:31.717228 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.717191 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:31.776754 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.776721 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-db6kb"] Sep 15 21:26:31.796284 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.796259 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:31.799539 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.799518 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 15 21:26:31.800372 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.800353 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fd7sr\"" Sep 15 21:26:31.803451 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.803058 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 15 21:26:31.814958 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.814930 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-db6kb"] Sep 15 21:26:31.825935 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.825906 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:31.875283 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.875243 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d1354b88-afbc-439f-ad1d-297368efa425-crio-socket\") pod \"insights-runtime-extractor-db6kb\" (UID: \"d1354b88-afbc-439f-ad1d-297368efa425\") " pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:31.875433 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.875363 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1354b88-afbc-439f-ad1d-297368efa425-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-db6kb\" (UID: \"d1354b88-afbc-439f-ad1d-297368efa425\") " pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:31.875516 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.875477 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42jm7\" (UniqueName: \"kubernetes.io/projected/d1354b88-afbc-439f-ad1d-297368efa425-kube-api-access-42jm7\") pod \"insights-runtime-extractor-db6kb\" (UID: \"d1354b88-afbc-439f-ad1d-297368efa425\") " pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:31.875589 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.875574 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1354b88-afbc-439f-ad1d-297368efa425-data-volume\") pod \"insights-runtime-extractor-db6kb\" (UID: \"d1354b88-afbc-439f-ad1d-297368efa425\") " pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:31.875694 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.875601 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1354b88-afbc-439f-ad1d-297368efa425-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-db6kb\" (UID: \"d1354b88-afbc-439f-ad1d-297368efa425\") " pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:31.917738 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.917701 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:31.976988 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.976897 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1354b88-afbc-439f-ad1d-297368efa425-data-volume\") pod \"insights-runtime-extractor-db6kb\" (UID: \"d1354b88-afbc-439f-ad1d-297368efa425\") " pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:31.976988 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.976932 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1354b88-afbc-439f-ad1d-297368efa425-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-db6kb\" (UID: \"d1354b88-afbc-439f-ad1d-297368efa425\") " pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:31.976988 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.976954 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d1354b88-afbc-439f-ad1d-297368efa425-crio-socket\") pod \"insights-runtime-extractor-db6kb\" (UID: \"d1354b88-afbc-439f-ad1d-297368efa425\") " pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:31.977268 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.977020 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d1354b88-afbc-439f-ad1d-297368efa425-crio-socket\") pod \"insights-runtime-extractor-db6kb\" (UID: \"d1354b88-afbc-439f-ad1d-297368efa425\") " pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:31.977268 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:31.977056 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 21:26:31.977268 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:31.977126 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d1354b88-afbc-439f-ad1d-297368efa425-kube-rbac-proxy-cm podName:d1354b88-afbc-439f-ad1d-297368efa425 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:32.477106091 +0000 UTC m=+47.063703663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d1354b88-afbc-439f-ad1d-297368efa425-kube-rbac-proxy-cm") pod "insights-runtime-extractor-db6kb" (UID: "d1354b88-afbc-439f-ad1d-297368efa425") : configmap "kube-rbac-proxy" not found Sep 15 21:26:31.977413 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.977276 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1354b88-afbc-439f-ad1d-297368efa425-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-db6kb\" (UID: \"d1354b88-afbc-439f-ad1d-297368efa425\") " pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:31.977413 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.977310 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1354b88-afbc-439f-ad1d-297368efa425-data-volume\") pod \"insights-runtime-extractor-db6kb\" (UID: \"d1354b88-afbc-439f-ad1d-297368efa425\") " pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:31.977413 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.977368 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42jm7\" (UniqueName: \"kubernetes.io/projected/d1354b88-afbc-439f-ad1d-297368efa425-kube-api-access-42jm7\") pod \"insights-runtime-extractor-db6kb\" (UID: \"d1354b88-afbc-439f-ad1d-297368efa425\") " pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:31.977512 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:31.977415 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 21:26:31.977512 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:31.977475 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1354b88-afbc-439f-ad1d-297368efa425-insights-runtime-extractor-tls podName:d1354b88-afbc-439f-ad1d-297368efa425 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:32.477458917 +0000 UTC m=+47.064056492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d1354b88-afbc-439f-ad1d-297368efa425-insights-runtime-extractor-tls") pod "insights-runtime-extractor-db6kb" (UID: "d1354b88-afbc-439f-ad1d-297368efa425") : secret "insights-runtime-extractor-tls" not found Sep 15 21:26:31.988743 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:31.988710 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42jm7\" (UniqueName: \"kubernetes.io/projected/d1354b88-afbc-439f-ad1d-297368efa425-kube-api-access-42jm7\") pod \"insights-runtime-extractor-db6kb\" (UID: \"d1354b88-afbc-439f-ad1d-297368efa425\") " pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:32.162610 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:32.162578 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/1.log" Sep 15 21:26:32.163059 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:32.163044 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/0.log" Sep 15 21:26:32.163105 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:32.163078 2573 generic.go:356] "Generic (PLEG): container finished" podID="fe5b8a05-c75a-48ae-9a1e-9b5d91630b89" containerID="111233771fd76e63944be788f1e9233eb21c0141dbe1ab18c935090f5f7b350c" exitCode=255 Sep 15 21:26:32.163171 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:32.163157 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" event={"ID":"fe5b8a05-c75a-48ae-9a1e-9b5d91630b89","Type":"ContainerDied","Data":"111233771fd76e63944be788f1e9233eb21c0141dbe1ab18c935090f5f7b350c"} Sep 15 21:26:32.163224 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:32.163200 2573 scope.go:117] "RemoveContainer" containerID="3f1f3d52cff460a5ec89f970fd94a30700fc6b84f84c3c9bf27c50db7189dfad" Sep 15 21:26:32.163523 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:32.163495 2573 scope.go:117] "RemoveContainer" containerID="111233771fd76e63944be788f1e9233eb21c0141dbe1ab18c935090f5f7b350c" Sep 15 21:26:32.163705 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:32.163684 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-nq4tk_openshift-console-operator(fe5b8a05-c75a-48ae-9a1e-9b5d91630b89)\"" pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" podUID="fe5b8a05-c75a-48ae-9a1e-9b5d91630b89" Sep 15 21:26:32.166387 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:32.166364 2573 generic.go:356] "Generic (PLEG): container finished" podID="47acebf0-6334-4091-8f05-726f7dccd8fc" containerID="63b08b0011b7c3c172477ecd0b71a5feadce916f011faed12c222ff41bb01a29" exitCode=0 Sep 15 21:26:32.167057 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:32.166936 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xbf5" event={"ID":"47acebf0-6334-4091-8f05-726f7dccd8fc","Type":"ContainerDied","Data":"63b08b0011b7c3c172477ecd0b71a5feadce916f011faed12c222ff41bb01a29"} Sep 15 21:26:32.481022 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:32.480982 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1354b88-afbc-439f-ad1d-297368efa425-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-db6kb\" (UID: \"d1354b88-afbc-439f-ad1d-297368efa425\") " pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:32.481208 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:32.481106 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 21:26:32.481208 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:32.481118 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1354b88-afbc-439f-ad1d-297368efa425-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-db6kb\" (UID: \"d1354b88-afbc-439f-ad1d-297368efa425\") " pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:32.481208 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:32.481176 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d1354b88-afbc-439f-ad1d-297368efa425-kube-rbac-proxy-cm podName:d1354b88-afbc-439f-ad1d-297368efa425 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:33.481159326 +0000 UTC m=+48.067756896 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d1354b88-afbc-439f-ad1d-297368efa425-kube-rbac-proxy-cm") pod "insights-runtime-extractor-db6kb" (UID: "d1354b88-afbc-439f-ad1d-297368efa425") : configmap "kube-rbac-proxy" not found Sep 15 21:26:32.481325 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:32.481224 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 21:26:32.481325 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:32.481279 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1354b88-afbc-439f-ad1d-297368efa425-insights-runtime-extractor-tls podName:d1354b88-afbc-439f-ad1d-297368efa425 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:33.481264229 +0000 UTC m=+48.067861799 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d1354b88-afbc-439f-ad1d-297368efa425-insights-runtime-extractor-tls") pod "insights-runtime-extractor-db6kb" (UID: "d1354b88-afbc-439f-ad1d-297368efa425") : secret "insights-runtime-extractor-tls" not found Sep 15 21:26:32.643661 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:32.643570 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:32.700108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:32.700067 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:33.078901 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:33.078813 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:33.116975 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:33.116948 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6pvrb_e3df5fab-3b41-4274-ba5f-dff5143b9192/dns-node-resolver/0.log" Sep 15 21:26:33.172563 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:33.172525 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5xbf5" event={"ID":"47acebf0-6334-4091-8f05-726f7dccd8fc","Type":"ContainerStarted","Data":"5064cd96484e37c2e08b771f10f7e8dd6a8c6e339b7043becc67a8debd5de89e"} Sep 15 21:26:33.174084 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:33.174060 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/1.log" Sep 15 21:26:33.174370 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:33.174346 2573 scope.go:117] "RemoveContainer" containerID="111233771fd76e63944be788f1e9233eb21c0141dbe1ab18c935090f5f7b350c" Sep 15 21:26:33.174509 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:33.174493 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-nq4tk_openshift-console-operator(fe5b8a05-c75a-48ae-9a1e-9b5d91630b89)\"" pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" podUID="fe5b8a05-c75a-48ae-9a1e-9b5d91630b89" Sep 15 21:26:33.198125 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:33.198068 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5xbf5" podStartSLOduration=8.626970144 podStartE2EDuration="47.19804905s" totalImagesPullingTime="38.571078906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:25:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:33.195985034 +0000 UTC m=+47.782582636" watchObservedRunningTime="2026-09-15 21:26:33.19804905 +0000 UTC m=+47.784646642" Sep 15 21:26:33.203460 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:33.203428 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:33.302782 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:33.302722 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:33.401771 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:33.401684 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:33.489905 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:33.489870 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1354b88-afbc-439f-ad1d-297368efa425-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-db6kb\" (UID: \"d1354b88-afbc-439f-ad1d-297368efa425\") " pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:33.490015 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:33.489958 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1354b88-afbc-439f-ad1d-297368efa425-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-db6kb\" (UID: \"d1354b88-afbc-439f-ad1d-297368efa425\") " pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:33.490015 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:33.489993 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 21:26:33.490093 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:33.490042 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 21:26:33.490093 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:33.490067 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d1354b88-afbc-439f-ad1d-297368efa425-kube-rbac-proxy-cm podName:d1354b88-afbc-439f-ad1d-297368efa425 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:35.490049935 +0000 UTC m=+50.076647507 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d1354b88-afbc-439f-ad1d-297368efa425-kube-rbac-proxy-cm") pod "insights-runtime-extractor-db6kb" (UID: "d1354b88-afbc-439f-ad1d-297368efa425") : configmap "kube-rbac-proxy" not found Sep 15 21:26:33.490171 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:33.490095 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1354b88-afbc-439f-ad1d-297368efa425-insights-runtime-extractor-tls podName:d1354b88-afbc-439f-ad1d-297368efa425 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:35.490084205 +0000 UTC m=+50.076681788 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d1354b88-afbc-439f-ad1d-297368efa425-insights-runtime-extractor-tls") pod "insights-runtime-extractor-db6kb" (UID: "d1354b88-afbc-439f-ad1d-297368efa425") : secret "insights-runtime-extractor-tls" not found Sep 15 21:26:34.118242 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:34.118216 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8qm2x_2da7d8f4-3fa7-4d76-86b9-1f22852adcef/node-ca/0.log" Sep 15 21:26:34.501478 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:34.501442 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:34.587980 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:34.587942 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:34.995880 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:34.995826 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:35.062139 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:35.062106 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:35.117465 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:35.117437 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hs9tw_fe233237-a6a8-4b91-9457-25bf748485fa/serve-healthcheck-canary/0.log" Sep 15 21:26:35.507919 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:35.507890 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1354b88-afbc-439f-ad1d-297368efa425-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-db6kb\" (UID: \"d1354b88-afbc-439f-ad1d-297368efa425\") " pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:35.508278 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:35.507990 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1354b88-afbc-439f-ad1d-297368efa425-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-db6kb\" (UID: \"d1354b88-afbc-439f-ad1d-297368efa425\") " pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:35.508278 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:35.508015 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 21:26:35.508278 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:35.508095 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d1354b88-afbc-439f-ad1d-297368efa425-kube-rbac-proxy-cm podName:d1354b88-afbc-439f-ad1d-297368efa425 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:39.508077653 +0000 UTC m=+54.094675243 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d1354b88-afbc-439f-ad1d-297368efa425-kube-rbac-proxy-cm") pod "insights-runtime-extractor-db6kb" (UID: "d1354b88-afbc-439f-ad1d-297368efa425") : configmap "kube-rbac-proxy" not found Sep 15 21:26:35.508278 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:35.508142 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 21:26:35.508278 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:35.508203 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1354b88-afbc-439f-ad1d-297368efa425-insights-runtime-extractor-tls podName:d1354b88-afbc-439f-ad1d-297368efa425 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:39.508189819 +0000 UTC m=+54.094787389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d1354b88-afbc-439f-ad1d-297368efa425-insights-runtime-extractor-tls") pod "insights-runtime-extractor-db6kb" (UID: "d1354b88-afbc-439f-ad1d-297368efa425") : secret "insights-runtime-extractor-tls" not found Sep 15 21:26:35.609017 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:35.608984 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3072d881-886e-44a9-ae4a-b33bd9dba717-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ts2j5\" (UID: \"3072d881-886e-44a9-ae4a-b33bd9dba717\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ts2j5" Sep 15 21:26:35.609169 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:35.609052 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e761257-cdb3-4046-a183-152c58a95cf3-service-ca-bundle\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:35.609169 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:35.609081 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2006e792-d99b-4fe3-a377-80a44d71bed4-metrics-tls\") pod \"dns-default-d88qc\" (UID: \"2006e792-d99b-4fe3-a377-80a44d71bed4\") " pod="openshift-dns/dns-default-d88qc" Sep 15 21:26:35.609169 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:35.609099 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c63672d5-4ee5-4a51-98e2-b430944567b8-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-r2j9t\" (UID: \"c63672d5-4ee5-4a51-98e2-b430944567b8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-r2j9t" Sep 15 21:26:35.609169 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:35.609117 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eee406f-4302-4f6d-b025-0ffeb454b0c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-kc9ll\" (UID: \"4eee406f-4302-4f6d-b025-0ffeb454b0c1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kc9ll" Sep 15 21:26:35.609169 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:35.609125 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 21:26:35.609169 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:35.609147 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-tls\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:35.609422 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:35.609207 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 21:26:35.609422 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:35.609222 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 15 21:26:35.609422 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:35.609237 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3072d881-886e-44a9-ae4a-b33bd9dba717-samples-operator-tls podName:3072d881-886e-44a9-ae4a-b33bd9dba717 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:51.609218989 +0000 UTC m=+66.195816576 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3072d881-886e-44a9-ae4a-b33bd9dba717-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-ts2j5" (UID: "3072d881-886e-44a9-ae4a-b33bd9dba717") : secret "samples-operator-tls" not found Sep 15 21:26:35.609422 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:35.609225 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 15 21:26:35.609422 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:35.609265 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 21:26:35.609422 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:35.609350 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fc7b5f45-9sq89: secret "image-registry-tls" not found Sep 15 21:26:35.609422 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:35.609270 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2006e792-d99b-4fe3-a377-80a44d71bed4-metrics-tls podName:2006e792-d99b-4fe3-a377-80a44d71bed4 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:51.609247956 +0000 UTC m=+66.195845531 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2006e792-d99b-4fe3-a377-80a44d71bed4-metrics-tls") pod "dns-default-d88qc" (UID: "2006e792-d99b-4fe3-a377-80a44d71bed4") : secret "dns-default-metrics-tls" not found Sep 15 21:26:35.609422 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:35.609383 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eee406f-4302-4f6d-b025-0ffeb454b0c1-cluster-monitoring-operator-tls podName:4eee406f-4302-4f6d-b025-0ffeb454b0c1 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:51.609376573 +0000 UTC m=+66.195974143 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4eee406f-4302-4f6d-b025-0ffeb454b0c1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-kc9ll" (UID: "4eee406f-4302-4f6d-b025-0ffeb454b0c1") : secret "cluster-monitoring-operator-tls" not found Sep 15 21:26:35.609422 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:35.609398 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-metrics-certs\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:35.609422 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:35.609439 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e761257-cdb3-4046-a183-152c58a95cf3-service-ca-bundle podName:7e761257-cdb3-4046-a183-152c58a95cf3 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:51.609431898 +0000 UTC m=+66.196029467 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e761257-cdb3-4046-a183-152c58a95cf3-service-ca-bundle") pod "router-default-65c7764bf8-c5p5m" (UID: "7e761257-cdb3-4046-a183-152c58a95cf3") : configmap references non-existent config key: service-ca.crt Sep 15 21:26:35.609798 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:35.609449 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c63672d5-4ee5-4a51-98e2-b430944567b8-networking-console-plugin-cert podName:c63672d5-4ee5-4a51-98e2-b430944567b8 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:51.609443487 +0000 UTC m=+66.196041056 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c63672d5-4ee5-4a51-98e2-b430944567b8-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-r2j9t" (UID: "c63672d5-4ee5-4a51-98e2-b430944567b8") : secret "networking-console-plugin-cert" not found Sep 15 21:26:35.609798 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:35.609459 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-tls podName:b05dc56b-1d26-4765-b191-85bfc180c33c nodeName:}" failed. No retries permitted until 2026-09-15 21:26:51.60945303 +0000 UTC m=+66.196050599 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-tls") pod "image-registry-67fc7b5f45-9sq89" (UID: "b05dc56b-1d26-4765-b191-85bfc180c33c") : secret "image-registry-tls" not found Sep 15 21:26:35.609798 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:35.609463 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 21:26:35.609798 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:35.609536 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-metrics-certs podName:7e761257-cdb3-4046-a183-152c58a95cf3 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:51.609518444 +0000 UTC m=+66.196116013 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-metrics-certs") pod "router-default-65c7764bf8-c5p5m" (UID: "7e761257-cdb3-4046-a183-152c58a95cf3") : secret "router-metrics-certs-default" not found Sep 15 21:26:36.202026 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:36.201996 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:36.721443 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:36.721414 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:38.896858 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:38.896808 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:39.347742 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:39.347710 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:39.481669 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:39.481629 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:39.540612 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:39.540574 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1354b88-afbc-439f-ad1d-297368efa425-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-db6kb\" (UID: \"d1354b88-afbc-439f-ad1d-297368efa425\") " pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:39.540805 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:39.540672 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1354b88-afbc-439f-ad1d-297368efa425-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-db6kb\" (UID: \"d1354b88-afbc-439f-ad1d-297368efa425\") " pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:39.540919 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:39.540805 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 21:26:39.540919 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:39.540889 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1354b88-afbc-439f-ad1d-297368efa425-insights-runtime-extractor-tls podName:d1354b88-afbc-439f-ad1d-297368efa425 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:47.540873908 +0000 UTC m=+62.127471482 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d1354b88-afbc-439f-ad1d-297368efa425-insights-runtime-extractor-tls") pod "insights-runtime-extractor-db6kb" (UID: "d1354b88-afbc-439f-ad1d-297368efa425") : secret "insights-runtime-extractor-tls" not found Sep 15 21:26:39.541202 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:39.541181 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1354b88-afbc-439f-ad1d-297368efa425-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-db6kb\" (UID: \"d1354b88-afbc-439f-ad1d-297368efa425\") " pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:39.582238 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:39.582208 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:39.697000 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:39.696920 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:39.798962 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:39.798928 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:39.912026 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:39.911994 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:40.035066 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:40.035033 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:40.120741 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:40.120708 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" Sep 15 21:26:40.120914 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:40.120764 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" Sep 15 21:26:40.121134 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:40.121121 2573 scope.go:117] "RemoveContainer" containerID="111233771fd76e63944be788f1e9233eb21c0141dbe1ab18c935090f5f7b350c" Sep 15 21:26:40.121306 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:40.121287 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-nq4tk_openshift-console-operator(fe5b8a05-c75a-48ae-9a1e-9b5d91630b89)\"" pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" podUID="fe5b8a05-c75a-48ae-9a1e-9b5d91630b89" Sep 15 21:26:41.044763 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:41.044731 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:41.399329 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:41.399240 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:41.595239 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:41.595208 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:41.793681 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:41.793648 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:41.941777 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:41.941744 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:42.006450 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:42.006414 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:42.989434 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:42.989400 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:43.050547 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:43.050518 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:43.390293 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:43.390213 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:43.581700 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:43.581668 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:43.788838 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:43.788793 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:43.847350 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:43.847307 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:43.986611 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:43.986576 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:45.084173 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:45.084145 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8w9j" Sep 15 21:26:45.187235 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:45.187203 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:45.288575 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:45.288544 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:45.345824 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:45.345746 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:45.406645 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:45.406613 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:45.513289 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:45.513258 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:45.864177 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:45.864148 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:45.922869 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:45.922820 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:45.983556 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:45.983512 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:47.197263 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:47.197211 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:47.381278 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:47.381240 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:47.586025 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:47.585985 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:47.613362 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:47.613327 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1354b88-afbc-439f-ad1d-297368efa425-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-db6kb\" (UID: \"d1354b88-afbc-439f-ad1d-297368efa425\") " pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:47.615618 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:47.615587 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1354b88-afbc-439f-ad1d-297368efa425-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-db6kb\" (UID: \"d1354b88-afbc-439f-ad1d-297368efa425\") " pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:47.645589 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:47.645559 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:47.709254 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:47.709219 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fd7sr\"" Sep 15 21:26:47.713720 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:47.713689 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:47.717545 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:47.717529 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-db6kb" Sep 15 21:26:47.987051 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:47.986930 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-db6kb"] Sep 15 21:26:47.989574 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:26:47.989550 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1354b88_afbc_439f_ad1d_297368efa425.slice/crio-40f4cf30ac008265a99e7f050ed55b83c5a5c0d93ce317792aefafd2641d2100 WatchSource:0}: Error finding container 40f4cf30ac008265a99e7f050ed55b83c5a5c0d93ce317792aefafd2641d2100: Status 404 returned error can't find the container with id 40f4cf30ac008265a99e7f050ed55b83c5a5c0d93ce317792aefafd2641d2100 Sep 15 21:26:48.222389 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:48.222353 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-db6kb" event={"ID":"d1354b88-afbc-439f-ad1d-297368efa425","Type":"ContainerStarted","Data":"088b823efd4be0097a261ba17a52886e2462d419021f773aa9b68a8932d517b7"} Sep 15 21:26:48.222746 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:48.222414 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-db6kb" event={"ID":"d1354b88-afbc-439f-ad1d-297368efa425","Type":"ContainerStarted","Data":"40f4cf30ac008265a99e7f050ed55b83c5a5c0d93ce317792aefafd2641d2100"} Sep 15 21:26:48.276941 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:48.276817 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:48.335656 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:48.335621 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:49.183161 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:49.183119 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:49.388390 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:49.388356 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:49.588486 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:49.588443 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:49.784568 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:49.784532 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:50.024344 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:50.024308 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:50.231217 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:50.231181 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-db6kb" event={"ID":"d1354b88-afbc-439f-ad1d-297368efa425","Type":"ContainerStarted","Data":"53f364ab02998a6d5cc6a73b7126dff2fef8acf1b7b7ef46cea42ff17c830565"} Sep 15 21:26:51.235546 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.235514 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-db6kb" event={"ID":"d1354b88-afbc-439f-ad1d-297368efa425","Type":"ContainerStarted","Data":"31ca478c530adf520be961b13d5860c6cf6ca9599e18b146a6a1de9b990b3512"} Sep 15 21:26:51.252414 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.252365 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-db6kb" podStartSLOduration=17.580963071 podStartE2EDuration="20.252349569s" totalImagesPullingTime="2.671386498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:26:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:51.251796416 +0000 UTC m=+65.838394008" watchObservedRunningTime="2026-09-15 21:26:51.252349569 +0000 UTC m=+65.838947160" Sep 15 21:26:51.649260 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.649165 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-metrics-certs\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:51.649260 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.649240 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3072d881-886e-44a9-ae4a-b33bd9dba717-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ts2j5\" (UID: \"3072d881-886e-44a9-ae4a-b33bd9dba717\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ts2j5" Sep 15 21:26:51.649497 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.649273 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5vv7\" (UniqueName: \"kubernetes.io/projected/23c8693a-bbba-4f16-951a-9f0516862649-kube-api-access-p5vv7\") pod \"network-check-target-tvvlc\" (UID: \"23c8693a-bbba-4f16-951a-9f0516862649\") " pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:26:51.649497 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.649300 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e761257-cdb3-4046-a183-152c58a95cf3-service-ca-bundle\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:51.649497 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.649330 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2006e792-d99b-4fe3-a377-80a44d71bed4-metrics-tls\") pod \"dns-default-d88qc\" (UID: \"2006e792-d99b-4fe3-a377-80a44d71bed4\") " pod="openshift-dns/dns-default-d88qc" Sep 15 21:26:51.649497 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.649358 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c63672d5-4ee5-4a51-98e2-b430944567b8-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-r2j9t\" (UID: \"c63672d5-4ee5-4a51-98e2-b430944567b8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-r2j9t" Sep 15 21:26:51.649497 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.649385 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eee406f-4302-4f6d-b025-0ffeb454b0c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-kc9ll\" (UID: \"4eee406f-4302-4f6d-b025-0ffeb454b0c1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kc9ll" Sep 15 21:26:51.649497 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.649433 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-tls\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:51.650189 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.650093 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e761257-cdb3-4046-a183-152c58a95cf3-service-ca-bundle\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:51.652260 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.652237 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-tls\") pod \"image-registry-67fc7b5f45-9sq89\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:51.652690 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.652670 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e761257-cdb3-4046-a183-152c58a95cf3-metrics-certs\") pod \"router-default-65c7764bf8-c5p5m\" (UID: \"7e761257-cdb3-4046-a183-152c58a95cf3\") " pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:51.652690 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.652683 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2006e792-d99b-4fe3-a377-80a44d71bed4-metrics-tls\") pod \"dns-default-d88qc\" (UID: \"2006e792-d99b-4fe3-a377-80a44d71bed4\") " pod="openshift-dns/dns-default-d88qc" Sep 15 21:26:51.652791 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.652737 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eee406f-4302-4f6d-b025-0ffeb454b0c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-kc9ll\" (UID: \"4eee406f-4302-4f6d-b025-0ffeb454b0c1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kc9ll" Sep 15 21:26:51.652791 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.652757 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3072d881-886e-44a9-ae4a-b33bd9dba717-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ts2j5\" (UID: \"3072d881-886e-44a9-ae4a-b33bd9dba717\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ts2j5" Sep 15 21:26:51.652878 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.652830 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c63672d5-4ee5-4a51-98e2-b430944567b8-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-r2j9t\" (UID: \"c63672d5-4ee5-4a51-98e2-b430944567b8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-r2j9t" Sep 15 21:26:51.652940 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.652923 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5vv7\" (UniqueName: \"kubernetes.io/projected/23c8693a-bbba-4f16-951a-9f0516862649-kube-api-access-p5vv7\") pod \"network-check-target-tvvlc\" (UID: \"23c8693a-bbba-4f16-951a-9f0516862649\") " pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:26:51.745931 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.745900 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pqjdv\"" Sep 15 21:26:51.751165 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.751145 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c225a82-b10a-42c0-8491-d3a70e1fb117-metrics-certs\") pod \"network-metrics-daemon-852v2\" (UID: \"9c225a82-b10a-42c0-8491-d3a70e1fb117\") " pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:26:51.751272 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.751179 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef06c19b-a992-4624-948e-2d0db582f824-original-pull-secret\") pod \"global-pull-secret-syncer-z22rp\" (UID: \"ef06c19b-a992-4624-948e-2d0db582f824\") " pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:26:51.753375 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.753359 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:26:51.753432 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.753410 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 15 21:26:51.753432 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.753426 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 15 21:26:51.763769 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.763744 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef06c19b-a992-4624-948e-2d0db582f824-original-pull-secret\") pod \"global-pull-secret-syncer-z22rp\" (UID: \"ef06c19b-a992-4624-948e-2d0db582f824\") " pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:26:51.763865 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.763799 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c225a82-b10a-42c0-8491-d3a70e1fb117-metrics-certs\") pod \"network-metrics-daemon-852v2\" (UID: \"9c225a82-b10a-42c0-8491-d3a70e1fb117\") " pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:26:51.807021 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.803768 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jjzfj\"" Sep 15 21:26:51.811257 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.811229 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:51.839297 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.839273 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-n2fmf\"" Sep 15 21:26:51.841064 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.841046 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q9hj2\"" Sep 15 21:26:51.847917 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.847901 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:51.849088 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.849069 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-852v2" Sep 15 21:26:51.875453 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.875423 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-49t7w\"" Sep 15 21:26:51.882390 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.881738 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wtwmk\"" Sep 15 21:26:51.883887 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.883748 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ts2j5" Sep 15 21:26:51.889616 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.889596 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kc9ll" Sep 15 21:26:51.906234 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.906212 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7jz98\"" Sep 15 21:26:51.932870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.927922 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-r2j9t" Sep 15 21:26:51.932870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.932806 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7gcfd\"" Sep 15 21:26:51.953836 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:51.945374 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d88qc" Sep 15 21:26:52.030568 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.027232 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tvvlc"] Sep 15 21:26:52.033401 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:26:52.033370 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c8693a_bbba_4f16_951a_9f0516862649.slice/crio-a95cf12cd41bc40d232390908b8dab761fbf566d0cddd1dd0c021e5f67141d8c WatchSource:0}: Error finding container a95cf12cd41bc40d232390908b8dab761fbf566d0cddd1dd0c021e5f67141d8c: Status 404 returned error can't find the container with id a95cf12cd41bc40d232390908b8dab761fbf566d0cddd1dd0c021e5f67141d8c Sep 15 21:26:52.038379 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.038272 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z22rp" Sep 15 21:26:52.087673 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.087642 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67fc7b5f45-9sq89"] Sep 15 21:26:52.090872 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:26:52.090829 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb05dc56b_1d26_4765_b191_85bfc180c33c.slice/crio-c2729170ac3ee151223c19a730b772425d03b7f4e983e8ac05ff592640190b74 WatchSource:0}: Error finding container c2729170ac3ee151223c19a730b772425d03b7f4e983e8ac05ff592640190b74: Status 404 returned error can't find the container with id c2729170ac3ee151223c19a730b772425d03b7f4e983e8ac05ff592640190b74 Sep 15 21:26:52.152811 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.152784 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-852v2"] Sep 15 21:26:52.155579 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.155557 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-65c7764bf8-c5p5m"] Sep 15 21:26:52.156490 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:26:52.156407 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c225a82_b10a_42c0_8491_d3a70e1fb117.slice/crio-6a3ac27405d7ed6d6f3573ddd8f082a01a32761f31994aaaf372ee666e3a394e WatchSource:0}: Error finding container 6a3ac27405d7ed6d6f3573ddd8f082a01a32761f31994aaaf372ee666e3a394e: Status 404 returned error can't find the container with id 6a3ac27405d7ed6d6f3573ddd8f082a01a32761f31994aaaf372ee666e3a394e Sep 15 21:26:52.158264 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:26:52.158241 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e761257_cdb3_4046_a183_152c58a95cf3.slice/crio-dbd10c6378166247407f91523123fc97223c18202b48057fb06a5e0da19062a4 WatchSource:0}: Error finding container dbd10c6378166247407f91523123fc97223c18202b48057fb06a5e0da19062a4: Status 404 returned error can't find the container with id dbd10c6378166247407f91523123fc97223c18202b48057fb06a5e0da19062a4 Sep 15 21:26:52.201048 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.201019 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ts2j5"] Sep 15 21:26:52.203740 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.203716 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-kc9ll"] Sep 15 21:26:52.208989 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:26:52.208961 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eee406f_4302_4f6d_b025_0ffeb454b0c1.slice/crio-2fa4264a438de33cac495eb448f6b9ab9f52cb523b11bc43a0fdc0237c687eaa WatchSource:0}: Error finding container 2fa4264a438de33cac495eb448f6b9ab9f52cb523b11bc43a0fdc0237c687eaa: Status 404 returned error can't find the container with id 2fa4264a438de33cac495eb448f6b9ab9f52cb523b11bc43a0fdc0237c687eaa Sep 15 21:26:52.241622 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.241595 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kc9ll" event={"ID":"4eee406f-4302-4f6d-b025-0ffeb454b0c1","Type":"ContainerStarted","Data":"2fa4264a438de33cac495eb448f6b9ab9f52cb523b11bc43a0fdc0237c687eaa"} Sep 15 21:26:52.242866 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.242816 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ts2j5" event={"ID":"3072d881-886e-44a9-ae4a-b33bd9dba717","Type":"ContainerStarted","Data":"e49ff239a9b2c7f882442fd3bbb660921be9bcfd96c51c818fb4bc7053047fdc"} Sep 15 21:26:52.244640 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.244612 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tvvlc" event={"ID":"23c8693a-bbba-4f16-951a-9f0516862649","Type":"ContainerStarted","Data":"f93be9c186a7e401aa6b8bfff3cfa2c8175b33b62a01410de2243738e8c6bf66"} Sep 15 21:26:52.244712 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.244662 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tvvlc" event={"ID":"23c8693a-bbba-4f16-951a-9f0516862649","Type":"ContainerStarted","Data":"a95cf12cd41bc40d232390908b8dab761fbf566d0cddd1dd0c021e5f67141d8c"} Sep 15 21:26:52.244805 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.244788 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:26:52.246162 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.246138 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-852v2" event={"ID":"9c225a82-b10a-42c0-8491-d3a70e1fb117","Type":"ContainerStarted","Data":"6a3ac27405d7ed6d6f3573ddd8f082a01a32761f31994aaaf372ee666e3a394e"} Sep 15 21:26:52.248284 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.248259 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-65c7764bf8-c5p5m" event={"ID":"7e761257-cdb3-4046-a183-152c58a95cf3","Type":"ContainerStarted","Data":"3dd3564ee2e4b1f70221044599ff3a7c21c6df47d7163fb6cfed520be1368c10"} Sep 15 21:26:52.248351 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.248306 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-65c7764bf8-c5p5m" event={"ID":"7e761257-cdb3-4046-a183-152c58a95cf3","Type":"ContainerStarted","Data":"dbd10c6378166247407f91523123fc97223c18202b48057fb06a5e0da19062a4"} Sep 15 21:26:52.250534 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.250504 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" event={"ID":"b05dc56b-1d26-4765-b191-85bfc180c33c","Type":"ContainerStarted","Data":"c85e5fe1702348bddb6929de616a44801442edd9427b9b5963561eab41d3563b"} Sep 15 21:26:52.250635 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.250547 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" event={"ID":"b05dc56b-1d26-4765-b191-85bfc180c33c","Type":"ContainerStarted","Data":"c2729170ac3ee151223c19a730b772425d03b7f4e983e8ac05ff592640190b74"} Sep 15 21:26:52.264237 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.264208 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-r2j9t"] Sep 15 21:26:52.268865 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.268824 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d88qc"] Sep 15 21:26:52.269125 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:26:52.269090 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc63672d5_4ee5_4a51_98e2_b430944567b8.slice/crio-0c18f679523fa349d50b492d262e7e4bb7db1e75f18e4953aeebe32b10bcde62 WatchSource:0}: Error finding container 0c18f679523fa349d50b492d262e7e4bb7db1e75f18e4953aeebe32b10bcde62: Status 404 returned error can't find the container with id 0c18f679523fa349d50b492d262e7e4bb7db1e75f18e4953aeebe32b10bcde62 Sep 15 21:26:52.271707 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:26:52.271688 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2006e792_d99b_4fe3_a377_80a44d71bed4.slice/crio-0deb4f3f61d4281dda81a52d05b34725713788eea77ad7d6f1fff108bf7d33db WatchSource:0}: Error finding container 0deb4f3f61d4281dda81a52d05b34725713788eea77ad7d6f1fff108bf7d33db: Status 404 returned error can't find the container with id 0deb4f3f61d4281dda81a52d05b34725713788eea77ad7d6f1fff108bf7d33db Sep 15 21:26:52.301937 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.301885 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tvvlc" podStartSLOduration=66.30186638 podStartE2EDuration="1m6.30186638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:25:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:52.281137179 +0000 UTC m=+66.867734772" watchObservedRunningTime="2026-09-15 21:26:52.30186638 +0000 UTC m=+66.888463964" Sep 15 21:26:52.302074 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.301969 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" podStartSLOduration=66.301963851 podStartE2EDuration="1m6.301963851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:25:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:52.301031497 +0000 UTC m=+66.887629089" watchObservedRunningTime="2026-09-15 21:26:52.301963851 +0000 UTC m=+66.888561444" Sep 15 21:26:52.317706 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.317677 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z22rp"] Sep 15 21:26:52.318545 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.318506 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-65c7764bf8-c5p5m" podStartSLOduration=37.318491104 podStartE2EDuration="37.318491104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:26:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:52.31806008 +0000 UTC m=+66.904657672" watchObservedRunningTime="2026-09-15 21:26:52.318491104 +0000 UTC m=+66.905088695" Sep 15 21:26:52.321378 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:26:52.321354 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef06c19b_a992_4624_948e_2d0db582f824.slice/crio-4c3f7088369162b983ed542e739700227d305f9d11c2529cff1d736c50e12658 WatchSource:0}: Error finding container 4c3f7088369162b983ed542e739700227d305f9d11c2529cff1d736c50e12658: Status 404 returned error can't find the container with id 4c3f7088369162b983ed542e739700227d305f9d11c2529cff1d736c50e12658 Sep 15 21:26:52.848615 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.848576 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:52.851520 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.851499 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:52.928336 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:52.928297 2573 scope.go:117] "RemoveContainer" containerID="111233771fd76e63944be788f1e9233eb21c0141dbe1ab18c935090f5f7b350c" Sep 15 21:26:53.259074 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:53.258986 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z22rp" event={"ID":"ef06c19b-a992-4624-948e-2d0db582f824","Type":"ContainerStarted","Data":"4c3f7088369162b983ed542e739700227d305f9d11c2529cff1d736c50e12658"} Sep 15 21:26:53.263176 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:53.263141 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-r2j9t" event={"ID":"c63672d5-4ee5-4a51-98e2-b430944567b8","Type":"ContainerStarted","Data":"0c18f679523fa349d50b492d262e7e4bb7db1e75f18e4953aeebe32b10bcde62"} Sep 15 21:26:53.266546 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:53.266526 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/1.log" Sep 15 21:26:53.266660 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:53.266631 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" event={"ID":"fe5b8a05-c75a-48ae-9a1e-9b5d91630b89","Type":"ContainerStarted","Data":"2c816449d2ef8be1898eac54da5db04111366f93bf9bb5721c4da723f6ab3e4e"} Sep 15 21:26:53.267687 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:53.267580 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" Sep 15 21:26:53.272992 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:53.271078 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d88qc" event={"ID":"2006e792-d99b-4fe3-a377-80a44d71bed4","Type":"ContainerStarted","Data":"0deb4f3f61d4281dda81a52d05b34725713788eea77ad7d6f1fff108bf7d33db"} Sep 15 21:26:53.272992 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:53.271165 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:53.272992 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:53.271609 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:26:53.273512 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:53.273443 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-65c7764bf8-c5p5m" Sep 15 21:26:53.300117 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:53.299101 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" podStartSLOduration=28.548617324 podStartE2EDuration="38.299080834s" totalImagesPullingTime="9.75046351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:53.289421101 +0000 UTC m=+67.876018686" watchObservedRunningTime="2026-09-15 21:26:53.299080834 +0000 UTC m=+67.885678437" Sep 15 21:26:54.267915 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:54.267868 2573 patch_prober.go:28] interesting pod/console-operator-696884fb9c-nq4tk container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.15:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Sep 15 21:26:54.268428 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:54.267951 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" podUID="fe5b8a05-c75a-48ae-9a1e-9b5d91630b89" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.15:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Sep 15 21:26:54.601828 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:54.601710 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-nq4tk" Sep 15 21:26:54.800102 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:54.799979 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:54.901764 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:54.901683 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:55.079245 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:55.079201 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:55.268775 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:55.268734 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:55.321751 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:55.321671 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:55.455673 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:55.455631 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:55.515406 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:55.515374 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:55.684471 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:55.684390 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:56.089343 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:56.089283 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:56.667138 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:56.667095 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:56.771220 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:56.771179 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:56.871179 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:56.871131 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:57.353452 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.353423 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dfb67f994-644mv"] Sep 15 21:26:57.386169 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.386138 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dfb67f994-644mv"] Sep 15 21:26:57.386347 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.386230 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dfb67f994-644mv" Sep 15 21:26:57.389818 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.389792 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 15 21:26:57.390056 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.389842 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-5nhhg\"" Sep 15 21:26:57.390056 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.389998 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 15 21:26:57.390181 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.390145 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 15 21:26:57.390466 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.390449 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 15 21:26:57.425215 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.425188 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-qhrj9"] Sep 15 21:26:57.444225 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.444200 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-qhrj9" Sep 15 21:26:57.450330 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.447946 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-vwbbh\"" Sep 15 21:26:57.450330 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.448149 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 15 21:26:57.450330 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.449302 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-qhrj9"] Sep 15 21:26:57.450330 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.450297 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 15 21:26:57.471591 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.471559 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:57.500261 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.500226 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhhb2\" (UniqueName: \"kubernetes.io/projected/908c898d-ab13-4f5a-9018-a2423569ca4e-kube-api-access-hhhb2\") pod \"managed-serviceaccount-addon-agent-6dfb67f994-644mv\" (UID: \"908c898d-ab13-4f5a-9018-a2423569ca4e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dfb67f994-644mv" Sep 15 21:26:57.500433 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.500300 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/908c898d-ab13-4f5a-9018-a2423569ca4e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dfb67f994-644mv\" (UID: \"908c898d-ab13-4f5a-9018-a2423569ca4e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dfb67f994-644mv" Sep 15 21:26:57.559572 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.559539 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:57.601133 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.601104 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhhb2\" (UniqueName: \"kubernetes.io/projected/908c898d-ab13-4f5a-9018-a2423569ca4e-kube-api-access-hhhb2\") pod \"managed-serviceaccount-addon-agent-6dfb67f994-644mv\" (UID: \"908c898d-ab13-4f5a-9018-a2423569ca4e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dfb67f994-644mv" Sep 15 21:26:57.601242 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.601173 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddckq\" (UniqueName: \"kubernetes.io/projected/88955b0e-a1aa-467f-b0a4-257aa77e1f89-kube-api-access-ddckq\") pod \"downloads-76f99584f4-qhrj9\" (UID: \"88955b0e-a1aa-467f-b0a4-257aa77e1f89\") " pod="openshift-console/downloads-76f99584f4-qhrj9" Sep 15 21:26:57.601242 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.601202 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/908c898d-ab13-4f5a-9018-a2423569ca4e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dfb67f994-644mv\" (UID: \"908c898d-ab13-4f5a-9018-a2423569ca4e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dfb67f994-644mv" Sep 15 21:26:57.603611 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.603562 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/908c898d-ab13-4f5a-9018-a2423569ca4e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dfb67f994-644mv\" (UID: \"908c898d-ab13-4f5a-9018-a2423569ca4e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dfb67f994-644mv" Sep 15 21:26:57.615833 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.615807 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhhb2\" (UniqueName: \"kubernetes.io/projected/908c898d-ab13-4f5a-9018-a2423569ca4e-kube-api-access-hhhb2\") pod \"managed-serviceaccount-addon-agent-6dfb67f994-644mv\" (UID: \"908c898d-ab13-4f5a-9018-a2423569ca4e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dfb67f994-644mv" Sep 15 21:26:57.660328 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.660287 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:57.701996 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.701968 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddckq\" (UniqueName: \"kubernetes.io/projected/88955b0e-a1aa-467f-b0a4-257aa77e1f89-kube-api-access-ddckq\") pod \"downloads-76f99584f4-qhrj9\" (UID: \"88955b0e-a1aa-467f-b0a4-257aa77e1f89\") " pod="openshift-console/downloads-76f99584f4-qhrj9" Sep 15 21:26:57.706155 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.706133 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dfb67f994-644mv" Sep 15 21:26:57.713208 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.713185 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddckq\" (UniqueName: \"kubernetes.io/projected/88955b0e-a1aa-467f-b0a4-257aa77e1f89-kube-api-access-ddckq\") pod \"downloads-76f99584f4-qhrj9\" (UID: \"88955b0e-a1aa-467f-b0a4-257aa77e1f89\") " pod="openshift-console/downloads-76f99584f4-qhrj9" Sep 15 21:26:57.757450 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.757262 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-qhrj9" Sep 15 21:26:57.758034 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:57.757981 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:58.013511 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.013486 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dfb67f994-644mv"] Sep 15 21:26:58.016315 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:26:58.016283 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod908c898d_ab13_4f5a_9018_a2423569ca4e.slice/crio-98cc34e4035857a26d2eda43c1d1f804ff12d81431757a3f450bab3a9eb4ed60 WatchSource:0}: Error finding container 98cc34e4035857a26d2eda43c1d1f804ff12d81431757a3f450bab3a9eb4ed60: Status 404 returned error can't find the container with id 98cc34e4035857a26d2eda43c1d1f804ff12d81431757a3f450bab3a9eb4ed60 Sep 15 21:26:58.044528 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.044473 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:58.137807 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.137748 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:58.186976 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.186823 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-qhrj9"] Sep 15 21:26:58.189146 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:26:58.189115 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88955b0e_a1aa_467f_b0a4_257aa77e1f89.slice/crio-d272ebf652d34ea208fbbeebb0c69f4c20691df6a0f154e9985dc9716cce16da WatchSource:0}: Error finding container d272ebf652d34ea208fbbeebb0c69f4c20691df6a0f154e9985dc9716cce16da: Status 404 returned error can't find the container with id d272ebf652d34ea208fbbeebb0c69f4c20691df6a0f154e9985dc9716cce16da Sep 15 21:26:58.212620 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.211516 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n2btb"] Sep 15 21:26:58.226264 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.226232 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:58.230579 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.230556 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n2btb"] Sep 15 21:26:58.230736 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.230641 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n2btb" Sep 15 21:26:58.233284 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.233252 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9sznp\"" Sep 15 21:26:58.233284 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.233273 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 15 21:26:58.293212 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.293177 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d88qc" event={"ID":"2006e792-d99b-4fe3-a377-80a44d71bed4","Type":"ContainerStarted","Data":"406a8f8fd9e809d4e40a016bb0abacc0993d9ef65722d94664c8e13ed53e5590"} Sep 15 21:26:58.293386 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.293241 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d88qc" event={"ID":"2006e792-d99b-4fe3-a377-80a44d71bed4","Type":"ContainerStarted","Data":"9ff7afa3498851bdea58ba4fa1b5d94d19a6554b3baf33fd06346651fb74bade"} Sep 15 21:26:58.293448 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.293430 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d88qc" Sep 15 21:26:58.294951 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.294915 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-qhrj9" event={"ID":"88955b0e-a1aa-467f-b0a4-257aa77e1f89","Type":"ContainerStarted","Data":"d272ebf652d34ea208fbbeebb0c69f4c20691df6a0f154e9985dc9716cce16da"} Sep 15 21:26:58.296999 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.296964 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z22rp" event={"ID":"ef06c19b-a992-4624-948e-2d0db582f824","Type":"ContainerStarted","Data":"d7f94a07869a48c1907f8363649669f22b148ee84b76172b1285558f97eead52"} Sep 15 21:26:58.298902 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.298877 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-r2j9t" event={"ID":"c63672d5-4ee5-4a51-98e2-b430944567b8","Type":"ContainerStarted","Data":"68828ba9f8fff9bd833c10e6017fbf45ee4ec559d85c7f2d2266c4cc526a157b"} Sep 15 21:26:58.300114 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.300091 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dfb67f994-644mv" event={"ID":"908c898d-ab13-4f5a-9018-a2423569ca4e","Type":"ContainerStarted","Data":"98cc34e4035857a26d2eda43c1d1f804ff12d81431757a3f450bab3a9eb4ed60"} Sep 15 21:26:58.307067 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.307045 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kc9ll" event={"ID":"4eee406f-4302-4f6d-b025-0ffeb454b0c1","Type":"ContainerStarted","Data":"d71b5253326bb9fd1e96fe490957d0d4d76e775564eb3f0205acefe8d9d5f763"} Sep 15 21:26:58.307647 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.307624 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/26f1bc64-064a-4cf4-a92e-81cd000b1126-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-n2btb\" (UID: \"26f1bc64-064a-4cf4-a92e-81cd000b1126\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n2btb" Sep 15 21:26:58.308995 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.308974 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ts2j5" event={"ID":"3072d881-886e-44a9-ae4a-b33bd9dba717","Type":"ContainerStarted","Data":"519ec9e97f0ff5bb67b1926b20df15cdeb16dd92fd9f6d6581a399bda78fc910"} Sep 15 21:26:58.309090 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.309016 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ts2j5" event={"ID":"3072d881-886e-44a9-ae4a-b33bd9dba717","Type":"ContainerStarted","Data":"16b9a15cd04b1999ad263661f4b76c1adfca30bb4d27f14eb07d7f7535abdadf"} Sep 15 21:26:58.311099 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.311074 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-852v2" event={"ID":"9c225a82-b10a-42c0-8491-d3a70e1fb117","Type":"ContainerStarted","Data":"10153da7a29020e4a138cee51e90cef3d9588eb60b9367351321e5e94f62fb4f"} Sep 15 21:26:58.311207 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.311118 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-852v2" event={"ID":"9c225a82-b10a-42c0-8491-d3a70e1fb117","Type":"ContainerStarted","Data":"28f0ca8aa1bc8ca70503f5b9a201bb8c031deebf5ae73159a241e272b92a8322"} Sep 15 21:26:58.312093 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.312058 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-d88qc" podStartSLOduration=33.990355748 podStartE2EDuration="39.31204665s" totalImagesPullingTime="5.321690902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:58.311381572 +0000 UTC m=+72.897979165" watchObservedRunningTime="2026-09-15 21:26:58.31204665 +0000 UTC m=+72.898644242" Sep 15 21:26:58.326487 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.326450 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-852v2" podStartSLOduration=66.89622176 podStartE2EDuration="1m12.326437511s" totalImagesPullingTime="5.430215751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:25:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:58.326003397 +0000 UTC m=+72.912601001" watchObservedRunningTime="2026-09-15 21:26:58.326437511 +0000 UTC m=+72.913035106" Sep 15 21:26:58.342998 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.342896 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ts2j5" podStartSLOduration=37.988963992 podStartE2EDuration="43.342880791s" totalImagesPullingTime="5.353916799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:58.342724265 +0000 UTC m=+72.929321858" watchObservedRunningTime="2026-09-15 21:26:58.342880791 +0000 UTC m=+72.929478379" Sep 15 21:26:58.367274 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.367237 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-r2j9t" podStartSLOduration=38.050101048 podStartE2EDuration="43.367223306s" totalImagesPullingTime="5.317122258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:58.365395758 +0000 UTC m=+72.951993350" watchObservedRunningTime="2026-09-15 21:26:58.367223306 +0000 UTC m=+72.953820910" Sep 15 21:26:58.383589 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.383539 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kc9ll" podStartSLOduration=38.004650956 podStartE2EDuration="43.383521994s" totalImagesPullingTime="5.378871038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:58.382548811 +0000 UTC m=+72.969146405" watchObservedRunningTime="2026-09-15 21:26:58.383521994 +0000 UTC m=+72.970119588" Sep 15 21:26:58.408611 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.408577 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/26f1bc64-064a-4cf4-a92e-81cd000b1126-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-n2btb\" (UID: \"26f1bc64-064a-4cf4-a92e-81cd000b1126\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n2btb" Sep 15 21:26:58.409277 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:58.409245 2573 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 15 21:26:58.409632 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:58.409614 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f1bc64-064a-4cf4-a92e-81cd000b1126-tls-certificates podName:26f1bc64-064a-4cf4-a92e-81cd000b1126 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:58.909589716 +0000 UTC m=+73.496187300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/26f1bc64-064a-4cf4-a92e-81cd000b1126-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-n2btb" (UID: "26f1bc64-064a-4cf4-a92e-81cd000b1126") : secret "prometheus-operator-admission-webhook-tls" not found Sep 15 21:26:58.414840 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.414800 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-z22rp" podStartSLOduration=66.818285338 podStartE2EDuration="1m12.414788486s" totalImagesPullingTime="5.596503148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:25:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:58.414481012 +0000 UTC m=+73.001078606" watchObservedRunningTime="2026-09-15 21:26:58.414788486 +0000 UTC m=+73.001386071" Sep 15 21:26:58.464413 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.464379 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:58.699204 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.699171 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:58.767530 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.767449 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:58.824542 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.824506 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:58.913811 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:58.913772 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/26f1bc64-064a-4cf4-a92e-81cd000b1126-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-n2btb\" (UID: \"26f1bc64-064a-4cf4-a92e-81cd000b1126\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n2btb" Sep 15 21:26:58.913999 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:58.913973 2573 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 15 21:26:58.914106 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:26:58.914091 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f1bc64-064a-4cf4-a92e-81cd000b1126-tls-certificates podName:26f1bc64-064a-4cf4-a92e-81cd000b1126 nodeName:}" failed. No retries permitted until 2026-09-15 21:26:59.91406596 +0000 UTC m=+74.500663531 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/26f1bc64-064a-4cf4-a92e-81cd000b1126-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-n2btb" (UID: "26f1bc64-064a-4cf4-a92e-81cd000b1126") : secret "prometheus-operator-admission-webhook-tls" not found Sep 15 21:26:59.269593 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:59.269523 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:59.577422 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:59.577317 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:26:59.924270 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:59.924180 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/26f1bc64-064a-4cf4-a92e-81cd000b1126-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-n2btb\" (UID: \"26f1bc64-064a-4cf4-a92e-81cd000b1126\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n2btb" Sep 15 21:26:59.927097 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:59.927068 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/26f1bc64-064a-4cf4-a92e-81cd000b1126-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-n2btb\" (UID: \"26f1bc64-064a-4cf4-a92e-81cd000b1126\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n2btb" Sep 15 21:26:59.962168 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:26:59.962039 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:00.032247 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:00.032191 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:00.040040 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:00.040012 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n2btb" Sep 15 21:27:00.770719 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:00.770680 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:01.165712 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:01.165544 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:01.224560 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:01.224516 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:01.541132 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:01.541100 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n2btb"] Sep 15 21:27:01.668265 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:27:01.668230 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26f1bc64_064a_4cf4_a92e_81cd000b1126.slice/crio-3202ddc5088540060288f70e241f077bcb8b9cd21622aa752d1bf1f0cd0a24c6 WatchSource:0}: Error finding container 3202ddc5088540060288f70e241f077bcb8b9cd21622aa752d1bf1f0cd0a24c6: Status 404 returned error can't find the container with id 3202ddc5088540060288f70e241f077bcb8b9cd21622aa752d1bf1f0cd0a24c6 Sep 15 21:27:02.339387 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:02.339350 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n2btb" event={"ID":"26f1bc64-064a-4cf4-a92e-81cd000b1126","Type":"ContainerStarted","Data":"3202ddc5088540060288f70e241f077bcb8b9cd21622aa752d1bf1f0cd0a24c6"} Sep 15 21:27:02.341477 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:02.341441 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dfb67f994-644mv" event={"ID":"908c898d-ab13-4f5a-9018-a2423569ca4e","Type":"ContainerStarted","Data":"4fe426de483868208bd67563b689a391dcc98cf2109977a1dcd3abb48a36d5cc"} Sep 15 21:27:02.361678 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:02.361621 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dfb67f994-644mv" podStartSLOduration=1.688869392 podStartE2EDuration="5.361605527s" totalImagesPullingTime="3.672736135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:27:02.359972561 +0000 UTC m=+76.946570156" watchObservedRunningTime="2026-09-15 21:27:02.361605527 +0000 UTC m=+76.948203119" Sep 15 21:27:02.618979 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:02.618897 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:02.680749 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:02.680710 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:03.081929 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:03.081895 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:03.178135 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:03.178092 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:03.278075 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:03.278036 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:04.349950 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:04.349917 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n2btb" event={"ID":"26f1bc64-064a-4cf4-a92e-81cd000b1126","Type":"ContainerStarted","Data":"e7187606978b3ee72846cac938e9be4eeed846daf84c9f813867b5d4668ce499"} Sep 15 21:27:04.350409 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:04.350233 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n2btb" Sep 15 21:27:04.355608 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:04.355582 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n2btb" Sep 15 21:27:04.367365 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:04.367320 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n2btb" podStartSLOduration=4.71613729 podStartE2EDuration="6.367304917s" totalImagesPullingTime="1.651167627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:26:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:27:04.366580037 +0000 UTC m=+78.953177630" watchObservedRunningTime="2026-09-15 21:27:04.367304917 +0000 UTC m=+78.953902509" Sep 15 21:27:05.260668 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:05.260630 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:05.348992 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:05.348944 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:06.388415 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:06.388371 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:08.319992 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:08.319864 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d88qc" Sep 15 21:27:08.884495 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:08.884442 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:08.945690 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:08.945605 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:10.433061 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.433020 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:10.644132 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.644086 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:10.689216 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.689128 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vrfsx"] Sep 15 21:27:10.692736 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.692389 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.695167 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.695140 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 15 21:27:10.695404 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.695381 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9lv77\"" Sep 15 21:27:10.695404 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.695382 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 15 21:27:10.695594 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.695450 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 15 21:27:10.696544 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.696526 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 15 21:27:10.749675 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.749644 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:10.819664 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.819627 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-node-exporter-tls\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.819877 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.819672 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-node-exporter-wtmp\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.819877 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.819698 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-metrics-client-ca\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.819877 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.819797 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-node-exporter-accelerators-collector-config\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.819877 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.819841 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-root\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.820115 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.819910 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-node-exporter-textfile\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.820115 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.819957 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-sys\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.820115 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.819983 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvch9\" (UniqueName: \"kubernetes.io/projected/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-kube-api-access-bvch9\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.820115 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.820078 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.843734 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.843653 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:10.921465 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.921419 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-node-exporter-tls\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.921644 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.921476 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-node-exporter-wtmp\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.921644 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.921503 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-metrics-client-ca\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.921644 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.921539 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-node-exporter-accelerators-collector-config\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.921644 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.921571 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-root\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.921644 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.921601 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-node-exporter-textfile\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.921644 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.921638 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-sys\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.922005 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.921661 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvch9\" (UniqueName: \"kubernetes.io/projected/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-kube-api-access-bvch9\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.922005 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.921670 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-node-exporter-wtmp\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.922005 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.921709 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-root\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.922005 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.921765 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-sys\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.922005 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.921779 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.922260 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.922210 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-node-exporter-textfile\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.922514 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.922491 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-node-exporter-accelerators-collector-config\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.922625 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.922570 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-metrics-client-ca\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.925028 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.925004 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.925028 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.925025 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-node-exporter-tls\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.931503 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.931482 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvch9\" (UniqueName: \"kubernetes.io/projected/e8dd38e7-7dfb-459d-8caa-9650760c6fbe-kube-api-access-bvch9\") pod \"node-exporter-vrfsx\" (UID: \"e8dd38e7-7dfb-459d-8caa-9650760c6fbe\") " pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:10.944578 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:10.944516 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:11.004431 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:11.004394 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vrfsx" Sep 15 21:27:11.142716 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:11.142658 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:11.243180 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:11.243132 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:11.352341 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:11.352270 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:11.449045 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:11.449010 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:11.734423 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:11.734387 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:11.817264 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:11.817220 2573 patch_prober.go:28] interesting pod/image-registry-67fc7b5f45-9sq89 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 15 21:27:11.817437 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:11.817279 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" podUID="b05dc56b-1d26-4765-b191-85bfc180c33c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 15 21:27:11.844008 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:11.843966 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:12.138121 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:12.137976 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:12.240312 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:12.240273 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:12.391747 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:12.391657 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:13.648150 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:13.648017 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:13.748961 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:13.748913 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:13.892053 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:13.892016 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:13.971096 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:13.971007 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:14.281704 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:14.281623 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:27:14.459992 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:14.459930 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:14.561269 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:14.561179 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:15.452964 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:15.452925 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:15.664511 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:15.664470 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:15.733170 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:15.733109 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:15.780794 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:27:15.780761 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8dd38e7_7dfb_459d_8caa_9650760c6fbe.slice/crio-20f687bb3f4d4924df38eb866efa7df084b285afc2b09c7b4605718b243aea62 WatchSource:0}: Error finding container 20f687bb3f4d4924df38eb866efa7df084b285afc2b09c7b4605718b243aea62: Status 404 returned error can't find the container with id 20f687bb3f4d4924df38eb866efa7df084b285afc2b09c7b4605718b243aea62 Sep 15 21:27:16.407239 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:16.407198 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vrfsx" event={"ID":"e8dd38e7-7dfb-459d-8caa-9650760c6fbe","Type":"ContainerStarted","Data":"20f687bb3f4d4924df38eb866efa7df084b285afc2b09c7b4605718b243aea62"} Sep 15 21:27:16.409372 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:16.409336 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-qhrj9" event={"ID":"88955b0e-a1aa-467f-b0a4-257aa77e1f89","Type":"ContainerStarted","Data":"ef1b632aa8aa8807b45b50e986fae904c5ea2fd8e3d898296861a5b8241686f4"} Sep 15 21:27:16.409933 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:16.409883 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-qhrj9" Sep 15 21:27:16.420406 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:16.420384 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-qhrj9" Sep 15 21:27:16.428677 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:16.428494 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-qhrj9" podStartSLOduration=1.754433207 podStartE2EDuration="19.428449471s" totalImagesPullingTime="17.674016264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:27:16.428175819 +0000 UTC m=+91.014773414" watchObservedRunningTime="2026-09-15 21:27:16.428449471 +0000 UTC m=+91.015047061" Sep 15 21:27:16.962630 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:16.962574 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:17.150708 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.150672 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f7c47bfd-s7mbx"] Sep 15 21:27:17.172576 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.172538 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:17.177771 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.177699 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f7c47bfd-s7mbx"] Sep 15 21:27:17.178130 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.178097 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 15 21:27:17.178255 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.178165 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 15 21:27:17.178255 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.178175 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 15 21:27:17.178513 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.178491 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 15 21:27:17.178700 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.178678 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 15 21:27:17.178766 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.178730 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hqrg5\"" Sep 15 21:27:17.186467 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.186411 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 15 21:27:17.279356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.279312 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12875e4a-f644-455b-855f-ea7085aba992-oauth-serving-cert\") pod \"console-7f7c47bfd-s7mbx\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:17.279553 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.279376 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12875e4a-f644-455b-855f-ea7085aba992-console-config\") pod \"console-7f7c47bfd-s7mbx\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:17.279553 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.279445 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12875e4a-f644-455b-855f-ea7085aba992-console-serving-cert\") pod \"console-7f7c47bfd-s7mbx\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:17.279553 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.279513 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12875e4a-f644-455b-855f-ea7085aba992-service-ca\") pod \"console-7f7c47bfd-s7mbx\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:17.279553 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.279544 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12875e4a-f644-455b-855f-ea7085aba992-trusted-ca-bundle\") pod \"console-7f7c47bfd-s7mbx\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:17.279780 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.279587 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq5n4\" (UniqueName: \"kubernetes.io/projected/12875e4a-f644-455b-855f-ea7085aba992-kube-api-access-zq5n4\") pod \"console-7f7c47bfd-s7mbx\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:17.279780 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.279640 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12875e4a-f644-455b-855f-ea7085aba992-console-oauth-config\") pod \"console-7f7c47bfd-s7mbx\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:17.380149 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.380108 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12875e4a-f644-455b-855f-ea7085aba992-console-oauth-config\") pod \"console-7f7c47bfd-s7mbx\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:17.380342 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.380154 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12875e4a-f644-455b-855f-ea7085aba992-oauth-serving-cert\") pod \"console-7f7c47bfd-s7mbx\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:17.380342 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.380196 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12875e4a-f644-455b-855f-ea7085aba992-console-config\") pod \"console-7f7c47bfd-s7mbx\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:17.380342 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.380239 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12875e4a-f644-455b-855f-ea7085aba992-console-serving-cert\") pod \"console-7f7c47bfd-s7mbx\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:17.380342 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.380267 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12875e4a-f644-455b-855f-ea7085aba992-service-ca\") pod \"console-7f7c47bfd-s7mbx\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:17.380342 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.380299 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12875e4a-f644-455b-855f-ea7085aba992-trusted-ca-bundle\") pod \"console-7f7c47bfd-s7mbx\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:17.380342 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.380339 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq5n4\" (UniqueName: \"kubernetes.io/projected/12875e4a-f644-455b-855f-ea7085aba992-kube-api-access-zq5n4\") pod \"console-7f7c47bfd-s7mbx\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:17.381087 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.381056 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12875e4a-f644-455b-855f-ea7085aba992-console-config\") pod \"console-7f7c47bfd-s7mbx\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:17.381201 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.381056 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12875e4a-f644-455b-855f-ea7085aba992-oauth-serving-cert\") pod \"console-7f7c47bfd-s7mbx\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:17.381812 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.381778 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12875e4a-f644-455b-855f-ea7085aba992-trusted-ca-bundle\") pod \"console-7f7c47bfd-s7mbx\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:17.381812 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.381796 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12875e4a-f644-455b-855f-ea7085aba992-service-ca\") pod \"console-7f7c47bfd-s7mbx\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:17.383111 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.383085 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12875e4a-f644-455b-855f-ea7085aba992-console-oauth-config\") pod \"console-7f7c47bfd-s7mbx\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:17.384196 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.384169 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12875e4a-f644-455b-855f-ea7085aba992-console-serving-cert\") pod \"console-7f7c47bfd-s7mbx\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:17.389614 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.389588 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq5n4\" (UniqueName: \"kubernetes.io/projected/12875e4a-f644-455b-855f-ea7085aba992-kube-api-access-zq5n4\") pod \"console-7f7c47bfd-s7mbx\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:17.416530 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.416492 2573 generic.go:356] "Generic (PLEG): container finished" podID="e8dd38e7-7dfb-459d-8caa-9650760c6fbe" containerID="bdc7ecd05823feb250c3309fab98cf12129acf9b29f4a812b769a6aec05494e3" exitCode=0 Sep 15 21:27:17.416674 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.416576 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vrfsx" event={"ID":"e8dd38e7-7dfb-459d-8caa-9650760c6fbe","Type":"ContainerDied","Data":"bdc7ecd05823feb250c3309fab98cf12129acf9b29f4a812b769a6aec05494e3"} Sep 15 21:27:17.456104 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.456066 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:17.485598 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.485563 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:17.515825 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.515724 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:17.741785 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.741695 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:17.796235 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.796209 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f7c47bfd-s7mbx"] Sep 15 21:27:17.799153 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:27:17.799122 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12875e4a_f644_455b_855f_ea7085aba992.slice/crio-67c09aa65d98440e5ef25962dae3a73bc730e69a05d3b7eb3acbc81aba0f36ea WatchSource:0}: Error finding container 67c09aa65d98440e5ef25962dae3a73bc730e69a05d3b7eb3acbc81aba0f36ea: Status 404 returned error can't find the container with id 67c09aa65d98440e5ef25962dae3a73bc730e69a05d3b7eb3acbc81aba0f36ea Sep 15 21:27:17.800889 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:17.800838 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:18.424323 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:18.424281 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f7c47bfd-s7mbx" event={"ID":"12875e4a-f644-455b-855f-ea7085aba992","Type":"ContainerStarted","Data":"67c09aa65d98440e5ef25962dae3a73bc730e69a05d3b7eb3acbc81aba0f36ea"} Sep 15 21:27:18.428437 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:18.428332 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vrfsx" event={"ID":"e8dd38e7-7dfb-459d-8caa-9650760c6fbe","Type":"ContainerStarted","Data":"02d188e76b47d2618d08d9be24019106d5c93e99d5ff21d47a082c23b6d37759"} Sep 15 21:27:18.428437 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:18.428384 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vrfsx" event={"ID":"e8dd38e7-7dfb-459d-8caa-9650760c6fbe","Type":"ContainerStarted","Data":"c7ff994838b3ca17a7cb288cbb111a9704fde68797fde0892b82f49378547bbf"} Sep 15 21:27:18.450086 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:18.449985 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vrfsx" podStartSLOduration=7.223888875 podStartE2EDuration="8.449964821s" totalImagesPullingTime="1.145234858s" totalInitContainerRuntime="80.841088ms" isStatefulPod=true podCreationTimestamp="2026-09-15 21:27:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:27:18.447367389 +0000 UTC m=+93.033965024" watchObservedRunningTime="2026-09-15 21:27:18.449964821 +0000 UTC m=+93.036562414" Sep 15 21:27:18.713119 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:18.713059 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:18.812420 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:18.812376 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:19.564716 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:19.564685 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67fc7b5f45-9sq89"] Sep 15 21:27:19.641830 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:19.641794 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:19.742603 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:19.742569 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:19.812897 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:19.812717 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:21.076922 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:21.076880 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:21.353122 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:21.353087 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:21.445766 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:21.445280 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f7c47bfd-s7mbx" event={"ID":"12875e4a-f644-455b-855f-ea7085aba992","Type":"ContainerStarted","Data":"e77f7a49027b895f24cfdca3f40b2382219b9a933ba403909e4fc27b957b11b1"} Sep 15 21:27:21.463576 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:21.463523 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f7c47bfd-s7mbx" podStartSLOduration=0.976164198 podStartE2EDuration="4.463499575s" totalImagesPullingTime="3.487335377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:27:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:27:21.462354755 +0000 UTC m=+96.048952348" watchObservedRunningTime="2026-09-15 21:27:21.463499575 +0000 UTC m=+96.050097169" Sep 15 21:27:23.113659 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:23.113617 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:23.208169 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:23.208133 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:23.280453 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:23.274963 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tvvlc" Sep 15 21:27:26.460291 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:26.460254 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:26.559398 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:26.559364 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:27.486630 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:27.486590 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:27.487117 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:27.486652 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:27.491403 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:27.491380 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:28.477220 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:28.477191 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:27:28.622611 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:28.622545 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:28.679618 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:28.679582 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:28.746586 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:28.746502 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:30.161079 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:30.161027 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:30.262130 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:30.262092 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:32.631794 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:32.631760 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:32.726345 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:32.726310 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:35.641982 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:35.641920 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:35.697105 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:35.697067 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:41.522369 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:41.522333 2573 generic.go:356] "Generic (PLEG): container finished" podID="335e21be-9627-4187-939e-a6680c2b6733" containerID="179f9703be02af028b429b7f5ab85cbbc11543801e928681aa404d2ea2890d5d" exitCode=0 Sep 15 21:27:41.522807 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:41.522409 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-4mqs2" event={"ID":"335e21be-9627-4187-939e-a6680c2b6733","Type":"ContainerDied","Data":"179f9703be02af028b429b7f5ab85cbbc11543801e928681aa404d2ea2890d5d"} Sep 15 21:27:41.522807 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:41.522724 2573 scope.go:117] "RemoveContainer" containerID="179f9703be02af028b429b7f5ab85cbbc11543801e928681aa404d2ea2890d5d" Sep 15 21:27:42.528170 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:42.528133 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-4mqs2" event={"ID":"335e21be-9627-4187-939e-a6680c2b6733","Type":"ContainerStarted","Data":"fa1ee001fa099d537fdd9bd1bdaf0f8038f45271e9239fa53982be2ec2adaf19"} Sep 15 21:27:42.529581 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:42.529558 2573 generic.go:356] "Generic (PLEG): container finished" podID="d54abead-997a-4566-ab01-681e14dffe15" containerID="5277ce7f928a5598ac8867928d90820b7373f8b6188551e3baa21a5de0009011" exitCode=0 Sep 15 21:27:42.529678 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:42.529595 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-g74kn" event={"ID":"d54abead-997a-4566-ab01-681e14dffe15","Type":"ContainerDied","Data":"5277ce7f928a5598ac8867928d90820b7373f8b6188551e3baa21a5de0009011"} Sep 15 21:27:42.529827 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:42.529816 2573 scope.go:117] "RemoveContainer" containerID="5277ce7f928a5598ac8867928d90820b7373f8b6188551e3baa21a5de0009011" Sep 15 21:27:43.535587 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:43.535551 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-g74kn" event={"ID":"d54abead-997a-4566-ab01-681e14dffe15","Type":"ContainerStarted","Data":"5eaa8fe6ec7994b26966e486c65a09464eff8e83f962553b90c6097c5a6688b4"} Sep 15 21:27:44.592243 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:44.592176 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" podUID="b05dc56b-1d26-4765-b191-85bfc180c33c" containerName="registry" containerID="cri-o://c85e5fe1702348bddb6929de616a44801442edd9427b9b5963561eab41d3563b" gracePeriod=30 Sep 15 21:27:44.872758 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:44.872693 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:27:45.005564 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.005526 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b05dc56b-1d26-4765-b191-85bfc180c33c-image-registry-private-configuration\") pod \"b05dc56b-1d26-4765-b191-85bfc180c33c\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " Sep 15 21:27:45.005564 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.005570 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b05dc56b-1d26-4765-b191-85bfc180c33c-ca-trust-extracted\") pod \"b05dc56b-1d26-4765-b191-85bfc180c33c\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " Sep 15 21:27:45.005826 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.005600 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-tls\") pod \"b05dc56b-1d26-4765-b191-85bfc180c33c\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " Sep 15 21:27:45.005826 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.005626 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b05dc56b-1d26-4765-b191-85bfc180c33c-installation-pull-secrets\") pod \"b05dc56b-1d26-4765-b191-85bfc180c33c\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " Sep 15 21:27:45.005826 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.005660 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-bound-sa-token\") pod \"b05dc56b-1d26-4765-b191-85bfc180c33c\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " Sep 15 21:27:45.005826 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.005677 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-certificates\") pod \"b05dc56b-1d26-4765-b191-85bfc180c33c\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " Sep 15 21:27:45.005826 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.005694 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcfns\" (UniqueName: \"kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-kube-api-access-rcfns\") pod \"b05dc56b-1d26-4765-b191-85bfc180c33c\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " Sep 15 21:27:45.005826 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.005718 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b05dc56b-1d26-4765-b191-85bfc180c33c-trusted-ca\") pod \"b05dc56b-1d26-4765-b191-85bfc180c33c\" (UID: \"b05dc56b-1d26-4765-b191-85bfc180c33c\") " Sep 15 21:27:45.006210 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.006160 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b05dc56b-1d26-4765-b191-85bfc180c33c" (UID: "b05dc56b-1d26-4765-b191-85bfc180c33c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:27:45.006430 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.006405 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b05dc56b-1d26-4765-b191-85bfc180c33c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b05dc56b-1d26-4765-b191-85bfc180c33c" (UID: "b05dc56b-1d26-4765-b191-85bfc180c33c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:27:45.008573 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.008528 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b05dc56b-1d26-4765-b191-85bfc180c33c" (UID: "b05dc56b-1d26-4765-b191-85bfc180c33c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:27:45.008573 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.008543 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b05dc56b-1d26-4765-b191-85bfc180c33c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b05dc56b-1d26-4765-b191-85bfc180c33c" (UID: "b05dc56b-1d26-4765-b191-85bfc180c33c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 21:27:45.008723 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.008605 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-kube-api-access-rcfns" (OuterVolumeSpecName: "kube-api-access-rcfns") pod "b05dc56b-1d26-4765-b191-85bfc180c33c" (UID: "b05dc56b-1d26-4765-b191-85bfc180c33c"). InnerVolumeSpecName "kube-api-access-rcfns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:27:45.008723 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.008630 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b05dc56b-1d26-4765-b191-85bfc180c33c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b05dc56b-1d26-4765-b191-85bfc180c33c" (UID: "b05dc56b-1d26-4765-b191-85bfc180c33c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 21:27:45.008723 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.008678 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b05dc56b-1d26-4765-b191-85bfc180c33c" (UID: "b05dc56b-1d26-4765-b191-85bfc180c33c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:27:45.014822 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.014798 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b05dc56b-1d26-4765-b191-85bfc180c33c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b05dc56b-1d26-4765-b191-85bfc180c33c" (UID: "b05dc56b-1d26-4765-b191-85bfc180c33c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:27:45.106819 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.106783 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b05dc56b-1d26-4765-b191-85bfc180c33c-trusted-ca\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:27:45.106819 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.106814 2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b05dc56b-1d26-4765-b191-85bfc180c33c-image-registry-private-configuration\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:27:45.106819 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.106825 2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b05dc56b-1d26-4765-b191-85bfc180c33c-ca-trust-extracted\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:27:45.107072 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.106835 2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-tls\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:27:45.107072 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.106862 2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b05dc56b-1d26-4765-b191-85bfc180c33c-installation-pull-secrets\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:27:45.107072 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.106871 2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-bound-sa-token\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:27:45.107072 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.106879 2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b05dc56b-1d26-4765-b191-85bfc180c33c-registry-certificates\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:27:45.107072 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.106886 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcfns\" (UniqueName: \"kubernetes.io/projected/b05dc56b-1d26-4765-b191-85bfc180c33c-kube-api-access-rcfns\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:27:45.544626 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.544594 2573 generic.go:356] "Generic (PLEG): container finished" podID="b05dc56b-1d26-4765-b191-85bfc180c33c" containerID="c85e5fe1702348bddb6929de616a44801442edd9427b9b5963561eab41d3563b" exitCode=0 Sep 15 21:27:45.544797 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.544635 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" event={"ID":"b05dc56b-1d26-4765-b191-85bfc180c33c","Type":"ContainerDied","Data":"c85e5fe1702348bddb6929de616a44801442edd9427b9b5963561eab41d3563b"} Sep 15 21:27:45.544797 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.544642 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" Sep 15 21:27:45.544797 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.544668 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67fc7b5f45-9sq89" event={"ID":"b05dc56b-1d26-4765-b191-85bfc180c33c","Type":"ContainerDied","Data":"c2729170ac3ee151223c19a730b772425d03b7f4e983e8ac05ff592640190b74"} Sep 15 21:27:45.544797 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.544687 2573 scope.go:117] "RemoveContainer" containerID="c85e5fe1702348bddb6929de616a44801442edd9427b9b5963561eab41d3563b" Sep 15 21:27:45.553064 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.553048 2573 scope.go:117] "RemoveContainer" containerID="c85e5fe1702348bddb6929de616a44801442edd9427b9b5963561eab41d3563b" Sep 15 21:27:45.553334 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:27:45.553314 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c85e5fe1702348bddb6929de616a44801442edd9427b9b5963561eab41d3563b\": container with ID starting with c85e5fe1702348bddb6929de616a44801442edd9427b9b5963561eab41d3563b not found: ID does not exist" containerID="c85e5fe1702348bddb6929de616a44801442edd9427b9b5963561eab41d3563b" Sep 15 21:27:45.553382 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.553343 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c85e5fe1702348bddb6929de616a44801442edd9427b9b5963561eab41d3563b"} err="failed to get container status \"c85e5fe1702348bddb6929de616a44801442edd9427b9b5963561eab41d3563b\": rpc error: code = NotFound desc = could not find container \"c85e5fe1702348bddb6929de616a44801442edd9427b9b5963561eab41d3563b\": container with ID starting with c85e5fe1702348bddb6929de616a44801442edd9427b9b5963561eab41d3563b not found: ID does not exist" Sep 15 21:27:45.565322 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.565301 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67fc7b5f45-9sq89"] Sep 15 21:27:45.568932 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.568910 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67fc7b5f45-9sq89"] Sep 15 21:27:45.933097 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:45.933067 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b05dc56b-1d26-4765-b191-85bfc180c33c" path="/var/lib/kubelet/pods/b05dc56b-1d26-4765-b191-85bfc180c33c/volumes" Sep 15 21:27:47.617906 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:47.617864 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:47.672676 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:47.672639 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:49.872186 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:49.872144 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:49.922698 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:49.922666 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:51.569203 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:51.569169 2573 generic.go:356] "Generic (PLEG): container finished" podID="0d4711a1-1b97-4fe8-b382-8a810c3a1a5d" containerID="d9032877ddd921713928fa3b54840f53ef01318a2ace942977404db821618327" exitCode=0 Sep 15 21:27:51.569579 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:51.569221 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-4d7d5" event={"ID":"0d4711a1-1b97-4fe8-b382-8a810c3a1a5d","Type":"ContainerDied","Data":"d9032877ddd921713928fa3b54840f53ef01318a2ace942977404db821618327"} Sep 15 21:27:51.569579 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:51.569531 2573 scope.go:117] "RemoveContainer" containerID="d9032877ddd921713928fa3b54840f53ef01318a2ace942977404db821618327" Sep 15 21:27:52.335789 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:52.335761 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65c7764bf8-c5p5m_7e761257-cdb3-4046-a183-152c58a95cf3/router/0.log" Sep 15 21:27:52.347695 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:52.347671 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hs9tw_fe233237-a6a8-4b91-9457-25bf748485fa/serve-healthcheck-canary/0.log" Sep 15 21:27:52.574754 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:52.574718 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-4d7d5" event={"ID":"0d4711a1-1b97-4fe8-b382-8a810c3a1a5d","Type":"ContainerStarted","Data":"e8897fc32eb1caa08c1cd284635452649e7a1169cda2287c6fa9b16c52d4ed58"} Sep 15 21:27:54.357541 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:54.357500 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:54.418733 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:54.418697 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:27:54.485287 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:27:54.485256 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:28:29.325009 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:29.324971 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:28:29.946367 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:29.946333 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:28:31.090886 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:31.090812 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:28:38.666980 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.666894 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69ff9dbfb4-2z8z6"] Sep 15 21:28:38.667503 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.667376 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b05dc56b-1d26-4765-b191-85bfc180c33c" containerName="registry" Sep 15 21:28:38.667503 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.667396 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b05dc56b-1d26-4765-b191-85bfc180c33c" containerName="registry" Sep 15 21:28:38.667503 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.667471 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b05dc56b-1d26-4765-b191-85bfc180c33c" containerName="registry" Sep 15 21:28:38.669555 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.669533 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:38.681031 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.681002 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69ff9dbfb4-2z8z6"] Sep 15 21:28:38.717937 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.717903 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:28:38.728730 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.728704 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89092930-4174-4ba4-9b28-1134813f089f-service-ca\") pod \"console-69ff9dbfb4-2z8z6\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:38.728889 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.728735 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89092930-4174-4ba4-9b28-1134813f089f-oauth-serving-cert\") pod \"console-69ff9dbfb4-2z8z6\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:38.728889 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.728759 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89092930-4174-4ba4-9b28-1134813f089f-console-serving-cert\") pod \"console-69ff9dbfb4-2z8z6\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:38.728889 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.728824 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w52gt\" (UniqueName: \"kubernetes.io/projected/89092930-4174-4ba4-9b28-1134813f089f-kube-api-access-w52gt\") pod \"console-69ff9dbfb4-2z8z6\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:38.728889 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.728875 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89092930-4174-4ba4-9b28-1134813f089f-trusted-ca-bundle\") pod \"console-69ff9dbfb4-2z8z6\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:38.729023 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.728923 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89092930-4174-4ba4-9b28-1134813f089f-console-config\") pod \"console-69ff9dbfb4-2z8z6\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:38.729023 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.728951 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89092930-4174-4ba4-9b28-1134813f089f-console-oauth-config\") pod \"console-69ff9dbfb4-2z8z6\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:38.829604 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.829569 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89092930-4174-4ba4-9b28-1134813f089f-console-config\") pod \"console-69ff9dbfb4-2z8z6\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:38.829782 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.829614 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89092930-4174-4ba4-9b28-1134813f089f-console-oauth-config\") pod \"console-69ff9dbfb4-2z8z6\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:38.829782 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.829649 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89092930-4174-4ba4-9b28-1134813f089f-service-ca\") pod \"console-69ff9dbfb4-2z8z6\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:38.829782 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.829664 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89092930-4174-4ba4-9b28-1134813f089f-oauth-serving-cert\") pod \"console-69ff9dbfb4-2z8z6\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:38.829782 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.829685 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89092930-4174-4ba4-9b28-1134813f089f-console-serving-cert\") pod \"console-69ff9dbfb4-2z8z6\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:38.829782 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.829706 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w52gt\" (UniqueName: \"kubernetes.io/projected/89092930-4174-4ba4-9b28-1134813f089f-kube-api-access-w52gt\") pod \"console-69ff9dbfb4-2z8z6\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:38.829782 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.829724 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89092930-4174-4ba4-9b28-1134813f089f-trusted-ca-bundle\") pod \"console-69ff9dbfb4-2z8z6\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:38.830482 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.830455 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89092930-4174-4ba4-9b28-1134813f089f-service-ca\") pod \"console-69ff9dbfb4-2z8z6\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:38.830579 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.830520 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89092930-4174-4ba4-9b28-1134813f089f-console-config\") pod \"console-69ff9dbfb4-2z8z6\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:38.830618 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.830572 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89092930-4174-4ba4-9b28-1134813f089f-oauth-serving-cert\") pod \"console-69ff9dbfb4-2z8z6\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:38.830764 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.830747 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89092930-4174-4ba4-9b28-1134813f089f-trusted-ca-bundle\") pod \"console-69ff9dbfb4-2z8z6\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:38.832120 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.832093 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89092930-4174-4ba4-9b28-1134813f089f-console-serving-cert\") pod \"console-69ff9dbfb4-2z8z6\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:38.832203 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.832128 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89092930-4174-4ba4-9b28-1134813f089f-console-oauth-config\") pod \"console-69ff9dbfb4-2z8z6\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:38.837611 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.837590 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w52gt\" (UniqueName: \"kubernetes.io/projected/89092930-4174-4ba4-9b28-1134813f089f-kube-api-access-w52gt\") pod \"console-69ff9dbfb4-2z8z6\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:38.864565 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.864525 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:28:38.921716 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.921629 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:28:38.979828 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:38.979794 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:39.248724 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:39.248701 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69ff9dbfb4-2z8z6"] Sep 15 21:28:39.251296 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:28:39.251264 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89092930_4174_4ba4_9b28_1134813f089f.slice/crio-a22c9b94064b680ae3531991b7c48df6151bf1a0df6d53580b4a38f23984a5c6 WatchSource:0}: Error finding container a22c9b94064b680ae3531991b7c48df6151bf1a0df6d53580b4a38f23984a5c6: Status 404 returned error can't find the container with id a22c9b94064b680ae3531991b7c48df6151bf1a0df6d53580b4a38f23984a5c6 Sep 15 21:28:39.490452 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:39.490417 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:28:39.548529 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:39.548445 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:28:39.756514 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:39.756482 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69ff9dbfb4-2z8z6" event={"ID":"89092930-4174-4ba4-9b28-1134813f089f","Type":"ContainerStarted","Data":"2b359a6de1235284ddfe07cf3e04006df17a7acdaaa010b593fba424acba9cde"} Sep 15 21:28:39.756903 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:39.756530 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69ff9dbfb4-2z8z6" event={"ID":"89092930-4174-4ba4-9b28-1134813f089f","Type":"ContainerStarted","Data":"a22c9b94064b680ae3531991b7c48df6151bf1a0df6d53580b4a38f23984a5c6"} Sep 15 21:28:39.774446 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:39.774399 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69ff9dbfb4-2z8z6" podStartSLOduration=1.7743839750000001 podStartE2EDuration="1.774383975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:28:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:28:39.773543439 +0000 UTC m=+174.360141032" watchObservedRunningTime="2026-09-15 21:28:39.774383975 +0000 UTC m=+174.360981567" Sep 15 21:28:48.980291 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:48.980242 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:48.980755 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:48.980348 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:48.985071 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:48.985047 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:49.798127 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:49.798096 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:28:49.838320 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:49.838281 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f7c47bfd-s7mbx"] Sep 15 21:28:49.939576 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:49.939543 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:28:50.041282 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:50.041249 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:28:50.095938 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:28:50.095840 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:29:14.859080 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:14.859014 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f7c47bfd-s7mbx" podUID="12875e4a-f644-455b-855f-ea7085aba992" containerName="console" containerID="cri-o://e77f7a49027b895f24cfdca3f40b2382219b9a933ba403909e4fc27b957b11b1" gracePeriod=15 Sep 15 21:29:15.099434 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.099409 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:29:15.233968 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.233930 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12875e4a-f644-455b-855f-ea7085aba992-console-oauth-config\") pod \"12875e4a-f644-455b-855f-ea7085aba992\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " Sep 15 21:29:15.234128 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.233987 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12875e4a-f644-455b-855f-ea7085aba992-console-config\") pod \"12875e4a-f644-455b-855f-ea7085aba992\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " Sep 15 21:29:15.234128 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.234020 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zq5n4\" (UniqueName: \"kubernetes.io/projected/12875e4a-f644-455b-855f-ea7085aba992-kube-api-access-zq5n4\") pod \"12875e4a-f644-455b-855f-ea7085aba992\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " Sep 15 21:29:15.234128 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.234054 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12875e4a-f644-455b-855f-ea7085aba992-oauth-serving-cert\") pod \"12875e4a-f644-455b-855f-ea7085aba992\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " Sep 15 21:29:15.234128 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.234086 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12875e4a-f644-455b-855f-ea7085aba992-trusted-ca-bundle\") pod \"12875e4a-f644-455b-855f-ea7085aba992\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " Sep 15 21:29:15.234315 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.234130 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12875e4a-f644-455b-855f-ea7085aba992-console-serving-cert\") pod \"12875e4a-f644-455b-855f-ea7085aba992\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " Sep 15 21:29:15.234315 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.234165 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12875e4a-f644-455b-855f-ea7085aba992-service-ca\") pod \"12875e4a-f644-455b-855f-ea7085aba992\" (UID: \"12875e4a-f644-455b-855f-ea7085aba992\") " Sep 15 21:29:15.234536 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.234501 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12875e4a-f644-455b-855f-ea7085aba992-console-config" (OuterVolumeSpecName: "console-config") pod "12875e4a-f644-455b-855f-ea7085aba992" (UID: "12875e4a-f644-455b-855f-ea7085aba992"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:29:15.234662 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.234505 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12875e4a-f644-455b-855f-ea7085aba992-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "12875e4a-f644-455b-855f-ea7085aba992" (UID: "12875e4a-f644-455b-855f-ea7085aba992"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:29:15.234662 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.234635 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12875e4a-f644-455b-855f-ea7085aba992-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "12875e4a-f644-455b-855f-ea7085aba992" (UID: "12875e4a-f644-455b-855f-ea7085aba992"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:29:15.234757 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.234672 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12875e4a-f644-455b-855f-ea7085aba992-service-ca" (OuterVolumeSpecName: "service-ca") pod "12875e4a-f644-455b-855f-ea7085aba992" (UID: "12875e4a-f644-455b-855f-ea7085aba992"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:29:15.236318 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.236293 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12875e4a-f644-455b-855f-ea7085aba992-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "12875e4a-f644-455b-855f-ea7085aba992" (UID: "12875e4a-f644-455b-855f-ea7085aba992"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 21:29:15.236411 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.236313 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12875e4a-f644-455b-855f-ea7085aba992-kube-api-access-zq5n4" (OuterVolumeSpecName: "kube-api-access-zq5n4") pod "12875e4a-f644-455b-855f-ea7085aba992" (UID: "12875e4a-f644-455b-855f-ea7085aba992"). InnerVolumeSpecName "kube-api-access-zq5n4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:29:15.236411 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.236341 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12875e4a-f644-455b-855f-ea7085aba992-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "12875e4a-f644-455b-855f-ea7085aba992" (UID: "12875e4a-f644-455b-855f-ea7085aba992"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 21:29:15.335194 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.335153 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12875e4a-f644-455b-855f-ea7085aba992-console-oauth-config\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:29:15.335194 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.335189 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12875e4a-f644-455b-855f-ea7085aba992-console-config\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:29:15.335194 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.335201 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zq5n4\" (UniqueName: \"kubernetes.io/projected/12875e4a-f644-455b-855f-ea7085aba992-kube-api-access-zq5n4\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:29:15.335431 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.335214 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12875e4a-f644-455b-855f-ea7085aba992-oauth-serving-cert\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:29:15.335431 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.335225 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12875e4a-f644-455b-855f-ea7085aba992-trusted-ca-bundle\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:29:15.335431 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.335237 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12875e4a-f644-455b-855f-ea7085aba992-console-serving-cert\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:29:15.335431 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.335248 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12875e4a-f644-455b-855f-ea7085aba992-service-ca\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:29:15.901293 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.901261 2573 generic.go:356] "Generic (PLEG): container finished" podID="12875e4a-f644-455b-855f-ea7085aba992" containerID="e77f7a49027b895f24cfdca3f40b2382219b9a933ba403909e4fc27b957b11b1" exitCode=0 Sep 15 21:29:15.901714 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.901299 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f7c47bfd-s7mbx" event={"ID":"12875e4a-f644-455b-855f-ea7085aba992","Type":"ContainerDied","Data":"e77f7a49027b895f24cfdca3f40b2382219b9a933ba403909e4fc27b957b11b1"} Sep 15 21:29:15.901714 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.901318 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f7c47bfd-s7mbx" Sep 15 21:29:15.901714 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.901345 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f7c47bfd-s7mbx" event={"ID":"12875e4a-f644-455b-855f-ea7085aba992","Type":"ContainerDied","Data":"67c09aa65d98440e5ef25962dae3a73bc730e69a05d3b7eb3acbc81aba0f36ea"} Sep 15 21:29:15.901714 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.901375 2573 scope.go:117] "RemoveContainer" containerID="e77f7a49027b895f24cfdca3f40b2382219b9a933ba403909e4fc27b957b11b1" Sep 15 21:29:15.910294 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.910275 2573 scope.go:117] "RemoveContainer" containerID="e77f7a49027b895f24cfdca3f40b2382219b9a933ba403909e4fc27b957b11b1" Sep 15 21:29:15.910566 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:29:15.910544 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e77f7a49027b895f24cfdca3f40b2382219b9a933ba403909e4fc27b957b11b1\": container with ID starting with e77f7a49027b895f24cfdca3f40b2382219b9a933ba403909e4fc27b957b11b1 not found: ID does not exist" containerID="e77f7a49027b895f24cfdca3f40b2382219b9a933ba403909e4fc27b957b11b1" Sep 15 21:29:15.910635 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.910578 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e77f7a49027b895f24cfdca3f40b2382219b9a933ba403909e4fc27b957b11b1"} err="failed to get container status \"e77f7a49027b895f24cfdca3f40b2382219b9a933ba403909e4fc27b957b11b1\": rpc error: code = NotFound desc = could not find container \"e77f7a49027b895f24cfdca3f40b2382219b9a933ba403909e4fc27b957b11b1\": container with ID starting with e77f7a49027b895f24cfdca3f40b2382219b9a933ba403909e4fc27b957b11b1 not found: ID does not exist" Sep 15 21:29:15.921763 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.921739 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f7c47bfd-s7mbx"] Sep 15 21:29:15.925700 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.925678 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f7c47bfd-s7mbx"] Sep 15 21:29:15.932968 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:15.932942 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12875e4a-f644-455b-855f-ea7085aba992" path="/var/lib/kubelet/pods/12875e4a-f644-455b-855f-ea7085aba992/volumes" Sep 15 21:29:22.526984 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:22.526944 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:29:22.579991 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:22.579962 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:29:27.439579 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:27.439541 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:29:45.220476 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.220437 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:29:45.274953 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.274912 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:29:45.795512 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.795477 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-db74bcf87-nk6wk"] Sep 15 21:29:45.796005 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.795982 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12875e4a-f644-455b-855f-ea7085aba992" containerName="console" Sep 15 21:29:45.796005 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.796006 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="12875e4a-f644-455b-855f-ea7085aba992" containerName="console" Sep 15 21:29:45.796179 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.796064 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="12875e4a-f644-455b-855f-ea7085aba992" containerName="console" Sep 15 21:29:45.797983 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.797959 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:45.812893 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.812834 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-db74bcf87-nk6wk"] Sep 15 21:29:45.843197 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.843164 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:29:45.859153 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.859129 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-console-serving-cert\") pod \"console-db74bcf87-nk6wk\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:45.859271 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.859164 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-trusted-ca-bundle\") pod \"console-db74bcf87-nk6wk\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:45.859271 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.859188 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp8km\" (UniqueName: \"kubernetes.io/projected/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-kube-api-access-gp8km\") pod \"console-db74bcf87-nk6wk\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:45.859271 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.859219 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-console-config\") pod \"console-db74bcf87-nk6wk\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:45.859271 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.859238 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-service-ca\") pod \"console-db74bcf87-nk6wk\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:45.859271 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.859259 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-console-oauth-config\") pod \"console-db74bcf87-nk6wk\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:45.859461 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.859283 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-oauth-serving-cert\") pod \"console-db74bcf87-nk6wk\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:45.897176 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.897140 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:29:45.959905 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.959875 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-console-serving-cert\") pod \"console-db74bcf87-nk6wk\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:45.960071 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.959919 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-trusted-ca-bundle\") pod \"console-db74bcf87-nk6wk\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:45.960071 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.959951 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp8km\" (UniqueName: \"kubernetes.io/projected/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-kube-api-access-gp8km\") pod \"console-db74bcf87-nk6wk\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:45.960071 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.959975 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-console-config\") pod \"console-db74bcf87-nk6wk\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:45.960071 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.959996 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-service-ca\") pod \"console-db74bcf87-nk6wk\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:45.960071 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.960032 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-console-oauth-config\") pod \"console-db74bcf87-nk6wk\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:45.960311 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.960189 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-oauth-serving-cert\") pod \"console-db74bcf87-nk6wk\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:45.960862 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.960823 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-console-config\") pod \"console-db74bcf87-nk6wk\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:45.960965 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.960823 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-service-ca\") pod \"console-db74bcf87-nk6wk\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:45.960965 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.960833 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-trusted-ca-bundle\") pod \"console-db74bcf87-nk6wk\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:45.960965 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.960897 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-oauth-serving-cert\") pod \"console-db74bcf87-nk6wk\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:45.962804 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.962783 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-console-oauth-config\") pod \"console-db74bcf87-nk6wk\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:45.962907 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.962893 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-console-serving-cert\") pod \"console-db74bcf87-nk6wk\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:45.967730 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:45.967707 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp8km\" (UniqueName: \"kubernetes.io/projected/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-kube-api-access-gp8km\") pod \"console-db74bcf87-nk6wk\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:46.109637 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:46.109555 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:46.377888 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:46.377807 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-db74bcf87-nk6wk"] Sep 15 21:29:46.380115 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:29:46.380090 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4ac0a0_4c31_41f7_8c60_b38fb4155de8.slice/crio-893a38bc5dc766d9d715ba07f7a81c7c3ff7a47aa4e6476b87cafb55ecc5a549 WatchSource:0}: Error finding container 893a38bc5dc766d9d715ba07f7a81c7c3ff7a47aa4e6476b87cafb55ecc5a549: Status 404 returned error can't find the container with id 893a38bc5dc766d9d715ba07f7a81c7c3ff7a47aa4e6476b87cafb55ecc5a549 Sep 15 21:29:47.024424 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:47.024387 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db74bcf87-nk6wk" event={"ID":"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8","Type":"ContainerStarted","Data":"bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06"} Sep 15 21:29:47.024626 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:47.024458 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db74bcf87-nk6wk" event={"ID":"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8","Type":"ContainerStarted","Data":"893a38bc5dc766d9d715ba07f7a81c7c3ff7a47aa4e6476b87cafb55ecc5a549"} Sep 15 21:29:47.045089 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:47.045045 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-db74bcf87-nk6wk" podStartSLOduration=2.045033026 podStartE2EDuration="2.045033026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:29:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:29:47.044271858 +0000 UTC m=+241.630869464" watchObservedRunningTime="2026-09-15 21:29:47.045033026 +0000 UTC m=+241.631630617" Sep 15 21:29:56.110439 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:56.110397 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:56.110928 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:56.110485 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:56.115712 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:56.115694 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:57.066934 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:57.066903 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:29:57.110309 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:57.110274 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69ff9dbfb4-2z8z6"] Sep 15 21:29:57.224834 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:57.224799 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:29:57.326142 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:57.326046 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:29:57.427011 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:29:57.426974 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:30:00.946679 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:00.946647 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:30:02.661130 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:02.661079 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:30:02.760114 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:02.760082 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:30:22.133234 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:22.133138 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69ff9dbfb4-2z8z6" podUID="89092930-4174-4ba4-9b28-1134813f089f" containerName="console" containerID="cri-o://2b359a6de1235284ddfe07cf3e04006df17a7acdaaa010b593fba424acba9cde" gracePeriod=15 Sep 15 21:30:22.372306 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:22.372284 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:30:22.443183 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:22.443111 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w52gt\" (UniqueName: \"kubernetes.io/projected/89092930-4174-4ba4-9b28-1134813f089f-kube-api-access-w52gt\") pod \"89092930-4174-4ba4-9b28-1134813f089f\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " Sep 15 21:30:22.443183 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:22.443145 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89092930-4174-4ba4-9b28-1134813f089f-console-config\") pod \"89092930-4174-4ba4-9b28-1134813f089f\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " Sep 15 21:30:22.443183 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:22.443166 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89092930-4174-4ba4-9b28-1134813f089f-console-serving-cert\") pod \"89092930-4174-4ba4-9b28-1134813f089f\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " Sep 15 21:30:22.443445 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:22.443207 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89092930-4174-4ba4-9b28-1134813f089f-console-oauth-config\") pod \"89092930-4174-4ba4-9b28-1134813f089f\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " Sep 15 21:30:22.443445 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:22.443231 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89092930-4174-4ba4-9b28-1134813f089f-service-ca\") pod \"89092930-4174-4ba4-9b28-1134813f089f\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " Sep 15 21:30:22.443445 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:22.443249 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89092930-4174-4ba4-9b28-1134813f089f-trusted-ca-bundle\") pod \"89092930-4174-4ba4-9b28-1134813f089f\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " Sep 15 21:30:22.443445 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:22.443277 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89092930-4174-4ba4-9b28-1134813f089f-oauth-serving-cert\") pod \"89092930-4174-4ba4-9b28-1134813f089f\" (UID: \"89092930-4174-4ba4-9b28-1134813f089f\") " Sep 15 21:30:22.443658 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:22.443620 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89092930-4174-4ba4-9b28-1134813f089f-console-config" (OuterVolumeSpecName: "console-config") pod "89092930-4174-4ba4-9b28-1134813f089f" (UID: "89092930-4174-4ba4-9b28-1134813f089f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:30:22.443730 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:22.443702 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89092930-4174-4ba4-9b28-1134813f089f-service-ca" (OuterVolumeSpecName: "service-ca") pod "89092930-4174-4ba4-9b28-1134813f089f" (UID: "89092930-4174-4ba4-9b28-1134813f089f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:30:22.443783 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:22.443735 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89092930-4174-4ba4-9b28-1134813f089f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "89092930-4174-4ba4-9b28-1134813f089f" (UID: "89092930-4174-4ba4-9b28-1134813f089f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:30:22.443783 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:22.443771 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89092930-4174-4ba4-9b28-1134813f089f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "89092930-4174-4ba4-9b28-1134813f089f" (UID: "89092930-4174-4ba4-9b28-1134813f089f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:30:22.445353 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:22.445328 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89092930-4174-4ba4-9b28-1134813f089f-kube-api-access-w52gt" (OuterVolumeSpecName: "kube-api-access-w52gt") pod "89092930-4174-4ba4-9b28-1134813f089f" (UID: "89092930-4174-4ba4-9b28-1134813f089f"). InnerVolumeSpecName "kube-api-access-w52gt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:30:22.445455 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:22.445344 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89092930-4174-4ba4-9b28-1134813f089f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "89092930-4174-4ba4-9b28-1134813f089f" (UID: "89092930-4174-4ba4-9b28-1134813f089f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 21:30:22.445455 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:22.445360 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89092930-4174-4ba4-9b28-1134813f089f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "89092930-4174-4ba4-9b28-1134813f089f" (UID: "89092930-4174-4ba4-9b28-1134813f089f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 21:30:22.544529 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:22.544488 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89092930-4174-4ba4-9b28-1134813f089f-service-ca\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:30:22.544529 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:22.544520 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89092930-4174-4ba4-9b28-1134813f089f-trusted-ca-bundle\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:30:22.544529 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:22.544530 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89092930-4174-4ba4-9b28-1134813f089f-oauth-serving-cert\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:30:22.544529 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:22.544538 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w52gt\" (UniqueName: \"kubernetes.io/projected/89092930-4174-4ba4-9b28-1134813f089f-kube-api-access-w52gt\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:30:22.544795 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:22.544547 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89092930-4174-4ba4-9b28-1134813f089f-console-config\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:30:22.544795 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:22.544556 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89092930-4174-4ba4-9b28-1134813f089f-console-serving-cert\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:30:22.544795 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:22.544564 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89092930-4174-4ba4-9b28-1134813f089f-console-oauth-config\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:30:23.162339 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:23.162309 2573 generic.go:356] "Generic (PLEG): container finished" podID="89092930-4174-4ba4-9b28-1134813f089f" containerID="2b359a6de1235284ddfe07cf3e04006df17a7acdaaa010b593fba424acba9cde" exitCode=0 Sep 15 21:30:23.162772 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:23.162351 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69ff9dbfb4-2z8z6" Sep 15 21:30:23.162772 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:23.162359 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69ff9dbfb4-2z8z6" event={"ID":"89092930-4174-4ba4-9b28-1134813f089f","Type":"ContainerDied","Data":"2b359a6de1235284ddfe07cf3e04006df17a7acdaaa010b593fba424acba9cde"} Sep 15 21:30:23.162772 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:23.162396 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69ff9dbfb4-2z8z6" event={"ID":"89092930-4174-4ba4-9b28-1134813f089f","Type":"ContainerDied","Data":"a22c9b94064b680ae3531991b7c48df6151bf1a0df6d53580b4a38f23984a5c6"} Sep 15 21:30:23.162772 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:23.162415 2573 scope.go:117] "RemoveContainer" containerID="2b359a6de1235284ddfe07cf3e04006df17a7acdaaa010b593fba424acba9cde" Sep 15 21:30:23.171104 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:23.171078 2573 scope.go:117] "RemoveContainer" containerID="2b359a6de1235284ddfe07cf3e04006df17a7acdaaa010b593fba424acba9cde" Sep 15 21:30:23.171384 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:30:23.171365 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b359a6de1235284ddfe07cf3e04006df17a7acdaaa010b593fba424acba9cde\": container with ID starting with 2b359a6de1235284ddfe07cf3e04006df17a7acdaaa010b593fba424acba9cde not found: ID does not exist" containerID="2b359a6de1235284ddfe07cf3e04006df17a7acdaaa010b593fba424acba9cde" Sep 15 21:30:23.171430 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:23.171393 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b359a6de1235284ddfe07cf3e04006df17a7acdaaa010b593fba424acba9cde"} err="failed to get container status \"2b359a6de1235284ddfe07cf3e04006df17a7acdaaa010b593fba424acba9cde\": rpc error: code = NotFound desc = could not find container \"2b359a6de1235284ddfe07cf3e04006df17a7acdaaa010b593fba424acba9cde\": container with ID starting with 2b359a6de1235284ddfe07cf3e04006df17a7acdaaa010b593fba424acba9cde not found: ID does not exist" Sep 15 21:30:23.183094 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:23.183071 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69ff9dbfb4-2z8z6"] Sep 15 21:30:23.189941 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:23.187318 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69ff9dbfb4-2z8z6"] Sep 15 21:30:23.932060 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:23.932020 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89092930-4174-4ba4-9b28-1134813f089f" path="/var/lib/kubelet/pods/89092930-4174-4ba4-9b28-1134813f089f/volumes" Sep 15 21:30:38.990312 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:38.990265 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:30:39.097633 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:39.097593 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:30:39.626742 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:39.626705 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck"] Sep 15 21:30:39.627049 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:39.627035 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89092930-4174-4ba4-9b28-1134813f089f" containerName="console" Sep 15 21:30:39.627101 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:39.627050 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="89092930-4174-4ba4-9b28-1134813f089f" containerName="console" Sep 15 21:30:39.627148 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:39.627109 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="89092930-4174-4ba4-9b28-1134813f089f" containerName="console" Sep 15 21:30:39.630043 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:39.630027 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck" Sep 15 21:30:39.632961 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:39.632936 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 15 21:30:39.633085 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:39.632939 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kgh75\"" Sep 15 21:30:39.633889 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:39.633868 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 15 21:30:39.640090 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:39.640053 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck"] Sep 15 21:30:39.777090 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:39.777047 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fc17a72-aa42-49d5-9fbb-c0da05f2845c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck\" (UID: \"3fc17a72-aa42-49d5-9fbb-c0da05f2845c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck" Sep 15 21:30:39.777255 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:39.777118 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqpp9\" (UniqueName: \"kubernetes.io/projected/3fc17a72-aa42-49d5-9fbb-c0da05f2845c-kube-api-access-rqpp9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck\" (UID: \"3fc17a72-aa42-49d5-9fbb-c0da05f2845c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck" Sep 15 21:30:39.777255 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:39.777162 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fc17a72-aa42-49d5-9fbb-c0da05f2845c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck\" (UID: \"3fc17a72-aa42-49d5-9fbb-c0da05f2845c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck" Sep 15 21:30:39.878249 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:39.878158 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fc17a72-aa42-49d5-9fbb-c0da05f2845c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck\" (UID: \"3fc17a72-aa42-49d5-9fbb-c0da05f2845c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck" Sep 15 21:30:39.878249 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:39.878218 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqpp9\" (UniqueName: \"kubernetes.io/projected/3fc17a72-aa42-49d5-9fbb-c0da05f2845c-kube-api-access-rqpp9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck\" (UID: \"3fc17a72-aa42-49d5-9fbb-c0da05f2845c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck" Sep 15 21:30:39.878417 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:39.878266 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fc17a72-aa42-49d5-9fbb-c0da05f2845c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck\" (UID: \"3fc17a72-aa42-49d5-9fbb-c0da05f2845c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck" Sep 15 21:30:39.878571 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:39.878551 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fc17a72-aa42-49d5-9fbb-c0da05f2845c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck\" (UID: \"3fc17a72-aa42-49d5-9fbb-c0da05f2845c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck" Sep 15 21:30:39.878632 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:39.878598 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fc17a72-aa42-49d5-9fbb-c0da05f2845c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck\" (UID: \"3fc17a72-aa42-49d5-9fbb-c0da05f2845c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck" Sep 15 21:30:39.886568 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:39.886549 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqpp9\" (UniqueName: \"kubernetes.io/projected/3fc17a72-aa42-49d5-9fbb-c0da05f2845c-kube-api-access-rqpp9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck\" (UID: \"3fc17a72-aa42-49d5-9fbb-c0da05f2845c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck" Sep 15 21:30:39.939341 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:39.939317 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck" Sep 15 21:30:40.206085 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:40.206058 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck"] Sep 15 21:30:40.208583 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:30:40.208554 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fc17a72_aa42_49d5_9fbb_c0da05f2845c.slice/crio-315331b7dc3eb240ea7aebece1b20628f7492c847992b12a60a80be2a2648567 WatchSource:0}: Error finding container 315331b7dc3eb240ea7aebece1b20628f7492c847992b12a60a80be2a2648567: Status 404 returned error can't find the container with id 315331b7dc3eb240ea7aebece1b20628f7492c847992b12a60a80be2a2648567 Sep 15 21:30:40.231736 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:40.231707 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck" event={"ID":"3fc17a72-aa42-49d5-9fbb-c0da05f2845c","Type":"ContainerStarted","Data":"315331b7dc3eb240ea7aebece1b20628f7492c847992b12a60a80be2a2648567"} Sep 15 21:30:45.797074 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:45.797032 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/1.log" Sep 15 21:30:45.800533 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:45.800506 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/1.log" Sep 15 21:30:45.817869 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:45.817797 2573 kubelet.go:1648] "Image garbage collection succeeded" Sep 15 21:30:49.269297 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:49.269263 2573 generic.go:356] "Generic (PLEG): container finished" podID="3fc17a72-aa42-49d5-9fbb-c0da05f2845c" containerID="a8d3459c0a109c2af616ab74088fed4517bdff6412bd321390c8059d6b2d66d2" exitCode=0 Sep 15 21:30:49.269686 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:49.269312 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck" event={"ID":"3fc17a72-aa42-49d5-9fbb-c0da05f2845c","Type":"ContainerDied","Data":"a8d3459c0a109c2af616ab74088fed4517bdff6412bd321390c8059d6b2d66d2"} Sep 15 21:30:49.270387 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:49.270370 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 21:30:52.281792 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:52.281750 2573 generic.go:356] "Generic (PLEG): container finished" podID="3fc17a72-aa42-49d5-9fbb-c0da05f2845c" containerID="2392c2dbde90d78fe878ee696f5db3caf0bb70c52b93e5ffe6ed98179b8fbac8" exitCode=0 Sep 15 21:30:52.282214 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:52.281834 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck" event={"ID":"3fc17a72-aa42-49d5-9fbb-c0da05f2845c","Type":"ContainerDied","Data":"2392c2dbde90d78fe878ee696f5db3caf0bb70c52b93e5ffe6ed98179b8fbac8"} Sep 15 21:30:59.315936 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:59.315898 2573 generic.go:356] "Generic (PLEG): container finished" podID="3fc17a72-aa42-49d5-9fbb-c0da05f2845c" containerID="fcb94518d3c7d626b494ead8282feb277e53d27e33e873b2321e56100428ab11" exitCode=0 Sep 15 21:30:59.316301 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:30:59.315992 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck" event={"ID":"3fc17a72-aa42-49d5-9fbb-c0da05f2845c","Type":"ContainerDied","Data":"fcb94518d3c7d626b494ead8282feb277e53d27e33e873b2321e56100428ab11"} Sep 15 21:31:00.447623 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:00.447598 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck" Sep 15 21:31:00.535522 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:00.535486 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqpp9\" (UniqueName: \"kubernetes.io/projected/3fc17a72-aa42-49d5-9fbb-c0da05f2845c-kube-api-access-rqpp9\") pod \"3fc17a72-aa42-49d5-9fbb-c0da05f2845c\" (UID: \"3fc17a72-aa42-49d5-9fbb-c0da05f2845c\") " Sep 15 21:31:00.535713 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:00.535539 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fc17a72-aa42-49d5-9fbb-c0da05f2845c-util\") pod \"3fc17a72-aa42-49d5-9fbb-c0da05f2845c\" (UID: \"3fc17a72-aa42-49d5-9fbb-c0da05f2845c\") " Sep 15 21:31:00.535713 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:00.535579 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fc17a72-aa42-49d5-9fbb-c0da05f2845c-bundle\") pod \"3fc17a72-aa42-49d5-9fbb-c0da05f2845c\" (UID: \"3fc17a72-aa42-49d5-9fbb-c0da05f2845c\") " Sep 15 21:31:00.536258 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:00.536234 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc17a72-aa42-49d5-9fbb-c0da05f2845c-bundle" (OuterVolumeSpecName: "bundle") pod "3fc17a72-aa42-49d5-9fbb-c0da05f2845c" (UID: "3fc17a72-aa42-49d5-9fbb-c0da05f2845c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:31:00.537717 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:00.537692 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fc17a72-aa42-49d5-9fbb-c0da05f2845c-kube-api-access-rqpp9" (OuterVolumeSpecName: "kube-api-access-rqpp9") pod "3fc17a72-aa42-49d5-9fbb-c0da05f2845c" (UID: "3fc17a72-aa42-49d5-9fbb-c0da05f2845c"). InnerVolumeSpecName "kube-api-access-rqpp9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:31:00.540390 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:00.540361 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc17a72-aa42-49d5-9fbb-c0da05f2845c-util" (OuterVolumeSpecName: "util") pod "3fc17a72-aa42-49d5-9fbb-c0da05f2845c" (UID: "3fc17a72-aa42-49d5-9fbb-c0da05f2845c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:31:00.636749 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:00.636668 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqpp9\" (UniqueName: \"kubernetes.io/projected/3fc17a72-aa42-49d5-9fbb-c0da05f2845c-kube-api-access-rqpp9\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:31:00.636749 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:00.636699 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fc17a72-aa42-49d5-9fbb-c0da05f2845c-util\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:31:00.636749 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:00.636709 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fc17a72-aa42-49d5-9fbb-c0da05f2845c-bundle\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:31:01.327634 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:01.327601 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck" Sep 15 21:31:01.327797 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:01.327601 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zk5ck" event={"ID":"3fc17a72-aa42-49d5-9fbb-c0da05f2845c","Type":"ContainerDied","Data":"315331b7dc3eb240ea7aebece1b20628f7492c847992b12a60a80be2a2648567"} Sep 15 21:31:01.327797 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:01.327723 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="315331b7dc3eb240ea7aebece1b20628f7492c847992b12a60a80be2a2648567" Sep 15 21:31:06.044187 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:06.044155 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:07.797471 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:07.797439 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fg8zp"] Sep 15 21:31:07.797867 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:07.797713 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc17a72-aa42-49d5-9fbb-c0da05f2845c" containerName="extract" Sep 15 21:31:07.797867 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:07.797724 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc17a72-aa42-49d5-9fbb-c0da05f2845c" containerName="extract" Sep 15 21:31:07.797867 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:07.797740 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc17a72-aa42-49d5-9fbb-c0da05f2845c" containerName="util" Sep 15 21:31:07.797867 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:07.797747 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc17a72-aa42-49d5-9fbb-c0da05f2845c" containerName="util" Sep 15 21:31:07.797867 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:07.797754 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc17a72-aa42-49d5-9fbb-c0da05f2845c" containerName="pull" Sep 15 21:31:07.797867 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:07.797759 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc17a72-aa42-49d5-9fbb-c0da05f2845c" containerName="pull" Sep 15 21:31:07.797867 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:07.797806 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fc17a72-aa42-49d5-9fbb-c0da05f2845c" containerName="extract" Sep 15 21:31:07.842511 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:07.842480 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fg8zp"] Sep 15 21:31:07.842657 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:07.842594 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fg8zp" Sep 15 21:31:07.845328 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:07.845306 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 15 21:31:07.845539 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:07.845517 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 15 21:31:07.845676 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:07.845659 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-j48fm\"" Sep 15 21:31:07.892025 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:07.891993 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21472910-c902-493f-85a3-54f40b85f51e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fg8zp\" (UID: \"21472910-c902-493f-85a3-54f40b85f51e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fg8zp" Sep 15 21:31:07.892168 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:07.892046 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz7fj\" (UniqueName: \"kubernetes.io/projected/21472910-c902-493f-85a3-54f40b85f51e-kube-api-access-pz7fj\") pod \"cert-manager-operator-controller-manager-55c444bf86-fg8zp\" (UID: \"21472910-c902-493f-85a3-54f40b85f51e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fg8zp" Sep 15 21:31:07.993096 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:07.993056 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz7fj\" (UniqueName: \"kubernetes.io/projected/21472910-c902-493f-85a3-54f40b85f51e-kube-api-access-pz7fj\") pod \"cert-manager-operator-controller-manager-55c444bf86-fg8zp\" (UID: \"21472910-c902-493f-85a3-54f40b85f51e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fg8zp" Sep 15 21:31:07.993277 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:07.993151 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21472910-c902-493f-85a3-54f40b85f51e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fg8zp\" (UID: \"21472910-c902-493f-85a3-54f40b85f51e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fg8zp" Sep 15 21:31:07.993531 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:07.993510 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21472910-c902-493f-85a3-54f40b85f51e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fg8zp\" (UID: \"21472910-c902-493f-85a3-54f40b85f51e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fg8zp" Sep 15 21:31:08.001146 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:08.001119 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz7fj\" (UniqueName: \"kubernetes.io/projected/21472910-c902-493f-85a3-54f40b85f51e-kube-api-access-pz7fj\") pod \"cert-manager-operator-controller-manager-55c444bf86-fg8zp\" (UID: \"21472910-c902-493f-85a3-54f40b85f51e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fg8zp" Sep 15 21:31:08.154401 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:08.154305 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fg8zp" Sep 15 21:31:08.443540 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:08.443511 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fg8zp"] Sep 15 21:31:08.446120 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:31:08.446094 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21472910_c902_493f_85a3_54f40b85f51e.slice/crio-d47df44d93a6384b6be2704b7407df0b28318572e1e307c2bb734b15e0dd8dea WatchSource:0}: Error finding container d47df44d93a6384b6be2704b7407df0b28318572e1e307c2bb734b15e0dd8dea: Status 404 returned error can't find the container with id d47df44d93a6384b6be2704b7407df0b28318572e1e307c2bb734b15e0dd8dea Sep 15 21:31:09.360613 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:09.360573 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fg8zp" event={"ID":"21472910-c902-493f-85a3-54f40b85f51e","Type":"ContainerStarted","Data":"d47df44d93a6384b6be2704b7407df0b28318572e1e307c2bb734b15e0dd8dea"} Sep 15 21:31:09.429883 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:09.429810 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:09.711102 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:09.711014 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:11.372150 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:11.372105 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fg8zp" event={"ID":"21472910-c902-493f-85a3-54f40b85f51e","Type":"ContainerStarted","Data":"c34d2ce9f1c20dded81c9abfd30ae3bcefedfc86b51ac306db171302740f5bcf"} Sep 15 21:31:11.392214 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:11.392163 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fg8zp" podStartSLOduration=2.164521083 podStartE2EDuration="4.392148363s" totalImagesPullingTime="2.22762728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:31:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:31:11.390072738 +0000 UTC m=+325.976670329" watchObservedRunningTime="2026-09-15 21:31:11.392148363 +0000 UTC m=+325.978745956" Sep 15 21:31:11.759457 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:11.759394 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:11.867366 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:11.867329 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:12.495888 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:12.495842 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt"] Sep 15 21:31:12.498132 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:12.498116 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt" Sep 15 21:31:12.501018 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:12.500996 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 15 21:31:12.501130 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:12.500995 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 15 21:31:12.501795 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:12.501775 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kgh75\"" Sep 15 21:31:12.507648 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:12.507622 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt"] Sep 15 21:31:12.532137 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:12.532109 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/081a9f85-6a70-472d-8bbf-57d861b88a37-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt\" (UID: \"081a9f85-6a70-472d-8bbf-57d861b88a37\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt" Sep 15 21:31:12.532137 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:12.532136 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/081a9f85-6a70-472d-8bbf-57d861b88a37-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt\" (UID: \"081a9f85-6a70-472d-8bbf-57d861b88a37\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt" Sep 15 21:31:12.532299 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:12.532178 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jts4\" (UniqueName: \"kubernetes.io/projected/081a9f85-6a70-472d-8bbf-57d861b88a37-kube-api-access-8jts4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt\" (UID: \"081a9f85-6a70-472d-8bbf-57d861b88a37\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt" Sep 15 21:31:12.633414 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:12.633373 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/081a9f85-6a70-472d-8bbf-57d861b88a37-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt\" (UID: \"081a9f85-6a70-472d-8bbf-57d861b88a37\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt" Sep 15 21:31:12.633590 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:12.633418 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/081a9f85-6a70-472d-8bbf-57d861b88a37-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt\" (UID: \"081a9f85-6a70-472d-8bbf-57d861b88a37\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt" Sep 15 21:31:12.633590 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:12.633470 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jts4\" (UniqueName: \"kubernetes.io/projected/081a9f85-6a70-472d-8bbf-57d861b88a37-kube-api-access-8jts4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt\" (UID: \"081a9f85-6a70-472d-8bbf-57d861b88a37\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt" Sep 15 21:31:12.633895 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:12.633870 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/081a9f85-6a70-472d-8bbf-57d861b88a37-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt\" (UID: \"081a9f85-6a70-472d-8bbf-57d861b88a37\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt" Sep 15 21:31:12.633941 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:12.633876 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/081a9f85-6a70-472d-8bbf-57d861b88a37-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt\" (UID: \"081a9f85-6a70-472d-8bbf-57d861b88a37\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt" Sep 15 21:31:12.642397 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:12.642371 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jts4\" (UniqueName: \"kubernetes.io/projected/081a9f85-6a70-472d-8bbf-57d861b88a37-kube-api-access-8jts4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt\" (UID: \"081a9f85-6a70-472d-8bbf-57d861b88a37\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt" Sep 15 21:31:12.807692 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:12.807625 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt" Sep 15 21:31:13.077298 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:13.077261 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt"] Sep 15 21:31:13.078242 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:31:13.078200 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod081a9f85_6a70_472d_8bbf_57d861b88a37.slice/crio-60e5e3359002b21e70cbee2ec359709c1d86dc27566031520c16c45520be57bc WatchSource:0}: Error finding container 60e5e3359002b21e70cbee2ec359709c1d86dc27566031520c16c45520be57bc: Status 404 returned error can't find the container with id 60e5e3359002b21e70cbee2ec359709c1d86dc27566031520c16c45520be57bc Sep 15 21:31:13.384684 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:13.384603 2573 generic.go:356] "Generic (PLEG): container finished" podID="081a9f85-6a70-472d-8bbf-57d861b88a37" containerID="aa031b714f54eb62d2c26729e9f4520f18979a2c96eff99980fc8062409ed2ce" exitCode=0 Sep 15 21:31:13.384825 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:13.384688 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt" event={"ID":"081a9f85-6a70-472d-8bbf-57d861b88a37","Type":"ContainerDied","Data":"aa031b714f54eb62d2c26729e9f4520f18979a2c96eff99980fc8062409ed2ce"} Sep 15 21:31:13.384825 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:13.384774 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt" event={"ID":"081a9f85-6a70-472d-8bbf-57d861b88a37","Type":"ContainerStarted","Data":"60e5e3359002b21e70cbee2ec359709c1d86dc27566031520c16c45520be57bc"} Sep 15 21:31:13.729125 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:13.729085 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:13.908450 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:13.908357 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:16.460214 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:16.460176 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:16.515860 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:16.515820 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:18.408720 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:18.408688 2573 generic.go:356] "Generic (PLEG): container finished" podID="081a9f85-6a70-472d-8bbf-57d861b88a37" containerID="4b97bd6597364c0c2e6ff156e548ead6dc7391cbd66d303c7d21d67ba0ee13e4" exitCode=0 Sep 15 21:31:18.409116 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:18.408777 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt" event={"ID":"081a9f85-6a70-472d-8bbf-57d861b88a37","Type":"ContainerDied","Data":"4b97bd6597364c0c2e6ff156e548ead6dc7391cbd66d303c7d21d67ba0ee13e4"} Sep 15 21:31:18.935631 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:18.935583 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:18.989797 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:18.989760 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:19.415032 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:19.414999 2573 generic.go:356] "Generic (PLEG): container finished" podID="081a9f85-6a70-472d-8bbf-57d861b88a37" containerID="72934c8522dd7fc2fbbe7693c66d37aae4b9f765499bc64a4302f230d7ccb075" exitCode=0 Sep 15 21:31:19.415452 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:19.415088 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt" event={"ID":"081a9f85-6a70-472d-8bbf-57d861b88a37","Type":"ContainerDied","Data":"72934c8522dd7fc2fbbe7693c66d37aae4b9f765499bc64a4302f230d7ccb075"} Sep 15 21:31:19.742104 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:19.742063 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:19.844281 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:19.844245 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:20.541095 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:20.541072 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt" Sep 15 21:31:20.596814 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:20.596784 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/081a9f85-6a70-472d-8bbf-57d861b88a37-bundle\") pod \"081a9f85-6a70-472d-8bbf-57d861b88a37\" (UID: \"081a9f85-6a70-472d-8bbf-57d861b88a37\") " Sep 15 21:31:20.596996 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:20.596823 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/081a9f85-6a70-472d-8bbf-57d861b88a37-util\") pod \"081a9f85-6a70-472d-8bbf-57d861b88a37\" (UID: \"081a9f85-6a70-472d-8bbf-57d861b88a37\") " Sep 15 21:31:20.596996 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:20.596874 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jts4\" (UniqueName: \"kubernetes.io/projected/081a9f85-6a70-472d-8bbf-57d861b88a37-kube-api-access-8jts4\") pod \"081a9f85-6a70-472d-8bbf-57d861b88a37\" (UID: \"081a9f85-6a70-472d-8bbf-57d861b88a37\") " Sep 15 21:31:20.597181 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:20.597158 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/081a9f85-6a70-472d-8bbf-57d861b88a37-bundle" (OuterVolumeSpecName: "bundle") pod "081a9f85-6a70-472d-8bbf-57d861b88a37" (UID: "081a9f85-6a70-472d-8bbf-57d861b88a37"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:31:20.598888 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:20.598867 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/081a9f85-6a70-472d-8bbf-57d861b88a37-kube-api-access-8jts4" (OuterVolumeSpecName: "kube-api-access-8jts4") pod "081a9f85-6a70-472d-8bbf-57d861b88a37" (UID: "081a9f85-6a70-472d-8bbf-57d861b88a37"). InnerVolumeSpecName "kube-api-access-8jts4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:31:20.601222 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:20.601185 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/081a9f85-6a70-472d-8bbf-57d861b88a37-util" (OuterVolumeSpecName: "util") pod "081a9f85-6a70-472d-8bbf-57d861b88a37" (UID: "081a9f85-6a70-472d-8bbf-57d861b88a37"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:31:20.697431 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:20.697343 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/081a9f85-6a70-472d-8bbf-57d861b88a37-bundle\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:31:20.697431 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:20.697375 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/081a9f85-6a70-472d-8bbf-57d861b88a37-util\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:31:20.697431 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:20.697388 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jts4\" (UniqueName: \"kubernetes.io/projected/081a9f85-6a70-472d-8bbf-57d861b88a37-kube-api-access-8jts4\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:31:21.425367 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:21.425331 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt" event={"ID":"081a9f85-6a70-472d-8bbf-57d861b88a37","Type":"ContainerDied","Data":"60e5e3359002b21e70cbee2ec359709c1d86dc27566031520c16c45520be57bc"} Sep 15 21:31:21.425535 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:21.425370 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkvrt" Sep 15 21:31:21.425535 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:21.425381 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60e5e3359002b21e70cbee2ec359709c1d86dc27566031520c16c45520be57bc" Sep 15 21:31:22.130624 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:22.130596 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:23.639309 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:23.639274 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7qwfs"] Sep 15 21:31:23.639668 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:23.639565 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="081a9f85-6a70-472d-8bbf-57d861b88a37" containerName="util" Sep 15 21:31:23.639668 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:23.639576 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="081a9f85-6a70-472d-8bbf-57d861b88a37" containerName="util" Sep 15 21:31:23.639668 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:23.639587 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="081a9f85-6a70-472d-8bbf-57d861b88a37" containerName="pull" Sep 15 21:31:23.639668 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:23.639592 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="081a9f85-6a70-472d-8bbf-57d861b88a37" containerName="pull" Sep 15 21:31:23.639668 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:23.639606 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="081a9f85-6a70-472d-8bbf-57d861b88a37" containerName="extract" Sep 15 21:31:23.639668 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:23.639611 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="081a9f85-6a70-472d-8bbf-57d861b88a37" containerName="extract" Sep 15 21:31:23.639668 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:23.639655 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="081a9f85-6a70-472d-8bbf-57d861b88a37" containerName="extract" Sep 15 21:31:23.642540 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:23.642521 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-7qwfs" Sep 15 21:31:23.645082 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:23.645056 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 15 21:31:23.645192 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:23.645056 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 15 21:31:23.645978 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:23.645961 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-g2pck\"" Sep 15 21:31:23.651679 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:23.651659 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7qwfs"] Sep 15 21:31:23.720656 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:23.720618 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c856466-81f3-4067-addc-f47184ed91a7-bound-sa-token\") pod \"cert-manager-55b4d954d5-7qwfs\" (UID: \"8c856466-81f3-4067-addc-f47184ed91a7\") " pod="cert-manager/cert-manager-55b4d954d5-7qwfs" Sep 15 21:31:23.720812 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:23.720683 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx9dz\" (UniqueName: \"kubernetes.io/projected/8c856466-81f3-4067-addc-f47184ed91a7-kube-api-access-cx9dz\") pod \"cert-manager-55b4d954d5-7qwfs\" (UID: \"8c856466-81f3-4067-addc-f47184ed91a7\") " pod="cert-manager/cert-manager-55b4d954d5-7qwfs" Sep 15 21:31:23.822022 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:23.821989 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx9dz\" (UniqueName: \"kubernetes.io/projected/8c856466-81f3-4067-addc-f47184ed91a7-kube-api-access-cx9dz\") pod \"cert-manager-55b4d954d5-7qwfs\" (UID: \"8c856466-81f3-4067-addc-f47184ed91a7\") " pod="cert-manager/cert-manager-55b4d954d5-7qwfs" Sep 15 21:31:23.822178 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:23.822039 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c856466-81f3-4067-addc-f47184ed91a7-bound-sa-token\") pod \"cert-manager-55b4d954d5-7qwfs\" (UID: \"8c856466-81f3-4067-addc-f47184ed91a7\") " pod="cert-manager/cert-manager-55b4d954d5-7qwfs" Sep 15 21:31:23.830198 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:23.830176 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c856466-81f3-4067-addc-f47184ed91a7-bound-sa-token\") pod \"cert-manager-55b4d954d5-7qwfs\" (UID: \"8c856466-81f3-4067-addc-f47184ed91a7\") " pod="cert-manager/cert-manager-55b4d954d5-7qwfs" Sep 15 21:31:23.830322 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:23.830279 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx9dz\" (UniqueName: \"kubernetes.io/projected/8c856466-81f3-4067-addc-f47184ed91a7-kube-api-access-cx9dz\") pod \"cert-manager-55b4d954d5-7qwfs\" (UID: \"8c856466-81f3-4067-addc-f47184ed91a7\") " pod="cert-manager/cert-manager-55b4d954d5-7qwfs" Sep 15 21:31:23.952587 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:23.952512 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-7qwfs" Sep 15 21:31:24.220616 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:24.220587 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7qwfs"] Sep 15 21:31:24.223059 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:31:24.223035 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c856466_81f3_4067_addc_f47184ed91a7.slice/crio-b67e13d5f818d43d3db28a3055501b250812f47a64b4e2f322b2d2d878b48ec3 WatchSource:0}: Error finding container b67e13d5f818d43d3db28a3055501b250812f47a64b4e2f322b2d2d878b48ec3: Status 404 returned error can't find the container with id b67e13d5f818d43d3db28a3055501b250812f47a64b4e2f322b2d2d878b48ec3 Sep 15 21:31:24.438616 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:24.438580 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-7qwfs" event={"ID":"8c856466-81f3-4067-addc-f47184ed91a7","Type":"ContainerStarted","Data":"b67e13d5f818d43d3db28a3055501b250812f47a64b4e2f322b2d2d878b48ec3"} Sep 15 21:31:25.174529 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:25.174491 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:25.272719 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:25.272657 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:27.453689 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:27.453654 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-7qwfs" event={"ID":"8c856466-81f3-4067-addc-f47184ed91a7","Type":"ContainerStarted","Data":"0a4b108f3b21ca5229350c04fb126e7ada9cb98464ad193b3389cfc6fdae4bae"} Sep 15 21:31:27.469017 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:27.468961 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-7qwfs" podStartSLOduration=1.855585194 podStartE2EDuration="4.468946184s" totalImagesPullingTime="2.61336099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:31:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:31:27.468083493 +0000 UTC m=+342.054681085" watchObservedRunningTime="2026-09-15 21:31:27.468946184 +0000 UTC m=+342.055543775" Sep 15 21:31:31.126828 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:31.126792 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:31.229259 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:31.229222 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:32.680180 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:32.680139 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr"] Sep 15 21:31:32.683615 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:32.683598 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr" Sep 15 21:31:32.686191 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:32.686173 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kgh75\"" Sep 15 21:31:32.686381 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:32.686360 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 15 21:31:32.686982 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:32.686965 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 15 21:31:32.691630 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:32.691600 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr"] Sep 15 21:31:32.798472 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:32.798436 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e1ae42e-864a-4031-83f8-b4e158c2fa1c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr\" (UID: \"2e1ae42e-864a-4031-83f8-b4e158c2fa1c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr" Sep 15 21:31:32.798650 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:32.798507 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c7pj\" (UniqueName: \"kubernetes.io/projected/2e1ae42e-864a-4031-83f8-b4e158c2fa1c-kube-api-access-7c7pj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr\" (UID: \"2e1ae42e-864a-4031-83f8-b4e158c2fa1c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr" Sep 15 21:31:32.798650 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:32.798549 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e1ae42e-864a-4031-83f8-b4e158c2fa1c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr\" (UID: \"2e1ae42e-864a-4031-83f8-b4e158c2fa1c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr" Sep 15 21:31:32.899186 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:32.899140 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c7pj\" (UniqueName: \"kubernetes.io/projected/2e1ae42e-864a-4031-83f8-b4e158c2fa1c-kube-api-access-7c7pj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr\" (UID: \"2e1ae42e-864a-4031-83f8-b4e158c2fa1c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr" Sep 15 21:31:32.899186 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:32.899185 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e1ae42e-864a-4031-83f8-b4e158c2fa1c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr\" (UID: \"2e1ae42e-864a-4031-83f8-b4e158c2fa1c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr" Sep 15 21:31:32.899382 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:32.899222 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e1ae42e-864a-4031-83f8-b4e158c2fa1c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr\" (UID: \"2e1ae42e-864a-4031-83f8-b4e158c2fa1c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr" Sep 15 21:31:32.899598 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:32.899583 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e1ae42e-864a-4031-83f8-b4e158c2fa1c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr\" (UID: \"2e1ae42e-864a-4031-83f8-b4e158c2fa1c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr" Sep 15 21:31:32.899637 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:32.899616 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e1ae42e-864a-4031-83f8-b4e158c2fa1c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr\" (UID: \"2e1ae42e-864a-4031-83f8-b4e158c2fa1c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr" Sep 15 21:31:32.906900 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:32.906870 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c7pj\" (UniqueName: \"kubernetes.io/projected/2e1ae42e-864a-4031-83f8-b4e158c2fa1c-kube-api-access-7c7pj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr\" (UID: \"2e1ae42e-864a-4031-83f8-b4e158c2fa1c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr" Sep 15 21:31:32.993907 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:32.993879 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr" Sep 15 21:31:33.231387 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:33.231354 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:33.262819 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:33.262789 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr"] Sep 15 21:31:33.264767 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:31:33.264741 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e1ae42e_864a_4031_83f8_b4e158c2fa1c.slice/crio-94515bc5157443452ada978f279aa6ab55c45bd85900690396799a81448458ce WatchSource:0}: Error finding container 94515bc5157443452ada978f279aa6ab55c45bd85900690396799a81448458ce: Status 404 returned error can't find the container with id 94515bc5157443452ada978f279aa6ab55c45bd85900690396799a81448458ce Sep 15 21:31:33.480524 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:33.480488 2573 generic.go:356] "Generic (PLEG): container finished" podID="2e1ae42e-864a-4031-83f8-b4e158c2fa1c" containerID="5c4748e9e8e870c5a738ab3010d6b8249c538ef38df077dcb06f2eb6f28a5c05" exitCode=0 Sep 15 21:31:33.480698 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:33.480573 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr" event={"ID":"2e1ae42e-864a-4031-83f8-b4e158c2fa1c","Type":"ContainerDied","Data":"5c4748e9e8e870c5a738ab3010d6b8249c538ef38df077dcb06f2eb6f28a5c05"} Sep 15 21:31:33.480698 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:33.480626 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr" event={"ID":"2e1ae42e-864a-4031-83f8-b4e158c2fa1c","Type":"ContainerStarted","Data":"94515bc5157443452ada978f279aa6ab55c45bd85900690396799a81448458ce"} Sep 15 21:31:34.486324 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:34.486295 2573 generic.go:356] "Generic (PLEG): container finished" podID="2e1ae42e-864a-4031-83f8-b4e158c2fa1c" containerID="f029e9972f8c777f30417592dfa0197cd5f047e65ef7199fcb6f6539d490ac19" exitCode=0 Sep 15 21:31:34.486758 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:34.486386 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr" event={"ID":"2e1ae42e-864a-4031-83f8-b4e158c2fa1c","Type":"ContainerDied","Data":"f029e9972f8c777f30417592dfa0197cd5f047e65ef7199fcb6f6539d490ac19"} Sep 15 21:31:35.493059 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:35.493024 2573 generic.go:356] "Generic (PLEG): container finished" podID="2e1ae42e-864a-4031-83f8-b4e158c2fa1c" containerID="909d19d04fea25f8825709db0216fd582bc357bc4e67d7e3abc2396572e9279d" exitCode=0 Sep 15 21:31:35.493059 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:35.493063 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr" event={"ID":"2e1ae42e-864a-4031-83f8-b4e158c2fa1c","Type":"ContainerDied","Data":"909d19d04fea25f8825709db0216fd582bc357bc4e67d7e3abc2396572e9279d"} Sep 15 21:31:36.627995 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:36.627966 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr" Sep 15 21:31:36.731317 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:36.731281 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e1ae42e-864a-4031-83f8-b4e158c2fa1c-util\") pod \"2e1ae42e-864a-4031-83f8-b4e158c2fa1c\" (UID: \"2e1ae42e-864a-4031-83f8-b4e158c2fa1c\") " Sep 15 21:31:36.731317 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:36.731322 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e1ae42e-864a-4031-83f8-b4e158c2fa1c-bundle\") pod \"2e1ae42e-864a-4031-83f8-b4e158c2fa1c\" (UID: \"2e1ae42e-864a-4031-83f8-b4e158c2fa1c\") " Sep 15 21:31:36.731547 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:36.731341 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7c7pj\" (UniqueName: \"kubernetes.io/projected/2e1ae42e-864a-4031-83f8-b4e158c2fa1c-kube-api-access-7c7pj\") pod \"2e1ae42e-864a-4031-83f8-b4e158c2fa1c\" (UID: \"2e1ae42e-864a-4031-83f8-b4e158c2fa1c\") " Sep 15 21:31:36.732251 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:36.732220 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e1ae42e-864a-4031-83f8-b4e158c2fa1c-bundle" (OuterVolumeSpecName: "bundle") pod "2e1ae42e-864a-4031-83f8-b4e158c2fa1c" (UID: "2e1ae42e-864a-4031-83f8-b4e158c2fa1c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:31:36.733448 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:36.733417 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e1ae42e-864a-4031-83f8-b4e158c2fa1c-kube-api-access-7c7pj" (OuterVolumeSpecName: "kube-api-access-7c7pj") pod "2e1ae42e-864a-4031-83f8-b4e158c2fa1c" (UID: "2e1ae42e-864a-4031-83f8-b4e158c2fa1c"). InnerVolumeSpecName "kube-api-access-7c7pj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:31:36.736990 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:36.736966 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e1ae42e-864a-4031-83f8-b4e158c2fa1c-util" (OuterVolumeSpecName: "util") pod "2e1ae42e-864a-4031-83f8-b4e158c2fa1c" (UID: "2e1ae42e-864a-4031-83f8-b4e158c2fa1c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:31:36.832650 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:36.832558 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e1ae42e-864a-4031-83f8-b4e158c2fa1c-util\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:31:36.832650 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:36.832588 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e1ae42e-864a-4031-83f8-b4e158c2fa1c-bundle\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:31:36.832650 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:36.832597 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7c7pj\" (UniqueName: \"kubernetes.io/projected/2e1ae42e-864a-4031-83f8-b4e158c2fa1c-kube-api-access-7c7pj\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:31:37.502909 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:37.502878 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr" Sep 15 21:31:37.503051 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:37.502885 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxm5dr" event={"ID":"2e1ae42e-864a-4031-83f8-b4e158c2fa1c","Type":"ContainerDied","Data":"94515bc5157443452ada978f279aa6ab55c45bd85900690396799a81448458ce"} Sep 15 21:31:37.503051 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:37.502994 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94515bc5157443452ada978f279aa6ab55c45bd85900690396799a81448458ce" Sep 15 21:31:43.903558 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:43.903476 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h"] Sep 15 21:31:43.904019 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:43.903842 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e1ae42e-864a-4031-83f8-b4e158c2fa1c" containerName="pull" Sep 15 21:31:43.904019 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:43.903870 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e1ae42e-864a-4031-83f8-b4e158c2fa1c" containerName="pull" Sep 15 21:31:43.904019 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:43.903892 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e1ae42e-864a-4031-83f8-b4e158c2fa1c" containerName="extract" Sep 15 21:31:43.904019 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:43.903898 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e1ae42e-864a-4031-83f8-b4e158c2fa1c" containerName="extract" Sep 15 21:31:43.904019 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:43.903905 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e1ae42e-864a-4031-83f8-b4e158c2fa1c" containerName="util" Sep 15 21:31:43.904019 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:43.903910 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e1ae42e-864a-4031-83f8-b4e158c2fa1c" containerName="util" Sep 15 21:31:43.904019 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:43.903965 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e1ae42e-864a-4031-83f8-b4e158c2fa1c" containerName="extract" Sep 15 21:31:43.906900 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:43.906884 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h" Sep 15 21:31:43.909381 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:43.909363 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 15 21:31:43.910321 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:43.910301 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 15 21:31:43.910392 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:43.910301 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kgh75\"" Sep 15 21:31:43.916514 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:43.916482 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h"] Sep 15 21:31:43.991606 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:43.991550 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/356e8e36-6823-4337-9bf4-50dc93f4a2da-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h\" (UID: \"356e8e36-6823-4337-9bf4-50dc93f4a2da\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h" Sep 15 21:31:43.991786 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:43.991658 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/356e8e36-6823-4337-9bf4-50dc93f4a2da-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h\" (UID: \"356e8e36-6823-4337-9bf4-50dc93f4a2da\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h" Sep 15 21:31:43.991786 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:43.991702 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6v5g\" (UniqueName: \"kubernetes.io/projected/356e8e36-6823-4337-9bf4-50dc93f4a2da-kube-api-access-f6v5g\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h\" (UID: \"356e8e36-6823-4337-9bf4-50dc93f4a2da\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h" Sep 15 21:31:44.092670 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:44.092633 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/356e8e36-6823-4337-9bf4-50dc93f4a2da-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h\" (UID: \"356e8e36-6823-4337-9bf4-50dc93f4a2da\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h" Sep 15 21:31:44.092891 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:44.092682 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/356e8e36-6823-4337-9bf4-50dc93f4a2da-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h\" (UID: \"356e8e36-6823-4337-9bf4-50dc93f4a2da\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h" Sep 15 21:31:44.092891 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:44.092704 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6v5g\" (UniqueName: \"kubernetes.io/projected/356e8e36-6823-4337-9bf4-50dc93f4a2da-kube-api-access-f6v5g\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h\" (UID: \"356e8e36-6823-4337-9bf4-50dc93f4a2da\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h" Sep 15 21:31:44.093157 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:44.093131 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/356e8e36-6823-4337-9bf4-50dc93f4a2da-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h\" (UID: \"356e8e36-6823-4337-9bf4-50dc93f4a2da\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h" Sep 15 21:31:44.093228 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:44.093143 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/356e8e36-6823-4337-9bf4-50dc93f4a2da-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h\" (UID: \"356e8e36-6823-4337-9bf4-50dc93f4a2da\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h" Sep 15 21:31:44.104655 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:44.104633 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6v5g\" (UniqueName: \"kubernetes.io/projected/356e8e36-6823-4337-9bf4-50dc93f4a2da-kube-api-access-f6v5g\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h\" (UID: \"356e8e36-6823-4337-9bf4-50dc93f4a2da\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h" Sep 15 21:31:44.216280 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:44.216249 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h" Sep 15 21:31:44.491863 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:44.491785 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h"] Sep 15 21:31:44.493992 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:31:44.493967 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod356e8e36_6823_4337_9bf4_50dc93f4a2da.slice/crio-fc09c6c6f9432475ce47674d7a4734cd31180dfea5831cc8bfc5d8eefc02ed8c WatchSource:0}: Error finding container fc09c6c6f9432475ce47674d7a4734cd31180dfea5831cc8bfc5d8eefc02ed8c: Status 404 returned error can't find the container with id fc09c6c6f9432475ce47674d7a4734cd31180dfea5831cc8bfc5d8eefc02ed8c Sep 15 21:31:44.532743 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:44.532711 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h" event={"ID":"356e8e36-6823-4337-9bf4-50dc93f4a2da","Type":"ContainerStarted","Data":"fc09c6c6f9432475ce47674d7a4734cd31180dfea5831cc8bfc5d8eefc02ed8c"} Sep 15 21:31:44.673267 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:44.673231 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:44.774184 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:44.774094 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:45.024671 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.024592 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:45.369284 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.369203 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:45.462943 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.462909 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:45.498784 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.498745 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx"] Sep 15 21:31:45.502090 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.502071 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx" Sep 15 21:31:45.504632 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.504608 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 15 21:31:45.504754 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.504687 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 15 21:31:45.505002 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.504822 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 15 21:31:45.505002 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.504948 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 15 21:31:45.505107 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.505076 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5f75r\"" Sep 15 21:31:45.519471 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.519443 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx"] Sep 15 21:31:45.538310 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.538278 2573 generic.go:356] "Generic (PLEG): container finished" podID="356e8e36-6823-4337-9bf4-50dc93f4a2da" containerID="f365413659641ebea1824aeee011c8e4d47e10caf3292e0d2279eb89a471725d" exitCode=0 Sep 15 21:31:45.538437 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.538310 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h" event={"ID":"356e8e36-6823-4337-9bf4-50dc93f4a2da","Type":"ContainerDied","Data":"f365413659641ebea1824aeee011c8e4d47e10caf3292e0d2279eb89a471725d"} Sep 15 21:31:45.605708 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.605677 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4-tmp\") pod \"opendatahub-operator-controller-manager-77fddcc9c6-898vx\" (UID: \"1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx" Sep 15 21:31:45.605875 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.605729 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd5kb\" (UniqueName: \"kubernetes.io/projected/1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4-kube-api-access-kd5kb\") pod \"opendatahub-operator-controller-manager-77fddcc9c6-898vx\" (UID: \"1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx" Sep 15 21:31:45.605875 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.605785 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4-webhook-cert\") pod \"opendatahub-operator-controller-manager-77fddcc9c6-898vx\" (UID: \"1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx" Sep 15 21:31:45.605875 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.605826 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4-manifests\") pod \"opendatahub-operator-controller-manager-77fddcc9c6-898vx\" (UID: \"1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx" Sep 15 21:31:45.606002 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.605875 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77fddcc9c6-898vx\" (UID: \"1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx" Sep 15 21:31:45.623363 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.623277 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:45.706711 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.706672 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4-tmp\") pod \"opendatahub-operator-controller-manager-77fddcc9c6-898vx\" (UID: \"1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx" Sep 15 21:31:45.706930 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.706737 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd5kb\" (UniqueName: \"kubernetes.io/projected/1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4-kube-api-access-kd5kb\") pod \"opendatahub-operator-controller-manager-77fddcc9c6-898vx\" (UID: \"1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx" Sep 15 21:31:45.706930 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.706875 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4-webhook-cert\") pod \"opendatahub-operator-controller-manager-77fddcc9c6-898vx\" (UID: \"1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx" Sep 15 21:31:45.707058 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.706931 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4-manifests\") pod \"opendatahub-operator-controller-manager-77fddcc9c6-898vx\" (UID: \"1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx" Sep 15 21:31:45.707058 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.706967 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77fddcc9c6-898vx\" (UID: \"1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx" Sep 15 21:31:45.707430 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.707390 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4-manifests\") pod \"opendatahub-operator-controller-manager-77fddcc9c6-898vx\" (UID: \"1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx" Sep 15 21:31:45.709103 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.709068 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4-tmp\") pod \"opendatahub-operator-controller-manager-77fddcc9c6-898vx\" (UID: \"1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx" Sep 15 21:31:45.709211 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.709170 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77fddcc9c6-898vx\" (UID: \"1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx" Sep 15 21:31:45.709329 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.709312 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4-webhook-cert\") pod \"opendatahub-operator-controller-manager-77fddcc9c6-898vx\" (UID: \"1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx" Sep 15 21:31:45.724803 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.724772 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd5kb\" (UniqueName: \"kubernetes.io/projected/1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4-kube-api-access-kd5kb\") pod \"opendatahub-operator-controller-manager-77fddcc9c6-898vx\" (UID: \"1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4\") " pod="opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx" Sep 15 21:31:45.736585 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.736558 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:45.814526 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.814495 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5f75r\"" Sep 15 21:31:45.821193 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.821164 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:45.822916 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.822900 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx" Sep 15 21:31:45.920553 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:45.920521 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:46.020706 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:46.020667 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:46.099752 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:46.099728 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx"] Sep 15 21:31:46.102543 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:31:46.102518 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1402330d_59f1_4b2e_a7e3_ca7d6f6ec6e4.slice/crio-18e7de6f2b52d90efafae1a7de58924115038bc0af84d6acb9075036548ac9c4 WatchSource:0}: Error finding container 18e7de6f2b52d90efafae1a7de58924115038bc0af84d6acb9075036548ac9c4: Status 404 returned error can't find the container with id 18e7de6f2b52d90efafae1a7de58924115038bc0af84d6acb9075036548ac9c4 Sep 15 21:31:46.544595 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:46.544558 2573 generic.go:356] "Generic (PLEG): container finished" podID="356e8e36-6823-4337-9bf4-50dc93f4a2da" containerID="b851e2601052eb45c0cd0fa970a3d93b76f1a2bf8bfff50ac87f88cb9e5b0b7e" exitCode=0 Sep 15 21:31:46.544761 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:46.544649 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h" event={"ID":"356e8e36-6823-4337-9bf4-50dc93f4a2da","Type":"ContainerDied","Data":"b851e2601052eb45c0cd0fa970a3d93b76f1a2bf8bfff50ac87f88cb9e5b0b7e"} Sep 15 21:31:46.546065 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:46.546043 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx" event={"ID":"1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4","Type":"ContainerStarted","Data":"18e7de6f2b52d90efafae1a7de58924115038bc0af84d6acb9075036548ac9c4"} Sep 15 21:31:47.555321 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:47.555283 2573 generic.go:356] "Generic (PLEG): container finished" podID="356e8e36-6823-4337-9bf4-50dc93f4a2da" containerID="93fedd00aa27c42511aafac1c70e31ccc57fc5d2f6550038bb293aca620e3221" exitCode=0 Sep 15 21:31:47.555815 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:47.555382 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h" event={"ID":"356e8e36-6823-4337-9bf4-50dc93f4a2da","Type":"ContainerDied","Data":"93fedd00aa27c42511aafac1c70e31ccc57fc5d2f6550038bb293aca620e3221"} Sep 15 21:31:49.188781 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:49.188750 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h" Sep 15 21:31:49.339423 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:49.339384 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/356e8e36-6823-4337-9bf4-50dc93f4a2da-bundle\") pod \"356e8e36-6823-4337-9bf4-50dc93f4a2da\" (UID: \"356e8e36-6823-4337-9bf4-50dc93f4a2da\") " Sep 15 21:31:49.339609 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:49.339453 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6v5g\" (UniqueName: \"kubernetes.io/projected/356e8e36-6823-4337-9bf4-50dc93f4a2da-kube-api-access-f6v5g\") pod \"356e8e36-6823-4337-9bf4-50dc93f4a2da\" (UID: \"356e8e36-6823-4337-9bf4-50dc93f4a2da\") " Sep 15 21:31:49.339609 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:49.339505 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/356e8e36-6823-4337-9bf4-50dc93f4a2da-util\") pod \"356e8e36-6823-4337-9bf4-50dc93f4a2da\" (UID: \"356e8e36-6823-4337-9bf4-50dc93f4a2da\") " Sep 15 21:31:49.340187 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:49.340153 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/356e8e36-6823-4337-9bf4-50dc93f4a2da-bundle" (OuterVolumeSpecName: "bundle") pod "356e8e36-6823-4337-9bf4-50dc93f4a2da" (UID: "356e8e36-6823-4337-9bf4-50dc93f4a2da"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:31:49.341460 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:49.341436 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/356e8e36-6823-4337-9bf4-50dc93f4a2da-kube-api-access-f6v5g" (OuterVolumeSpecName: "kube-api-access-f6v5g") pod "356e8e36-6823-4337-9bf4-50dc93f4a2da" (UID: "356e8e36-6823-4337-9bf4-50dc93f4a2da"). InnerVolumeSpecName "kube-api-access-f6v5g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:31:49.346523 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:49.346498 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/356e8e36-6823-4337-9bf4-50dc93f4a2da-util" (OuterVolumeSpecName: "util") pod "356e8e36-6823-4337-9bf4-50dc93f4a2da" (UID: "356e8e36-6823-4337-9bf4-50dc93f4a2da"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:31:49.440793 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:49.440707 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/356e8e36-6823-4337-9bf4-50dc93f4a2da-bundle\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:31:49.440793 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:49.440738 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6v5g\" (UniqueName: \"kubernetes.io/projected/356e8e36-6823-4337-9bf4-50dc93f4a2da-kube-api-access-f6v5g\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:31:49.440793 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:49.440751 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/356e8e36-6823-4337-9bf4-50dc93f4a2da-util\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:31:49.566911 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:49.566867 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx" event={"ID":"1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4","Type":"ContainerStarted","Data":"1f2a0bc08bc231e767d80ac04cde0228f7d6c7dbb53f403d6825825c4f7885d2"} Sep 15 21:31:49.568861 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:49.568814 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h" Sep 15 21:31:49.568999 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:49.568813 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02hb7h" event={"ID":"356e8e36-6823-4337-9bf4-50dc93f4a2da","Type":"ContainerDied","Data":"fc09c6c6f9432475ce47674d7a4734cd31180dfea5831cc8bfc5d8eefc02ed8c"} Sep 15 21:31:49.568999 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:49.568951 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc09c6c6f9432475ce47674d7a4734cd31180dfea5831cc8bfc5d8eefc02ed8c" Sep 15 21:31:50.575347 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:50.575310 2573 generic.go:356] "Generic (PLEG): container finished" podID="1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4" containerID="1f2a0bc08bc231e767d80ac04cde0228f7d6c7dbb53f403d6825825c4f7885d2" exitCode=0 Sep 15 21:31:50.575731 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:50.575372 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx" event={"ID":"1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4","Type":"ContainerDied","Data":"1f2a0bc08bc231e767d80ac04cde0228f7d6c7dbb53f403d6825825c4f7885d2"} Sep 15 21:31:51.583226 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:51.583164 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx" event={"ID":"1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4","Type":"ContainerStarted","Data":"cd81b7079a9311fc3830ac840d15cd89f1e8e09f60a8604e9c0112b2334d2e43"} Sep 15 21:31:51.583697 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:51.583327 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx" Sep 15 21:31:51.606129 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:51.606083 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx" podStartSLOduration=2.121762644 podStartE2EDuration="6.606067376s" totalImagesPullingTime="3.400409586s" totalInitContainerRuntime="1.083895146s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:31:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:31:51.604326004 +0000 UTC m=+366.190923618" watchObservedRunningTime="2026-09-15 21:31:51.606067376 +0000 UTC m=+366.192664968" Sep 15 21:31:55.444503 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:55.444468 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:31:55.552924 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:31:55.552890 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:02.590561 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:02.590526 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-77fddcc9c6-898vx" Sep 15 21:32:05.897510 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:05.897474 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:06.009210 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.009162 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:06.242681 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.242651 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d697dcf85-s4rp5"] Sep 15 21:32:06.243041 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.243021 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="356e8e36-6823-4337-9bf4-50dc93f4a2da" containerName="util" Sep 15 21:32:06.243041 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.243041 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="356e8e36-6823-4337-9bf4-50dc93f4a2da" containerName="util" Sep 15 21:32:06.243195 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.243053 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="356e8e36-6823-4337-9bf4-50dc93f4a2da" containerName="pull" Sep 15 21:32:06.243195 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.243059 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="356e8e36-6823-4337-9bf4-50dc93f4a2da" containerName="pull" Sep 15 21:32:06.243195 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.243075 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="356e8e36-6823-4337-9bf4-50dc93f4a2da" containerName="extract" Sep 15 21:32:06.243195 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.243080 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="356e8e36-6823-4337-9bf4-50dc93f4a2da" containerName="extract" Sep 15 21:32:06.243195 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.243135 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="356e8e36-6823-4337-9bf4-50dc93f4a2da" containerName="extract" Sep 15 21:32:06.250188 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.250164 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5d697dcf85-s4rp5" Sep 15 21:32:06.254012 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.253982 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 15 21:32:06.254012 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.254003 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-brf94\"" Sep 15 21:32:06.254197 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.254016 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 15 21:32:06.254197 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.254057 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 15 21:32:06.254197 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.254009 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 15 21:32:06.258014 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.257991 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 15 21:32:06.260649 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.260628 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d697dcf85-s4rp5"] Sep 15 21:32:06.279299 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.279268 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/457976fb-99da-4be7-b19c-24eea9444974-manager-config\") pod \"lws-controller-manager-5d697dcf85-s4rp5\" (UID: \"457976fb-99da-4be7-b19c-24eea9444974\") " pod="openshift-lws-operator/lws-controller-manager-5d697dcf85-s4rp5" Sep 15 21:32:06.279447 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.279321 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/457976fb-99da-4be7-b19c-24eea9444974-metrics-cert\") pod \"lws-controller-manager-5d697dcf85-s4rp5\" (UID: \"457976fb-99da-4be7-b19c-24eea9444974\") " pod="openshift-lws-operator/lws-controller-manager-5d697dcf85-s4rp5" Sep 15 21:32:06.279447 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.279414 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf94r\" (UniqueName: \"kubernetes.io/projected/457976fb-99da-4be7-b19c-24eea9444974-kube-api-access-hf94r\") pod \"lws-controller-manager-5d697dcf85-s4rp5\" (UID: \"457976fb-99da-4be7-b19c-24eea9444974\") " pod="openshift-lws-operator/lws-controller-manager-5d697dcf85-s4rp5" Sep 15 21:32:06.279540 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.279451 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/457976fb-99da-4be7-b19c-24eea9444974-cert\") pod \"lws-controller-manager-5d697dcf85-s4rp5\" (UID: \"457976fb-99da-4be7-b19c-24eea9444974\") " pod="openshift-lws-operator/lws-controller-manager-5d697dcf85-s4rp5" Sep 15 21:32:06.380073 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.380041 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf94r\" (UniqueName: \"kubernetes.io/projected/457976fb-99da-4be7-b19c-24eea9444974-kube-api-access-hf94r\") pod \"lws-controller-manager-5d697dcf85-s4rp5\" (UID: \"457976fb-99da-4be7-b19c-24eea9444974\") " pod="openshift-lws-operator/lws-controller-manager-5d697dcf85-s4rp5" Sep 15 21:32:06.380073 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.380079 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/457976fb-99da-4be7-b19c-24eea9444974-cert\") pod \"lws-controller-manager-5d697dcf85-s4rp5\" (UID: \"457976fb-99da-4be7-b19c-24eea9444974\") " pod="openshift-lws-operator/lws-controller-manager-5d697dcf85-s4rp5" Sep 15 21:32:06.380320 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.380121 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/457976fb-99da-4be7-b19c-24eea9444974-manager-config\") pod \"lws-controller-manager-5d697dcf85-s4rp5\" (UID: \"457976fb-99da-4be7-b19c-24eea9444974\") " pod="openshift-lws-operator/lws-controller-manager-5d697dcf85-s4rp5" Sep 15 21:32:06.380320 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.380142 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/457976fb-99da-4be7-b19c-24eea9444974-metrics-cert\") pod \"lws-controller-manager-5d697dcf85-s4rp5\" (UID: \"457976fb-99da-4be7-b19c-24eea9444974\") " pod="openshift-lws-operator/lws-controller-manager-5d697dcf85-s4rp5" Sep 15 21:32:06.381020 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.380991 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/457976fb-99da-4be7-b19c-24eea9444974-manager-config\") pod \"lws-controller-manager-5d697dcf85-s4rp5\" (UID: \"457976fb-99da-4be7-b19c-24eea9444974\") " pod="openshift-lws-operator/lws-controller-manager-5d697dcf85-s4rp5" Sep 15 21:32:06.382688 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.382665 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/457976fb-99da-4be7-b19c-24eea9444974-cert\") pod \"lws-controller-manager-5d697dcf85-s4rp5\" (UID: \"457976fb-99da-4be7-b19c-24eea9444974\") " pod="openshift-lws-operator/lws-controller-manager-5d697dcf85-s4rp5" Sep 15 21:32:06.382802 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.382713 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/457976fb-99da-4be7-b19c-24eea9444974-metrics-cert\") pod \"lws-controller-manager-5d697dcf85-s4rp5\" (UID: \"457976fb-99da-4be7-b19c-24eea9444974\") " pod="openshift-lws-operator/lws-controller-manager-5d697dcf85-s4rp5" Sep 15 21:32:06.393832 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.393806 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf94r\" (UniqueName: \"kubernetes.io/projected/457976fb-99da-4be7-b19c-24eea9444974-kube-api-access-hf94r\") pod \"lws-controller-manager-5d697dcf85-s4rp5\" (UID: \"457976fb-99da-4be7-b19c-24eea9444974\") " pod="openshift-lws-operator/lws-controller-manager-5d697dcf85-s4rp5" Sep 15 21:32:06.562344 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.562261 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5d697dcf85-s4rp5" Sep 15 21:32:06.833554 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:06.833526 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d697dcf85-s4rp5"] Sep 15 21:32:06.835788 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:32:06.835743 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod457976fb_99da_4be7_b19c_24eea9444974.slice/crio-353f2bfe72a21934de310604dd635a8307207feb69fc0462f837a6ae110f3573 WatchSource:0}: Error finding container 353f2bfe72a21934de310604dd635a8307207feb69fc0462f837a6ae110f3573: Status 404 returned error can't find the container with id 353f2bfe72a21934de310604dd635a8307207feb69fc0462f837a6ae110f3573 Sep 15 21:32:07.660399 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:07.660362 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5d697dcf85-s4rp5" event={"ID":"457976fb-99da-4be7-b19c-24eea9444974","Type":"ContainerStarted","Data":"353f2bfe72a21934de310604dd635a8307207feb69fc0462f837a6ae110f3573"} Sep 15 21:32:08.666690 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:08.666658 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5d697dcf85-s4rp5" event={"ID":"457976fb-99da-4be7-b19c-24eea9444974","Type":"ContainerStarted","Data":"9b29c50e1a17a9c18962d461b0290143746e47951b87f9a8ef00731c6273dc88"} Sep 15 21:32:08.667088 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:08.666779 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5d697dcf85-s4rp5" Sep 15 21:32:08.682431 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:08.682385 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5d697dcf85-s4rp5" podStartSLOduration=0.940592 podStartE2EDuration="2.68236958s" totalImagesPullingTime="1.74177758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:32:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:32:08.681763179 +0000 UTC m=+383.268360772" watchObservedRunningTime="2026-09-15 21:32:08.68236958 +0000 UTC m=+383.268967172" Sep 15 21:32:09.716498 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.716457 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-745648c7f7-pbrhs"] Sep 15 21:32:09.719906 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.719885 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:09.731814 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.731787 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-745648c7f7-pbrhs"] Sep 15 21:32:09.772266 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.772238 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:09.809669 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.809641 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df81a705-f14b-4d90-8219-20ec079dc744-console-oauth-config\") pod \"console-745648c7f7-pbrhs\" (UID: \"df81a705-f14b-4d90-8219-20ec079dc744\") " pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:09.809809 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.809670 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df81a705-f14b-4d90-8219-20ec079dc744-oauth-serving-cert\") pod \"console-745648c7f7-pbrhs\" (UID: \"df81a705-f14b-4d90-8219-20ec079dc744\") " pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:09.809809 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.809695 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf67h\" (UniqueName: \"kubernetes.io/projected/df81a705-f14b-4d90-8219-20ec079dc744-kube-api-access-rf67h\") pod \"console-745648c7f7-pbrhs\" (UID: \"df81a705-f14b-4d90-8219-20ec079dc744\") " pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:09.809809 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.809793 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df81a705-f14b-4d90-8219-20ec079dc744-console-serving-cert\") pod \"console-745648c7f7-pbrhs\" (UID: \"df81a705-f14b-4d90-8219-20ec079dc744\") " pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:09.809959 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.809831 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df81a705-f14b-4d90-8219-20ec079dc744-console-config\") pod \"console-745648c7f7-pbrhs\" (UID: \"df81a705-f14b-4d90-8219-20ec079dc744\") " pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:09.809959 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.809884 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df81a705-f14b-4d90-8219-20ec079dc744-service-ca\") pod \"console-745648c7f7-pbrhs\" (UID: \"df81a705-f14b-4d90-8219-20ec079dc744\") " pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:09.809959 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.809905 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df81a705-f14b-4d90-8219-20ec079dc744-trusted-ca-bundle\") pod \"console-745648c7f7-pbrhs\" (UID: \"df81a705-f14b-4d90-8219-20ec079dc744\") " pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:09.825416 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.825390 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:09.915991 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.915951 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df81a705-f14b-4d90-8219-20ec079dc744-console-serving-cert\") pod \"console-745648c7f7-pbrhs\" (UID: \"df81a705-f14b-4d90-8219-20ec079dc744\") " pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:09.916181 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.916006 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df81a705-f14b-4d90-8219-20ec079dc744-console-config\") pod \"console-745648c7f7-pbrhs\" (UID: \"df81a705-f14b-4d90-8219-20ec079dc744\") " pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:09.916181 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.916032 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df81a705-f14b-4d90-8219-20ec079dc744-service-ca\") pod \"console-745648c7f7-pbrhs\" (UID: \"df81a705-f14b-4d90-8219-20ec079dc744\") " pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:09.916181 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.916058 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df81a705-f14b-4d90-8219-20ec079dc744-trusted-ca-bundle\") pod \"console-745648c7f7-pbrhs\" (UID: \"df81a705-f14b-4d90-8219-20ec079dc744\") " pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:09.916181 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.916113 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df81a705-f14b-4d90-8219-20ec079dc744-console-oauth-config\") pod \"console-745648c7f7-pbrhs\" (UID: \"df81a705-f14b-4d90-8219-20ec079dc744\") " pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:09.916181 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.916138 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df81a705-f14b-4d90-8219-20ec079dc744-oauth-serving-cert\") pod \"console-745648c7f7-pbrhs\" (UID: \"df81a705-f14b-4d90-8219-20ec079dc744\") " pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:09.916181 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.916180 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf67h\" (UniqueName: \"kubernetes.io/projected/df81a705-f14b-4d90-8219-20ec079dc744-kube-api-access-rf67h\") pod \"console-745648c7f7-pbrhs\" (UID: \"df81a705-f14b-4d90-8219-20ec079dc744\") " pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:09.916868 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.916826 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df81a705-f14b-4d90-8219-20ec079dc744-console-config\") pod \"console-745648c7f7-pbrhs\" (UID: \"df81a705-f14b-4d90-8219-20ec079dc744\") " pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:09.916958 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.916934 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df81a705-f14b-4d90-8219-20ec079dc744-oauth-serving-cert\") pod \"console-745648c7f7-pbrhs\" (UID: \"df81a705-f14b-4d90-8219-20ec079dc744\") " pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:09.917029 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.916993 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df81a705-f14b-4d90-8219-20ec079dc744-service-ca\") pod \"console-745648c7f7-pbrhs\" (UID: \"df81a705-f14b-4d90-8219-20ec079dc744\") " pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:09.917085 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.917067 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df81a705-f14b-4d90-8219-20ec079dc744-trusted-ca-bundle\") pod \"console-745648c7f7-pbrhs\" (UID: \"df81a705-f14b-4d90-8219-20ec079dc744\") " pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:09.918739 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.918718 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df81a705-f14b-4d90-8219-20ec079dc744-console-serving-cert\") pod \"console-745648c7f7-pbrhs\" (UID: \"df81a705-f14b-4d90-8219-20ec079dc744\") " pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:09.919047 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.919025 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df81a705-f14b-4d90-8219-20ec079dc744-console-oauth-config\") pod \"console-745648c7f7-pbrhs\" (UID: \"df81a705-f14b-4d90-8219-20ec079dc744\") " pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:09.923682 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:09.923659 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf67h\" (UniqueName: \"kubernetes.io/projected/df81a705-f14b-4d90-8219-20ec079dc744-kube-api-access-rf67h\") pod \"console-745648c7f7-pbrhs\" (UID: \"df81a705-f14b-4d90-8219-20ec079dc744\") " pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:10.030936 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:10.030829 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:10.305010 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:10.304984 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-745648c7f7-pbrhs"] Sep 15 21:32:10.306999 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:32:10.306968 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf81a705_f14b_4d90_8219_20ec079dc744.slice/crio-036e4ba91e3885bcec4acb90c710c11cfbeaa1e830bdc14e57563a0585ee7ae2 WatchSource:0}: Error finding container 036e4ba91e3885bcec4acb90c710c11cfbeaa1e830bdc14e57563a0585ee7ae2: Status 404 returned error can't find the container with id 036e4ba91e3885bcec4acb90c710c11cfbeaa1e830bdc14e57563a0585ee7ae2 Sep 15 21:32:10.678062 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:10.677978 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745648c7f7-pbrhs" event={"ID":"df81a705-f14b-4d90-8219-20ec079dc744","Type":"ContainerStarted","Data":"884607d2cb40fea1c1f6f4590db0ddbdc74b14be7485ed63d9dc3a1d167c1ba3"} Sep 15 21:32:10.678062 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:10.678023 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745648c7f7-pbrhs" event={"ID":"df81a705-f14b-4d90-8219-20ec079dc744","Type":"ContainerStarted","Data":"036e4ba91e3885bcec4acb90c710c11cfbeaa1e830bdc14e57563a0585ee7ae2"} Sep 15 21:32:10.697756 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:10.697708 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-745648c7f7-pbrhs" podStartSLOduration=1.6976922 podStartE2EDuration="1.6976922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:32:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:32:10.695354732 +0000 UTC m=+385.281952322" watchObservedRunningTime="2026-09-15 21:32:10.6976922 +0000 UTC m=+385.284289791" Sep 15 21:32:16.681902 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:16.681801 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:16.855354 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:16.855311 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:16.953050 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:16.952963 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:17.053651 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:17.053615 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:18.725568 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:18.725532 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:18.826079 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:18.826041 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:18.926967 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:18.926929 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:19.674604 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:19.674576 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5d697dcf85-s4rp5" Sep 15 21:32:20.031381 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:20.031346 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:20.031769 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:20.031415 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:20.036244 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:20.036219 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:20.729895 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:20.729864 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-745648c7f7-pbrhs" Sep 15 21:32:20.772241 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:20.772210 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-db74bcf87-nk6wk"] Sep 15 21:32:20.877717 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:20.877671 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:20.978088 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:20.978050 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:21.032819 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:21.032731 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:23.028033 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.027997 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:23.123963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.123929 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:23.681257 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.681219 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw"] Sep 15 21:32:23.687908 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.687888 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.690711 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.690684 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-lvdvf\"" Sep 15 21:32:23.690869 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.690727 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 15 21:32:23.699965 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.699942 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw"] Sep 15 21:32:23.708329 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.708304 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6"] Sep 15 21:32:23.711021 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.710996 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:23.714173 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.714149 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 15 21:32:23.714281 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.714154 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 15 21:32:23.714281 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.714154 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 15 21:32:23.714281 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.714190 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9x555\"" Sep 15 21:32:23.724639 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.724614 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6"] Sep 15 21:32:23.727720 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.727693 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:23.733914 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.733829 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/608b1fef-5905-4280-bda4-0b887898e46a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.733914 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.733899 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/608b1fef-5905-4280-bda4-0b887898e46a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.734104 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.733924 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/608b1fef-5905-4280-bda4-0b887898e46a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.734104 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.734007 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/608b1fef-5905-4280-bda4-0b887898e46a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.734104 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.734044 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/608b1fef-5905-4280-bda4-0b887898e46a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.734104 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.734066 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g75b7\" (UniqueName: \"kubernetes.io/projected/608b1fef-5905-4280-bda4-0b887898e46a-kube-api-access-g75b7\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.734327 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.734117 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/608b1fef-5905-4280-bda4-0b887898e46a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.734327 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.734142 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/608b1fef-5905-4280-bda4-0b887898e46a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.734327 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.734158 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/608b1fef-5905-4280-bda4-0b887898e46a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.835189 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.835151 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/608b1fef-5905-4280-bda4-0b887898e46a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.835382 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.835193 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/608b1fef-5905-4280-bda4-0b887898e46a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.835382 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.835223 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g75b7\" (UniqueName: \"kubernetes.io/projected/608b1fef-5905-4280-bda4-0b887898e46a-kube-api-access-g75b7\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.835382 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.835257 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e394ccb2-1aeb-49ec-8183-40ced527fea1-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-4jdr6\" (UID: \"e394ccb2-1aeb-49ec-8183-40ced527fea1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:23.835382 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.835306 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/608b1fef-5905-4280-bda4-0b887898e46a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.835382 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.835332 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e394ccb2-1aeb-49ec-8183-40ced527fea1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-4jdr6\" (UID: \"e394ccb2-1aeb-49ec-8183-40ced527fea1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:23.835382 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.835366 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/608b1fef-5905-4280-bda4-0b887898e46a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.835718 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.835392 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/608b1fef-5905-4280-bda4-0b887898e46a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.835718 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.835465 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e394ccb2-1aeb-49ec-8183-40ced527fea1-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-4jdr6\" (UID: \"e394ccb2-1aeb-49ec-8183-40ced527fea1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:23.835718 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.835517 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e394ccb2-1aeb-49ec-8183-40ced527fea1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-4jdr6\" (UID: \"e394ccb2-1aeb-49ec-8183-40ced527fea1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:23.835718 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.835559 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/608b1fef-5905-4280-bda4-0b887898e46a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.835718 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.835613 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/608b1fef-5905-4280-bda4-0b887898e46a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.835718 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.835614 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm2kr\" (UniqueName: \"kubernetes.io/projected/e394ccb2-1aeb-49ec-8183-40ced527fea1-kube-api-access-tm2kr\") pod \"istiod-openshift-gateway-5677ccb49b-4jdr6\" (UID: \"e394ccb2-1aeb-49ec-8183-40ced527fea1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:23.835718 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.835669 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/608b1fef-5905-4280-bda4-0b887898e46a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.835718 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.835675 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/608b1fef-5905-4280-bda4-0b887898e46a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.836204 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.835738 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/608b1fef-5905-4280-bda4-0b887898e46a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.836204 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.835741 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/608b1fef-5905-4280-bda4-0b887898e46a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.836204 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.835773 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e394ccb2-1aeb-49ec-8183-40ced527fea1-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-4jdr6\" (UID: \"e394ccb2-1aeb-49ec-8183-40ced527fea1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:23.836204 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.835800 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e394ccb2-1aeb-49ec-8183-40ced527fea1-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-4jdr6\" (UID: \"e394ccb2-1aeb-49ec-8183-40ced527fea1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:23.836204 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.835821 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/608b1fef-5905-4280-bda4-0b887898e46a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.836204 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.835997 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/608b1fef-5905-4280-bda4-0b887898e46a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.837528 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.837503 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/608b1fef-5905-4280-bda4-0b887898e46a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.837980 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.837964 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/608b1fef-5905-4280-bda4-0b887898e46a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.844875 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.844831 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/608b1fef-5905-4280-bda4-0b887898e46a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.845051 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.845033 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g75b7\" (UniqueName: \"kubernetes.io/projected/608b1fef-5905-4280-bda4-0b887898e46a-kube-api-access-g75b7\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw\" (UID: \"608b1fef-5905-4280-bda4-0b887898e46a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:23.936224 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.936135 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:23.936373 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.936271 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e394ccb2-1aeb-49ec-8183-40ced527fea1-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-4jdr6\" (UID: \"e394ccb2-1aeb-49ec-8183-40ced527fea1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:23.936373 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.936324 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e394ccb2-1aeb-49ec-8183-40ced527fea1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-4jdr6\" (UID: \"e394ccb2-1aeb-49ec-8183-40ced527fea1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:23.936373 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.936356 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm2kr\" (UniqueName: \"kubernetes.io/projected/e394ccb2-1aeb-49ec-8183-40ced527fea1-kube-api-access-tm2kr\") pod \"istiod-openshift-gateway-5677ccb49b-4jdr6\" (UID: \"e394ccb2-1aeb-49ec-8183-40ced527fea1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:23.936529 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.936390 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e394ccb2-1aeb-49ec-8183-40ced527fea1-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-4jdr6\" (UID: \"e394ccb2-1aeb-49ec-8183-40ced527fea1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:23.936529 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.936413 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e394ccb2-1aeb-49ec-8183-40ced527fea1-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-4jdr6\" (UID: \"e394ccb2-1aeb-49ec-8183-40ced527fea1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:23.936529 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.936476 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e394ccb2-1aeb-49ec-8183-40ced527fea1-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-4jdr6\" (UID: \"e394ccb2-1aeb-49ec-8183-40ced527fea1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:23.936529 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.936511 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e394ccb2-1aeb-49ec-8183-40ced527fea1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-4jdr6\" (UID: \"e394ccb2-1aeb-49ec-8183-40ced527fea1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:23.937184 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.937154 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e394ccb2-1aeb-49ec-8183-40ced527fea1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-4jdr6\" (UID: \"e394ccb2-1aeb-49ec-8183-40ced527fea1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:23.938873 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.938819 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e394ccb2-1aeb-49ec-8183-40ced527fea1-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-4jdr6\" (UID: \"e394ccb2-1aeb-49ec-8183-40ced527fea1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:23.938989 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.938973 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e394ccb2-1aeb-49ec-8183-40ced527fea1-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-4jdr6\" (UID: \"e394ccb2-1aeb-49ec-8183-40ced527fea1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:23.939073 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.939051 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e394ccb2-1aeb-49ec-8183-40ced527fea1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-4jdr6\" (UID: \"e394ccb2-1aeb-49ec-8183-40ced527fea1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:23.939130 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.939076 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e394ccb2-1aeb-49ec-8183-40ced527fea1-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-4jdr6\" (UID: \"e394ccb2-1aeb-49ec-8183-40ced527fea1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:23.946233 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.946208 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e394ccb2-1aeb-49ec-8183-40ced527fea1-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-4jdr6\" (UID: \"e394ccb2-1aeb-49ec-8183-40ced527fea1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:23.947299 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.947255 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm2kr\" (UniqueName: \"kubernetes.io/projected/e394ccb2-1aeb-49ec-8183-40ced527fea1-kube-api-access-tm2kr\") pod \"istiod-openshift-gateway-5677ccb49b-4jdr6\" (UID: \"e394ccb2-1aeb-49ec-8183-40ced527fea1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:23.999501 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:23.999465 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:24.022338 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:24.022308 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:24.052657 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:24.052422 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:24.323447 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:24.323413 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw"] Sep 15 21:32:24.327297 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:32:24.327271 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod608b1fef_5905_4280_bda4_0b887898e46a.slice/crio-d4414fb80eaaf7de4836fbf9e6a5956e6342969fec79fb98161345383f2f4d55 WatchSource:0}: Error finding container d4414fb80eaaf7de4836fbf9e6a5956e6342969fec79fb98161345383f2f4d55: Status 404 returned error can't find the container with id d4414fb80eaaf7de4836fbf9e6a5956e6342969fec79fb98161345383f2f4d55 Sep 15 21:32:24.345467 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:24.345439 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6"] Sep 15 21:32:24.346694 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:32:24.346673 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode394ccb2_1aeb_49ec_8183_40ced527fea1.slice/crio-0486275be509b433c855b8d0fbf10fe5085e60f7b8003dc234c84f68d8ab49e6 WatchSource:0}: Error finding container 0486275be509b433c855b8d0fbf10fe5085e60f7b8003dc234c84f68d8ab49e6: Status 404 returned error can't find the container with id 0486275be509b433c855b8d0fbf10fe5085e60f7b8003dc234c84f68d8ab49e6 Sep 15 21:32:24.746032 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:24.745994 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" event={"ID":"e394ccb2-1aeb-49ec-8183-40ced527fea1","Type":"ContainerStarted","Data":"0486275be509b433c855b8d0fbf10fe5085e60f7b8003dc234c84f68d8ab49e6"} Sep 15 21:32:24.747369 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:24.747345 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" event={"ID":"608b1fef-5905-4280-bda4-0b887898e46a","Type":"ContainerStarted","Data":"d4414fb80eaaf7de4836fbf9e6a5956e6342969fec79fb98161345383f2f4d55"} Sep 15 21:32:26.388763 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:26.388726 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:26.489391 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:26.489277 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:26.657661 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:26.657576 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:26.872328 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:26.872289 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:27.723289 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:27.723247 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:32:27.723552 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:27.723327 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:32:27.726173 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:27.726141 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:32:27.726262 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:27.726204 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:32:27.726262 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:27.726240 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:32:27.730071 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:27.730047 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:27.830804 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:27.830734 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:32:28.771551 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:28.771510 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" event={"ID":"608b1fef-5905-4280-bda4-0b887898e46a","Type":"ContainerStarted","Data":"3e4c17a974849f3f5dfb78aeec1dd76dde7df5f9d47d67b485987ec43e1debf2"} Sep 15 21:32:28.773135 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:28.773107 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" event={"ID":"e394ccb2-1aeb-49ec-8183-40ced527fea1","Type":"ContainerStarted","Data":"5889f6190cfcc56f2b761553a0201ead6b70d88dde87b34651466c90eb69ed31"} Sep 15 21:32:28.773322 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:28.773304 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:28.775038 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:28.775021 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" Sep 15 21:32:28.804296 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:28.804254 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" podStartSLOduration=2.407821693 podStartE2EDuration="5.804234346s" totalImagesPullingTime="3.396412653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:32:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:32:28.802536967 +0000 UTC m=+403.389134759" watchObservedRunningTime="2026-09-15 21:32:28.804234346 +0000 UTC m=+403.390831942" Sep 15 21:32:28.848117 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:28.848066 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6" podStartSLOduration=2.473737129 podStartE2EDuration="5.848051634s" totalImagesPullingTime="3.374314505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:32:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:32:28.847896505 +0000 UTC m=+403.434494096" watchObservedRunningTime="2026-09-15 21:32:28.848051634 +0000 UTC m=+403.434649226" Sep 15 21:32:28.999860 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:28.999803 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:29.004415 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:29.004391 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:29.778108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:29.778071 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:29.779037 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:29.779016 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw" Sep 15 21:32:45.793457 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:45.793394 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-db74bcf87-nk6wk" podUID="6e4ac0a0-4c31-41f7-8c60-b38fb4155de8" containerName="console" containerID="cri-o://bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06" gracePeriod=15 Sep 15 21:32:46.058000 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.057941 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:32:46.239558 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.239530 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-service-ca\") pod \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " Sep 15 21:32:46.239558 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.239562 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-console-oauth-config\") pod \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " Sep 15 21:32:46.239812 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.239593 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gp8km\" (UniqueName: \"kubernetes.io/projected/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-kube-api-access-gp8km\") pod \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " Sep 15 21:32:46.239812 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.239615 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-console-serving-cert\") pod \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " Sep 15 21:32:46.239812 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.239681 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-trusted-ca-bundle\") pod \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " Sep 15 21:32:46.239812 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.239717 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-console-config\") pod \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " Sep 15 21:32:46.239812 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.239748 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-oauth-serving-cert\") pod \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\" (UID: \"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8\") " Sep 15 21:32:46.240152 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.240111 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-service-ca" (OuterVolumeSpecName: "service-ca") pod "6e4ac0a0-4c31-41f7-8c60-b38fb4155de8" (UID: "6e4ac0a0-4c31-41f7-8c60-b38fb4155de8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:32:46.240314 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.240285 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6e4ac0a0-4c31-41f7-8c60-b38fb4155de8" (UID: "6e4ac0a0-4c31-41f7-8c60-b38fb4155de8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:32:46.240437 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.240409 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6e4ac0a0-4c31-41f7-8c60-b38fb4155de8" (UID: "6e4ac0a0-4c31-41f7-8c60-b38fb4155de8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:32:46.240500 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.240450 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-console-config" (OuterVolumeSpecName: "console-config") pod "6e4ac0a0-4c31-41f7-8c60-b38fb4155de8" (UID: "6e4ac0a0-4c31-41f7-8c60-b38fb4155de8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:32:46.242014 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.241994 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6e4ac0a0-4c31-41f7-8c60-b38fb4155de8" (UID: "6e4ac0a0-4c31-41f7-8c60-b38fb4155de8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 21:32:46.242103 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.242019 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-kube-api-access-gp8km" (OuterVolumeSpecName: "kube-api-access-gp8km") pod "6e4ac0a0-4c31-41f7-8c60-b38fb4155de8" (UID: "6e4ac0a0-4c31-41f7-8c60-b38fb4155de8"). InnerVolumeSpecName "kube-api-access-gp8km". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:32:46.242103 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.242026 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6e4ac0a0-4c31-41f7-8c60-b38fb4155de8" (UID: "6e4ac0a0-4c31-41f7-8c60-b38fb4155de8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 21:32:46.341412 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.341329 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-service-ca\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:32:46.341412 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.341356 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-console-oauth-config\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:32:46.341412 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.341366 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp8km\" (UniqueName: \"kubernetes.io/projected/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-kube-api-access-gp8km\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:32:46.341412 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.341375 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-console-serving-cert\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:32:46.341412 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.341385 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-trusted-ca-bundle\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:32:46.341412 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.341393 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-console-config\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:32:46.341412 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.341401 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8-oauth-serving-cert\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:32:46.858928 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.858891 2573 generic.go:356] "Generic (PLEG): container finished" podID="6e4ac0a0-4c31-41f7-8c60-b38fb4155de8" containerID="bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06" exitCode=0 Sep 15 21:32:46.859375 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.858935 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db74bcf87-nk6wk" Sep 15 21:32:46.859375 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.858959 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db74bcf87-nk6wk" event={"ID":"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8","Type":"ContainerDied","Data":"bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06"} Sep 15 21:32:46.859375 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.859008 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db74bcf87-nk6wk" event={"ID":"6e4ac0a0-4c31-41f7-8c60-b38fb4155de8","Type":"ContainerDied","Data":"893a38bc5dc766d9d715ba07f7a81c7c3ff7a47aa4e6476b87cafb55ecc5a549"} Sep 15 21:32:46.859375 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.859039 2573 scope.go:117] "RemoveContainer" containerID="bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06" Sep 15 21:32:46.867801 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.867778 2573 scope.go:117] "RemoveContainer" containerID="bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06" Sep 15 21:32:46.868090 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:32:46.868069 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06\": container with ID starting with bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06 not found: ID does not exist" containerID="bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06" Sep 15 21:32:46.868178 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.868098 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06"} err="failed to get container status \"bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06\": rpc error: code = NotFound desc = could not find container \"bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06\": container with ID starting with bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06 not found: ID does not exist" Sep 15 21:32:46.868896 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:32:46.868874 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4ac0a0_4c31_41f7_8c60_b38fb4155de8.slice/crio-conmon-bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06.scope\": RecentStats: unable to find data in memory cache]" Sep 15 21:32:46.880709 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.880688 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-db74bcf87-nk6wk"] Sep 15 21:32:46.882508 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:46.882489 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-db74bcf87-nk6wk"] Sep 15 21:32:47.934600 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:32:47.934557 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e4ac0a0-4c31-41f7-8c60-b38fb4155de8" path="/var/lib/kubelet/pods/6e4ac0a0-4c31-41f7-8c60-b38fb4155de8/volumes" Sep 15 21:32:49.854022 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:32:49.853989 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4ac0a0_4c31_41f7_8c60_b38fb4155de8.slice/crio-conmon-bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06.scope\": RecentStats: unable to find data in memory cache]" Sep 15 21:32:56.909913 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:32:56.909879 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4ac0a0_4c31_41f7_8c60_b38fb4155de8.slice/crio-conmon-bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06.scope\": RecentStats: unable to find data in memory cache]" Sep 15 21:33:00.317873 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:33:00.317801 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4ac0a0_4c31_41f7_8c60_b38fb4155de8.slice/crio-conmon-bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06.scope\": RecentStats: unable to find data in memory cache]" Sep 15 21:33:00.318353 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:33:00.318126 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4ac0a0_4c31_41f7_8c60_b38fb4155de8.slice/crio-conmon-bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06.scope\": RecentStats: unable to find data in memory cache]" Sep 15 21:33:04.856176 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:33:04.856137 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4ac0a0_4c31_41f7_8c60_b38fb4155de8.slice/crio-conmon-bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06.scope\": RecentStats: unable to find data in memory cache]" Sep 15 21:33:06.918828 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:33:06.918790 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4ac0a0_4c31_41f7_8c60_b38fb4155de8.slice/crio-conmon-bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06.scope\": RecentStats: unable to find data in memory cache]" Sep 15 21:33:16.958996 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:33:16.958911 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4ac0a0_4c31_41f7_8c60_b38fb4155de8.slice/crio-conmon-bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06.scope\": RecentStats: unable to find data in memory cache]" Sep 15 21:33:17.969247 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:17.969206 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:18.066650 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:18.066611 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:19.829119 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:33:19.829079 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4ac0a0_4c31_41f7_8c60_b38fb4155de8.slice/crio-conmon-bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06.scope\": RecentStats: unable to find data in memory cache]" Sep 15 21:33:21.580048 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.580006 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9"] Sep 15 21:33:21.580398 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.580344 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e4ac0a0-4c31-41f7-8c60-b38fb4155de8" containerName="console" Sep 15 21:33:21.580398 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.580354 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e4ac0a0-4c31-41f7-8c60-b38fb4155de8" containerName="console" Sep 15 21:33:21.580469 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.580409 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e4ac0a0-4c31-41f7-8c60-b38fb4155de8" containerName="console" Sep 15 21:33:21.582489 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.582470 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9" Sep 15 21:33:21.584736 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.584712 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 15 21:33:21.585784 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.585765 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kgh75\"" Sep 15 21:33:21.585895 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.585766 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 15 21:33:21.590385 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.590363 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9"] Sep 15 21:33:21.678602 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.678565 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml"] Sep 15 21:33:21.681164 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.681143 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml" Sep 15 21:33:21.689473 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.689447 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml"] Sep 15 21:33:21.745786 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.745748 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk5r5\" (UniqueName: \"kubernetes.io/projected/29215579-a055-42ca-8c0a-7ef1b222162f-kube-api-access-lk5r5\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9\" (UID: \"29215579-a055-42ca-8c0a-7ef1b222162f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9" Sep 15 21:33:21.746019 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.745801 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29215579-a055-42ca-8c0a-7ef1b222162f-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9\" (UID: \"29215579-a055-42ca-8c0a-7ef1b222162f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9" Sep 15 21:33:21.746019 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.745951 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29215579-a055-42ca-8c0a-7ef1b222162f-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9\" (UID: \"29215579-a055-42ca-8c0a-7ef1b222162f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9" Sep 15 21:33:21.778342 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.778306 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5"] Sep 15 21:33:21.780731 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.780715 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5" Sep 15 21:33:21.789044 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.789021 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5"] Sep 15 21:33:21.846442 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.846363 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk5r5\" (UniqueName: \"kubernetes.io/projected/29215579-a055-42ca-8c0a-7ef1b222162f-kube-api-access-lk5r5\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9\" (UID: \"29215579-a055-42ca-8c0a-7ef1b222162f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9" Sep 15 21:33:21.846442 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.846406 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46373a4a-2025-45e3-aadc-719bf3143538-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml\" (UID: \"46373a4a-2025-45e3-aadc-719bf3143538\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml" Sep 15 21:33:21.846442 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.846432 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29215579-a055-42ca-8c0a-7ef1b222162f-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9\" (UID: \"29215579-a055-42ca-8c0a-7ef1b222162f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9" Sep 15 21:33:21.846652 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.846524 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29215579-a055-42ca-8c0a-7ef1b222162f-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9\" (UID: \"29215579-a055-42ca-8c0a-7ef1b222162f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9" Sep 15 21:33:21.846652 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.846556 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46373a4a-2025-45e3-aadc-719bf3143538-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml\" (UID: \"46373a4a-2025-45e3-aadc-719bf3143538\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml" Sep 15 21:33:21.846652 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.846611 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd6pb\" (UniqueName: \"kubernetes.io/projected/46373a4a-2025-45e3-aadc-719bf3143538-kube-api-access-sd6pb\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml\" (UID: \"46373a4a-2025-45e3-aadc-719bf3143538\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml" Sep 15 21:33:21.846798 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.846783 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29215579-a055-42ca-8c0a-7ef1b222162f-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9\" (UID: \"29215579-a055-42ca-8c0a-7ef1b222162f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9" Sep 15 21:33:21.846863 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.846829 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29215579-a055-42ca-8c0a-7ef1b222162f-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9\" (UID: \"29215579-a055-42ca-8c0a-7ef1b222162f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9" Sep 15 21:33:21.854160 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.854130 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk5r5\" (UniqueName: \"kubernetes.io/projected/29215579-a055-42ca-8c0a-7ef1b222162f-kube-api-access-lk5r5\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9\" (UID: \"29215579-a055-42ca-8c0a-7ef1b222162f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9" Sep 15 21:33:21.879128 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.879097 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps"] Sep 15 21:33:21.881909 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.881891 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps" Sep 15 21:33:21.891165 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.891136 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps"] Sep 15 21:33:21.892627 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.892605 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9" Sep 15 21:33:21.947305 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.947272 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j55rq\" (UniqueName: \"kubernetes.io/projected/ce645074-aa89-45c1-be17-4e9aec85bf0d-kube-api-access-j55rq\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5\" (UID: \"ce645074-aa89-45c1-be17-4e9aec85bf0d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5" Sep 15 21:33:21.947442 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.947342 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce645074-aa89-45c1-be17-4e9aec85bf0d-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5\" (UID: \"ce645074-aa89-45c1-be17-4e9aec85bf0d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5" Sep 15 21:33:21.947442 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.947418 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46373a4a-2025-45e3-aadc-719bf3143538-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml\" (UID: \"46373a4a-2025-45e3-aadc-719bf3143538\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml" Sep 15 21:33:21.947556 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.947470 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce645074-aa89-45c1-be17-4e9aec85bf0d-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5\" (UID: \"ce645074-aa89-45c1-be17-4e9aec85bf0d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5" Sep 15 21:33:21.947556 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.947516 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd6pb\" (UniqueName: \"kubernetes.io/projected/46373a4a-2025-45e3-aadc-719bf3143538-kube-api-access-sd6pb\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml\" (UID: \"46373a4a-2025-45e3-aadc-719bf3143538\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml" Sep 15 21:33:21.947662 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.947578 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46373a4a-2025-45e3-aadc-719bf3143538-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml\" (UID: \"46373a4a-2025-45e3-aadc-719bf3143538\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml" Sep 15 21:33:21.948080 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.947895 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46373a4a-2025-45e3-aadc-719bf3143538-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml\" (UID: \"46373a4a-2025-45e3-aadc-719bf3143538\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml" Sep 15 21:33:21.948080 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.948068 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46373a4a-2025-45e3-aadc-719bf3143538-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml\" (UID: \"46373a4a-2025-45e3-aadc-719bf3143538\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml" Sep 15 21:33:21.957113 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.956933 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd6pb\" (UniqueName: \"kubernetes.io/projected/46373a4a-2025-45e3-aadc-719bf3143538-kube-api-access-sd6pb\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml\" (UID: \"46373a4a-2025-45e3-aadc-719bf3143538\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml" Sep 15 21:33:21.990707 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:21.990678 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml" Sep 15 21:33:22.048571 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:22.048505 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j55rq\" (UniqueName: \"kubernetes.io/projected/ce645074-aa89-45c1-be17-4e9aec85bf0d-kube-api-access-j55rq\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5\" (UID: \"ce645074-aa89-45c1-be17-4e9aec85bf0d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5" Sep 15 21:33:22.048703 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:22.048573 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj66b\" (UniqueName: \"kubernetes.io/projected/d697ce98-40c5-49af-b870-f547ff00599f-kube-api-access-nj66b\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps\" (UID: \"d697ce98-40c5-49af-b870-f547ff00599f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps" Sep 15 21:33:22.048703 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:22.048615 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce645074-aa89-45c1-be17-4e9aec85bf0d-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5\" (UID: \"ce645074-aa89-45c1-be17-4e9aec85bf0d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5" Sep 15 21:33:22.048703 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:22.048660 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d697ce98-40c5-49af-b870-f547ff00599f-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps\" (UID: \"d697ce98-40c5-49af-b870-f547ff00599f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps" Sep 15 21:33:22.048703 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:22.048690 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d697ce98-40c5-49af-b870-f547ff00599f-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps\" (UID: \"d697ce98-40c5-49af-b870-f547ff00599f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps" Sep 15 21:33:22.049019 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:22.048730 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce645074-aa89-45c1-be17-4e9aec85bf0d-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5\" (UID: \"ce645074-aa89-45c1-be17-4e9aec85bf0d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5" Sep 15 21:33:22.049233 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:22.049206 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce645074-aa89-45c1-be17-4e9aec85bf0d-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5\" (UID: \"ce645074-aa89-45c1-be17-4e9aec85bf0d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5" Sep 15 21:33:22.049317 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:22.049217 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce645074-aa89-45c1-be17-4e9aec85bf0d-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5\" (UID: \"ce645074-aa89-45c1-be17-4e9aec85bf0d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5" Sep 15 21:33:22.056997 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:22.056975 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j55rq\" (UniqueName: \"kubernetes.io/projected/ce645074-aa89-45c1-be17-4e9aec85bf0d-kube-api-access-j55rq\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5\" (UID: \"ce645074-aa89-45c1-be17-4e9aec85bf0d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5" Sep 15 21:33:22.091042 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:22.091009 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5" Sep 15 21:33:22.149561 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:22.149524 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj66b\" (UniqueName: \"kubernetes.io/projected/d697ce98-40c5-49af-b870-f547ff00599f-kube-api-access-nj66b\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps\" (UID: \"d697ce98-40c5-49af-b870-f547ff00599f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps" Sep 15 21:33:22.149685 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:22.149593 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d697ce98-40c5-49af-b870-f547ff00599f-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps\" (UID: \"d697ce98-40c5-49af-b870-f547ff00599f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps" Sep 15 21:33:22.149685 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:22.149623 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d697ce98-40c5-49af-b870-f547ff00599f-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps\" (UID: \"d697ce98-40c5-49af-b870-f547ff00599f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps" Sep 15 21:33:22.150043 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:22.150023 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d697ce98-40c5-49af-b870-f547ff00599f-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps\" (UID: \"d697ce98-40c5-49af-b870-f547ff00599f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps" Sep 15 21:33:22.150097 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:22.150071 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d697ce98-40c5-49af-b870-f547ff00599f-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps\" (UID: \"d697ce98-40c5-49af-b870-f547ff00599f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps" Sep 15 21:33:22.157920 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:22.157895 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj66b\" (UniqueName: \"kubernetes.io/projected/d697ce98-40c5-49af-b870-f547ff00599f-kube-api-access-nj66b\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps\" (UID: \"d697ce98-40c5-49af-b870-f547ff00599f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps" Sep 15 21:33:22.166727 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:22.165871 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9"] Sep 15 21:33:22.172318 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:33:22.171985 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29215579_a055_42ca_8c0a_7ef1b222162f.slice/crio-f6f5f6bf2dcf205cb3d3c2ee5657bf6eeda0b26dc0de842092b58826e2fef187 WatchSource:0}: Error finding container f6f5f6bf2dcf205cb3d3c2ee5657bf6eeda0b26dc0de842092b58826e2fef187: Status 404 returned error can't find the container with id f6f5f6bf2dcf205cb3d3c2ee5657bf6eeda0b26dc0de842092b58826e2fef187 Sep 15 21:33:22.191907 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:22.191880 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps" Sep 15 21:33:22.269262 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:22.269234 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml"] Sep 15 21:33:22.271021 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:33:22.270988 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46373a4a_2025_45e3_aadc_719bf3143538.slice/crio-37c45a7a7536296c34418b5b355fb7760802c990c2878d1e962ae39d9d457480 WatchSource:0}: Error finding container 37c45a7a7536296c34418b5b355fb7760802c990c2878d1e962ae39d9d457480: Status 404 returned error can't find the container with id 37c45a7a7536296c34418b5b355fb7760802c990c2878d1e962ae39d9d457480 Sep 15 21:33:22.361830 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:22.361797 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5"] Sep 15 21:33:22.363105 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:33:22.363080 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce645074_aa89_45c1_be17_4e9aec85bf0d.slice/crio-ea9aa8087cd981eb4a2a766ebf274b4584f8c7b440b22fe65697b5047157a5ff WatchSource:0}: Error finding container ea9aa8087cd981eb4a2a766ebf274b4584f8c7b440b22fe65697b5047157a5ff: Status 404 returned error can't find the container with id ea9aa8087cd981eb4a2a766ebf274b4584f8c7b440b22fe65697b5047157a5ff Sep 15 21:33:22.463939 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:22.463910 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps"] Sep 15 21:33:22.511740 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:33:22.511709 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd697ce98_40c5_49af_b870_f547ff00599f.slice/crio-38889d203316de6f1823a328c5df9c544e49e83074d74464226fe0b3ef78919e WatchSource:0}: Error finding container 38889d203316de6f1823a328c5df9c544e49e83074d74464226fe0b3ef78919e: Status 404 returned error can't find the container with id 38889d203316de6f1823a328c5df9c544e49e83074d74464226fe0b3ef78919e Sep 15 21:33:23.029282 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:23.029248 2573 generic.go:356] "Generic (PLEG): container finished" podID="ce645074-aa89-45c1-be17-4e9aec85bf0d" containerID="e0ee2b56fc87529ee532fc219e3659e6f539ff2f8795b87fd1171732e4325c37" exitCode=0 Sep 15 21:33:23.029735 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:23.029322 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5" event={"ID":"ce645074-aa89-45c1-be17-4e9aec85bf0d","Type":"ContainerDied","Data":"e0ee2b56fc87529ee532fc219e3659e6f539ff2f8795b87fd1171732e4325c37"} Sep 15 21:33:23.029735 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:23.029370 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5" event={"ID":"ce645074-aa89-45c1-be17-4e9aec85bf0d","Type":"ContainerStarted","Data":"ea9aa8087cd981eb4a2a766ebf274b4584f8c7b440b22fe65697b5047157a5ff"} Sep 15 21:33:23.031009 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:23.030985 2573 generic.go:356] "Generic (PLEG): container finished" podID="46373a4a-2025-45e3-aadc-719bf3143538" containerID="ab74f7d1757caaa04d91fd1b43e37dcbae087fc27033690288f7ebe92195150d" exitCode=0 Sep 15 21:33:23.031099 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:23.031075 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml" event={"ID":"46373a4a-2025-45e3-aadc-719bf3143538","Type":"ContainerDied","Data":"ab74f7d1757caaa04d91fd1b43e37dcbae087fc27033690288f7ebe92195150d"} Sep 15 21:33:23.031172 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:23.031121 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml" event={"ID":"46373a4a-2025-45e3-aadc-719bf3143538","Type":"ContainerStarted","Data":"37c45a7a7536296c34418b5b355fb7760802c990c2878d1e962ae39d9d457480"} Sep 15 21:33:23.032646 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:23.032624 2573 generic.go:356] "Generic (PLEG): container finished" podID="29215579-a055-42ca-8c0a-7ef1b222162f" containerID="2d098482cd7bd4f12059580a07f8fb7da01467d5c0a5735508d05a1497591f40" exitCode=0 Sep 15 21:33:23.032747 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:23.032720 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9" event={"ID":"29215579-a055-42ca-8c0a-7ef1b222162f","Type":"ContainerDied","Data":"2d098482cd7bd4f12059580a07f8fb7da01467d5c0a5735508d05a1497591f40"} Sep 15 21:33:23.032816 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:23.032769 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9" event={"ID":"29215579-a055-42ca-8c0a-7ef1b222162f","Type":"ContainerStarted","Data":"f6f5f6bf2dcf205cb3d3c2ee5657bf6eeda0b26dc0de842092b58826e2fef187"} Sep 15 21:33:23.034450 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:23.034423 2573 generic.go:356] "Generic (PLEG): container finished" podID="d697ce98-40c5-49af-b870-f547ff00599f" containerID="0a7370d18b9bbbe4bb9b3a51060d8cba1cf489c5469bdf0b4955548dd534dc83" exitCode=0 Sep 15 21:33:23.034543 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:23.034458 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps" event={"ID":"d697ce98-40c5-49af-b870-f547ff00599f","Type":"ContainerDied","Data":"0a7370d18b9bbbe4bb9b3a51060d8cba1cf489c5469bdf0b4955548dd534dc83"} Sep 15 21:33:23.034543 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:23.034501 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps" event={"ID":"d697ce98-40c5-49af-b870-f547ff00599f","Type":"ContainerStarted","Data":"38889d203316de6f1823a328c5df9c544e49e83074d74464226fe0b3ef78919e"} Sep 15 21:33:24.050834 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:24.050779 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5" event={"ID":"ce645074-aa89-45c1-be17-4e9aec85bf0d","Type":"ContainerStarted","Data":"9b6c4e78e16e97cf5d6b76a94293fb122cf159dc5b959d98953d33f98f1095c7"} Sep 15 21:33:24.052722 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:24.052696 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9" event={"ID":"29215579-a055-42ca-8c0a-7ef1b222162f","Type":"ContainerStarted","Data":"1a3b01a5c735447eef0a20b69c52b03c79aa07a434b7f74122a084554f168018"} Sep 15 21:33:25.059339 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:25.059302 2573 generic.go:356] "Generic (PLEG): container finished" podID="46373a4a-2025-45e3-aadc-719bf3143538" containerID="3cb3711f97ff1b05988dd59ce10bc5157c7f6058800fc3a11cef2816ae65c29c" exitCode=0 Sep 15 21:33:25.059766 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:25.059387 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml" event={"ID":"46373a4a-2025-45e3-aadc-719bf3143538","Type":"ContainerDied","Data":"3cb3711f97ff1b05988dd59ce10bc5157c7f6058800fc3a11cef2816ae65c29c"} Sep 15 21:33:25.061365 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:25.061342 2573 generic.go:356] "Generic (PLEG): container finished" podID="29215579-a055-42ca-8c0a-7ef1b222162f" containerID="1a3b01a5c735447eef0a20b69c52b03c79aa07a434b7f74122a084554f168018" exitCode=0 Sep 15 21:33:25.061455 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:25.061431 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9" event={"ID":"29215579-a055-42ca-8c0a-7ef1b222162f","Type":"ContainerDied","Data":"1a3b01a5c735447eef0a20b69c52b03c79aa07a434b7f74122a084554f168018"} Sep 15 21:33:25.063432 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:25.063409 2573 generic.go:356] "Generic (PLEG): container finished" podID="d697ce98-40c5-49af-b870-f547ff00599f" containerID="5cdc6bbff9090238f740d536a17538a8c19d5b6342f2c63e0386639b9caf3d13" exitCode=0 Sep 15 21:33:25.063529 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:25.063486 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps" event={"ID":"d697ce98-40c5-49af-b870-f547ff00599f","Type":"ContainerDied","Data":"5cdc6bbff9090238f740d536a17538a8c19d5b6342f2c63e0386639b9caf3d13"} Sep 15 21:33:25.065607 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:25.065586 2573 generic.go:356] "Generic (PLEG): container finished" podID="ce645074-aa89-45c1-be17-4e9aec85bf0d" containerID="9b6c4e78e16e97cf5d6b76a94293fb122cf159dc5b959d98953d33f98f1095c7" exitCode=0 Sep 15 21:33:25.065696 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:25.065619 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5" event={"ID":"ce645074-aa89-45c1-be17-4e9aec85bf0d","Type":"ContainerDied","Data":"9b6c4e78e16e97cf5d6b76a94293fb122cf159dc5b959d98953d33f98f1095c7"} Sep 15 21:33:26.073297 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:26.073254 2573 generic.go:356] "Generic (PLEG): container finished" podID="ce645074-aa89-45c1-be17-4e9aec85bf0d" containerID="204f29823e63e28d934b85e833fc468b54306b3305c877243f01fb1be3a68449" exitCode=0 Sep 15 21:33:26.073753 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:26.073349 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5" event={"ID":"ce645074-aa89-45c1-be17-4e9aec85bf0d","Type":"ContainerDied","Data":"204f29823e63e28d934b85e833fc468b54306b3305c877243f01fb1be3a68449"} Sep 15 21:33:26.077067 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:26.077037 2573 generic.go:356] "Generic (PLEG): container finished" podID="46373a4a-2025-45e3-aadc-719bf3143538" containerID="22e906e71ada42b442861c4eb9cf39eab54f81ec76de5eaec548567442704299" exitCode=0 Sep 15 21:33:26.077219 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:26.077109 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml" event={"ID":"46373a4a-2025-45e3-aadc-719bf3143538","Type":"ContainerDied","Data":"22e906e71ada42b442861c4eb9cf39eab54f81ec76de5eaec548567442704299"} Sep 15 21:33:26.079382 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:26.079357 2573 generic.go:356] "Generic (PLEG): container finished" podID="29215579-a055-42ca-8c0a-7ef1b222162f" containerID="b1a4ea7500e14c855412907d0e93ebb5ce9bd74af5fcb438e5be72a4601ea6ea" exitCode=0 Sep 15 21:33:26.079506 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:26.079436 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9" event={"ID":"29215579-a055-42ca-8c0a-7ef1b222162f","Type":"ContainerDied","Data":"b1a4ea7500e14c855412907d0e93ebb5ce9bd74af5fcb438e5be72a4601ea6ea"} Sep 15 21:33:26.081480 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:26.081464 2573 generic.go:356] "Generic (PLEG): container finished" podID="d697ce98-40c5-49af-b870-f547ff00599f" containerID="7d762f7d3260e05305ee99bc12d0bce629b622ef9227f12306a456278dbbac4c" exitCode=0 Sep 15 21:33:26.081555 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:26.081508 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps" event={"ID":"d697ce98-40c5-49af-b870-f547ff00599f","Type":"ContainerDied","Data":"7d762f7d3260e05305ee99bc12d0bce629b622ef9227f12306a456278dbbac4c"} Sep 15 21:33:27.000672 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:33:27.000638 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4ac0a0_4c31_41f7_8c60_b38fb4155de8.slice/crio-conmon-bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06.scope\": RecentStats: unable to find data in memory cache]" Sep 15 21:33:27.238626 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.238587 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5" Sep 15 21:33:27.299001 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.298976 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9" Sep 15 21:33:27.302296 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.302271 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml" Sep 15 21:33:27.306293 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.306271 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps" Sep 15 21:33:27.396608 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.396577 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lk5r5\" (UniqueName: \"kubernetes.io/projected/29215579-a055-42ca-8c0a-7ef1b222162f-kube-api-access-lk5r5\") pod \"29215579-a055-42ca-8c0a-7ef1b222162f\" (UID: \"29215579-a055-42ca-8c0a-7ef1b222162f\") " Sep 15 21:33:27.396792 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.396637 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46373a4a-2025-45e3-aadc-719bf3143538-util\") pod \"46373a4a-2025-45e3-aadc-719bf3143538\" (UID: \"46373a4a-2025-45e3-aadc-719bf3143538\") " Sep 15 21:33:27.396792 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.396663 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sd6pb\" (UniqueName: \"kubernetes.io/projected/46373a4a-2025-45e3-aadc-719bf3143538-kube-api-access-sd6pb\") pod \"46373a4a-2025-45e3-aadc-719bf3143538\" (UID: \"46373a4a-2025-45e3-aadc-719bf3143538\") " Sep 15 21:33:27.396792 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.396689 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29215579-a055-42ca-8c0a-7ef1b222162f-util\") pod \"29215579-a055-42ca-8c0a-7ef1b222162f\" (UID: \"29215579-a055-42ca-8c0a-7ef1b222162f\") " Sep 15 21:33:27.396971 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.396928 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46373a4a-2025-45e3-aadc-719bf3143538-bundle\") pod \"46373a4a-2025-45e3-aadc-719bf3143538\" (UID: \"46373a4a-2025-45e3-aadc-719bf3143538\") " Sep 15 21:33:27.397034 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.396984 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j55rq\" (UniqueName: \"kubernetes.io/projected/ce645074-aa89-45c1-be17-4e9aec85bf0d-kube-api-access-j55rq\") pod \"ce645074-aa89-45c1-be17-4e9aec85bf0d\" (UID: \"ce645074-aa89-45c1-be17-4e9aec85bf0d\") " Sep 15 21:33:27.397034 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.397013 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce645074-aa89-45c1-be17-4e9aec85bf0d-bundle\") pod \"ce645074-aa89-45c1-be17-4e9aec85bf0d\" (UID: \"ce645074-aa89-45c1-be17-4e9aec85bf0d\") " Sep 15 21:33:27.397136 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.397040 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nj66b\" (UniqueName: \"kubernetes.io/projected/d697ce98-40c5-49af-b870-f547ff00599f-kube-api-access-nj66b\") pod \"d697ce98-40c5-49af-b870-f547ff00599f\" (UID: \"d697ce98-40c5-49af-b870-f547ff00599f\") " Sep 15 21:33:27.397136 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.397068 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d697ce98-40c5-49af-b870-f547ff00599f-util\") pod \"d697ce98-40c5-49af-b870-f547ff00599f\" (UID: \"d697ce98-40c5-49af-b870-f547ff00599f\") " Sep 15 21:33:27.397229 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.397188 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce645074-aa89-45c1-be17-4e9aec85bf0d-util\") pod \"ce645074-aa89-45c1-be17-4e9aec85bf0d\" (UID: \"ce645074-aa89-45c1-be17-4e9aec85bf0d\") " Sep 15 21:33:27.397285 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.397234 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d697ce98-40c5-49af-b870-f547ff00599f-bundle\") pod \"d697ce98-40c5-49af-b870-f547ff00599f\" (UID: \"d697ce98-40c5-49af-b870-f547ff00599f\") " Sep 15 21:33:27.397285 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.397265 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29215579-a055-42ca-8c0a-7ef1b222162f-bundle\") pod \"29215579-a055-42ca-8c0a-7ef1b222162f\" (UID: \"29215579-a055-42ca-8c0a-7ef1b222162f\") " Sep 15 21:33:27.398255 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.397705 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46373a4a-2025-45e3-aadc-719bf3143538-bundle" (OuterVolumeSpecName: "bundle") pod "46373a4a-2025-45e3-aadc-719bf3143538" (UID: "46373a4a-2025-45e3-aadc-719bf3143538"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:33:27.398255 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.398049 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce645074-aa89-45c1-be17-4e9aec85bf0d-bundle" (OuterVolumeSpecName: "bundle") pod "ce645074-aa89-45c1-be17-4e9aec85bf0d" (UID: "ce645074-aa89-45c1-be17-4e9aec85bf0d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:33:27.398255 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.398183 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29215579-a055-42ca-8c0a-7ef1b222162f-bundle" (OuterVolumeSpecName: "bundle") pod "29215579-a055-42ca-8c0a-7ef1b222162f" (UID: "29215579-a055-42ca-8c0a-7ef1b222162f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:33:27.398620 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.398592 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d697ce98-40c5-49af-b870-f547ff00599f-bundle" (OuterVolumeSpecName: "bundle") pod "d697ce98-40c5-49af-b870-f547ff00599f" (UID: "d697ce98-40c5-49af-b870-f547ff00599f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:33:27.400170 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.400130 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce645074-aa89-45c1-be17-4e9aec85bf0d-kube-api-access-j55rq" (OuterVolumeSpecName: "kube-api-access-j55rq") pod "ce645074-aa89-45c1-be17-4e9aec85bf0d" (UID: "ce645074-aa89-45c1-be17-4e9aec85bf0d"). InnerVolumeSpecName "kube-api-access-j55rq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:33:27.400680 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.400567 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29215579-a055-42ca-8c0a-7ef1b222162f-kube-api-access-lk5r5" (OuterVolumeSpecName: "kube-api-access-lk5r5") pod "29215579-a055-42ca-8c0a-7ef1b222162f" (UID: "29215579-a055-42ca-8c0a-7ef1b222162f"). InnerVolumeSpecName "kube-api-access-lk5r5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:33:27.400680 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.400645 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46373a4a-2025-45e3-aadc-719bf3143538-kube-api-access-sd6pb" (OuterVolumeSpecName: "kube-api-access-sd6pb") pod "46373a4a-2025-45e3-aadc-719bf3143538" (UID: "46373a4a-2025-45e3-aadc-719bf3143538"). InnerVolumeSpecName "kube-api-access-sd6pb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:33:27.400826 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.400774 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d697ce98-40c5-49af-b870-f547ff00599f-kube-api-access-nj66b" (OuterVolumeSpecName: "kube-api-access-nj66b") pod "d697ce98-40c5-49af-b870-f547ff00599f" (UID: "d697ce98-40c5-49af-b870-f547ff00599f"). InnerVolumeSpecName "kube-api-access-nj66b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:33:27.402511 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.402471 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29215579-a055-42ca-8c0a-7ef1b222162f-util" (OuterVolumeSpecName: "util") pod "29215579-a055-42ca-8c0a-7ef1b222162f" (UID: "29215579-a055-42ca-8c0a-7ef1b222162f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:33:27.404541 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.404520 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce645074-aa89-45c1-be17-4e9aec85bf0d-util" (OuterVolumeSpecName: "util") pod "ce645074-aa89-45c1-be17-4e9aec85bf0d" (UID: "ce645074-aa89-45c1-be17-4e9aec85bf0d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:33:27.405994 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.405971 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46373a4a-2025-45e3-aadc-719bf3143538-util" (OuterVolumeSpecName: "util") pod "46373a4a-2025-45e3-aadc-719bf3143538" (UID: "46373a4a-2025-45e3-aadc-719bf3143538"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:33:27.406388 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.406372 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d697ce98-40c5-49af-b870-f547ff00599f-util" (OuterVolumeSpecName: "util") pod "d697ce98-40c5-49af-b870-f547ff00599f" (UID: "d697ce98-40c5-49af-b870-f547ff00599f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:33:27.498367 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.498328 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d697ce98-40c5-49af-b870-f547ff00599f-bundle\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:33:27.498367 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.498358 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29215579-a055-42ca-8c0a-7ef1b222162f-bundle\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:33:27.498367 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.498368 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lk5r5\" (UniqueName: \"kubernetes.io/projected/29215579-a055-42ca-8c0a-7ef1b222162f-kube-api-access-lk5r5\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:33:27.498587 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.498377 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46373a4a-2025-45e3-aadc-719bf3143538-util\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:33:27.498587 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.498395 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd6pb\" (UniqueName: \"kubernetes.io/projected/46373a4a-2025-45e3-aadc-719bf3143538-kube-api-access-sd6pb\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:33:27.498587 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.498403 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29215579-a055-42ca-8c0a-7ef1b222162f-util\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:33:27.498587 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.498413 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46373a4a-2025-45e3-aadc-719bf3143538-bundle\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:33:27.498587 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.498421 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j55rq\" (UniqueName: \"kubernetes.io/projected/ce645074-aa89-45c1-be17-4e9aec85bf0d-kube-api-access-j55rq\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:33:27.498587 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.498429 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce645074-aa89-45c1-be17-4e9aec85bf0d-bundle\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:33:27.498587 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.498438 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nj66b\" (UniqueName: \"kubernetes.io/projected/d697ce98-40c5-49af-b870-f547ff00599f-kube-api-access-nj66b\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:33:27.498587 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.498447 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d697ce98-40c5-49af-b870-f547ff00599f-util\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:33:27.498587 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:27.498454 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce645074-aa89-45c1-be17-4e9aec85bf0d-util\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:33:28.099727 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:28.099695 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5" event={"ID":"ce645074-aa89-45c1-be17-4e9aec85bf0d","Type":"ContainerDied","Data":"ea9aa8087cd981eb4a2a766ebf274b4584f8c7b440b22fe65697b5047157a5ff"} Sep 15 21:33:28.099909 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:28.099748 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea9aa8087cd981eb4a2a766ebf274b4584f8c7b440b22fe65697b5047157a5ff" Sep 15 21:33:28.099909 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:28.099705 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xpqp5" Sep 15 21:33:28.101751 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:28.101716 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml" Sep 15 21:33:28.101994 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:28.101716 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xk9ml" event={"ID":"46373a4a-2025-45e3-aadc-719bf3143538","Type":"ContainerDied","Data":"37c45a7a7536296c34418b5b355fb7760802c990c2878d1e962ae39d9d457480"} Sep 15 21:33:28.101994 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:28.101880 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37c45a7a7536296c34418b5b355fb7760802c990c2878d1e962ae39d9d457480" Sep 15 21:33:28.104224 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:28.104191 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9" event={"ID":"29215579-a055-42ca-8c0a-7ef1b222162f","Type":"ContainerDied","Data":"f6f5f6bf2dcf205cb3d3c2ee5657bf6eeda0b26dc0de842092b58826e2fef187"} Sep 15 21:33:28.104347 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:28.104232 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f6f5f6bf2dcf205cb3d3c2ee5657bf6eeda0b26dc0de842092b58826e2fef187" Sep 15 21:33:28.104347 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:28.104200 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6dls9" Sep 15 21:33:28.106410 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:28.106394 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps" Sep 15 21:33:28.106519 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:28.106396 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8gqps" event={"ID":"d697ce98-40c5-49af-b870-f547ff00599f","Type":"ContainerDied","Data":"38889d203316de6f1823a328c5df9c544e49e83074d74464226fe0b3ef78919e"} Sep 15 21:33:28.106519 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:28.106503 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38889d203316de6f1823a328c5df9c544e49e83074d74464226fe0b3ef78919e" Sep 15 21:33:31.924016 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:31.923979 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:34.854730 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:33:34.854696 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4ac0a0_4c31_41f7_8c60_b38fb4155de8.slice/crio-conmon-bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06.scope\": RecentStats: unable to find data in memory cache]" Sep 15 21:33:35.351072 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:35.351040 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:37.009572 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:33:37.009534 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4ac0a0_4c31_41f7_8c60_b38fb4155de8.slice/crio-conmon-bbc04d19fc34efae14dcf049f774a336d03958e213ad967fdd98efd3bc8a5b06.scope\": RecentStats: unable to find data in memory cache]" Sep 15 21:33:37.997089 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:37.997049 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:38.551427 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:38.551391 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:39.126494 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:39.126451 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:42.179763 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:42.179722 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:42.319768 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:42.319733 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:42.920782 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:42.920743 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:43.575997 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:43.575965 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:44.617081 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:44.617036 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:44.711199 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:44.711163 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:46.170265 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:46.170170 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:46.275010 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:46.274969 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:46.370672 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:46.370639 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:46.512173 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:46.512138 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:48.553781 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:48.553745 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:48.655102 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:48.655073 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:49.735627 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:49.735581 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:50.195961 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:50.195867 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:54.528367 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:54.528330 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:54.589798 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:54.589760 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:54.739719 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:54.739684 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:54.840185 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:54.840097 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:54.940448 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:54.940418 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:33:55.020520 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:33:55.020480 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:03.190729 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:03.190693 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:03.283193 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:03.283135 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:03.384254 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:03.384213 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:03.836395 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:03.836358 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:03.937545 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:03.937510 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:05.719036 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:05.718998 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:05.820405 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:05.820369 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:08.124692 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:08.124662 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:08.183044 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:08.183015 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:11.740081 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:11.740040 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:13.251711 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:13.251678 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:13.353096 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:13.353064 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:13.452774 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:13.452737 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:22.082033 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:22.082000 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:22.182327 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:22.182288 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:24.737696 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:24.737658 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:24.842514 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:24.842472 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:27.685892 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:27.685834 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:27.785563 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:27.785525 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:33.288109 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:33.288078 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:33.386384 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:33.386346 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:34.080374 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:34.080336 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:34.137407 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:34.137358 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:34.290711 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:34.290672 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:34.390821 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:34.390725 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:40.381486 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381407 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww"] Sep 15 21:34:40.381870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381711 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d697ce98-40c5-49af-b870-f547ff00599f" containerName="util" Sep 15 21:34:40.381870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381732 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d697ce98-40c5-49af-b870-f547ff00599f" containerName="util" Sep 15 21:34:40.381870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381745 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce645074-aa89-45c1-be17-4e9aec85bf0d" containerName="extract" Sep 15 21:34:40.381870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381751 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce645074-aa89-45c1-be17-4e9aec85bf0d" containerName="extract" Sep 15 21:34:40.381870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381758 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46373a4a-2025-45e3-aadc-719bf3143538" containerName="extract" Sep 15 21:34:40.381870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381764 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="46373a4a-2025-45e3-aadc-719bf3143538" containerName="extract" Sep 15 21:34:40.381870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381773 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29215579-a055-42ca-8c0a-7ef1b222162f" containerName="util" Sep 15 21:34:40.381870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381777 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="29215579-a055-42ca-8c0a-7ef1b222162f" containerName="util" Sep 15 21:34:40.381870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381783 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d697ce98-40c5-49af-b870-f547ff00599f" containerName="pull" Sep 15 21:34:40.381870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381788 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d697ce98-40c5-49af-b870-f547ff00599f" containerName="pull" Sep 15 21:34:40.381870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381794 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce645074-aa89-45c1-be17-4e9aec85bf0d" containerName="pull" Sep 15 21:34:40.381870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381799 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce645074-aa89-45c1-be17-4e9aec85bf0d" containerName="pull" Sep 15 21:34:40.381870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381809 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce645074-aa89-45c1-be17-4e9aec85bf0d" containerName="util" Sep 15 21:34:40.381870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381813 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce645074-aa89-45c1-be17-4e9aec85bf0d" containerName="util" Sep 15 21:34:40.381870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381818 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46373a4a-2025-45e3-aadc-719bf3143538" containerName="util" Sep 15 21:34:40.381870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381823 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="46373a4a-2025-45e3-aadc-719bf3143538" containerName="util" Sep 15 21:34:40.381870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381830 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46373a4a-2025-45e3-aadc-719bf3143538" containerName="pull" Sep 15 21:34:40.381870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381837 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="46373a4a-2025-45e3-aadc-719bf3143538" containerName="pull" Sep 15 21:34:40.381870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381854 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29215579-a055-42ca-8c0a-7ef1b222162f" containerName="pull" Sep 15 21:34:40.381870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381861 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="29215579-a055-42ca-8c0a-7ef1b222162f" containerName="pull" Sep 15 21:34:40.381870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381870 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29215579-a055-42ca-8c0a-7ef1b222162f" containerName="extract" Sep 15 21:34:40.381870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381875 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="29215579-a055-42ca-8c0a-7ef1b222162f" containerName="extract" Sep 15 21:34:40.381870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381880 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d697ce98-40c5-49af-b870-f547ff00599f" containerName="extract" Sep 15 21:34:40.381870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381885 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d697ce98-40c5-49af-b870-f547ff00599f" containerName="extract" Sep 15 21:34:40.382604 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381938 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce645074-aa89-45c1-be17-4e9aec85bf0d" containerName="extract" Sep 15 21:34:40.382604 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381949 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="29215579-a055-42ca-8c0a-7ef1b222162f" containerName="extract" Sep 15 21:34:40.382604 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381955 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d697ce98-40c5-49af-b870-f547ff00599f" containerName="extract" Sep 15 21:34:40.382604 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.381960 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="46373a4a-2025-45e3-aadc-719bf3143538" containerName="extract" Sep 15 21:34:40.384804 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.384786 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.388380 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.388355 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-97sl2\"" Sep 15 21:34:40.400955 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.400930 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww"] Sep 15 21:34:40.418759 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.418730 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:40.422300 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.422273 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.422412 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.422308 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.422412 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.422330 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkb9z\" (UniqueName: \"kubernetes.io/projected/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-kube-api-access-fkb9z\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.422412 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.422358 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.422526 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.422401 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.422526 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.422438 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.422526 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.422475 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.422526 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.422513 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.422665 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.422561 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.523158 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.523119 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.523158 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.523163 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.523376 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.523276 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkb9z\" (UniqueName: \"kubernetes.io/projected/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-kube-api-access-fkb9z\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.523376 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.523313 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.523376 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.523338 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.523376 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.523366 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.523575 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.523422 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.523575 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.523453 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.523575 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.523508 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.523575 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.523557 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.523792 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.523640 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.523792 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.523765 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.523903 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.523800 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.524184 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.524161 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.525647 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.525625 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.525722 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.525698 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.531428 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.531405 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.531529 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.531479 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkb9z\" (UniqueName: \"kubernetes.io/projected/bc8cd5e0-f1c1-4f75-9282-e5ad2386268f-kube-api-access-fkb9z\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qvvww\" (UID: \"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.693360 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.693224 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:40.695032 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.695004 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:40.968952 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.968919 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww"] Sep 15 21:34:40.969939 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:34:40.969912 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc8cd5e0_f1c1_4f75_9282_e5ad2386268f.slice/crio-1ddbf368ceb05f93c370c19717de4b23898b94eb6a2b52dc67a780c482fe3026 WatchSource:0}: Error finding container 1ddbf368ceb05f93c370c19717de4b23898b94eb6a2b52dc67a780c482fe3026: Status 404 returned error can't find the container with id 1ddbf368ceb05f93c370c19717de4b23898b94eb6a2b52dc67a780c482fe3026 Sep 15 21:34:40.972036 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.972004 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:34:40.972110 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.972077 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:34:40.972153 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:40.972108 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:34:41.262476 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:41.262393 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:41.362396 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:41.362348 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:41.485838 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:41.485798 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" event={"ID":"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f","Type":"ContainerStarted","Data":"53aa736e43338f37847474126e3190509dc2552d95af4b2409421e9228b5a390"} Sep 15 21:34:41.486280 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:41.485864 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" event={"ID":"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f","Type":"ContainerStarted","Data":"1ddbf368ceb05f93c370c19717de4b23898b94eb6a2b52dc67a780c482fe3026"} Sep 15 21:34:41.507339 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:41.507289 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" podStartSLOduration=1.507270135 podStartE2EDuration="1.507270135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:34:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:34:41.506372787 +0000 UTC m=+536.092970379" watchObservedRunningTime="2026-09-15 21:34:41.507270135 +0000 UTC m=+536.093867727" Sep 15 21:34:41.695761 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:41.695677 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:42.701108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:42.701071 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:43.340059 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:43.340019 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:43.446119 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:43.446068 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:43.496554 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:43.496521 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:43.497555 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:43.497537 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:34:43.498636 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:43.498608 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:44.165353 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:44.165319 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:34:44.270458 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:34:44.270423 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:35:13.911583 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:35:13.911542 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:35:14.010610 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:35:14.010557 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:35:14.390513 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:35:14.390475 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:35:26.820675 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:35:26.820632 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:35:27.116490 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:35:27.116400 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:35:34.203176 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:35:34.203143 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:35:34.274383 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:35:34.274331 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:35:34.348601 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:35:34.348566 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:35:34.418358 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:35:34.418321 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:35:34.490919 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:35:34.490832 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:35:37.656584 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:35:37.656548 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:35:37.759737 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:35:37.759703 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:35:44.895422 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:35:44.895376 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:35:44.960194 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:35:44.960146 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:35:45.842895 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:35:45.842869 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/1.log" Sep 15 21:35:45.846971 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:35:45.846941 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/1.log" Sep 15 21:36:09.197176 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:09.197086 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:36:09.260447 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:09.260411 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:36:10.665435 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:10.665403 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:36:11.357656 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:11.357615 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-7q576"] Sep 15 21:36:11.360959 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:11.360937 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-7q576" Sep 15 21:36:11.363583 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:11.363562 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 15 21:36:11.363692 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:11.363637 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-zd78j\"" Sep 15 21:36:11.375877 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:11.375818 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-7q576"] Sep 15 21:36:11.404626 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:11.404597 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b1b10bf-d7ac-4e51-82ad-9c247a8b4365-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-7q576\" (UID: \"4b1b10bf-d7ac-4e51-82ad-9c247a8b4365\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7q576" Sep 15 21:36:11.404776 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:11.404638 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sn97\" (UniqueName: \"kubernetes.io/projected/4b1b10bf-d7ac-4e51-82ad-9c247a8b4365-kube-api-access-8sn97\") pod \"payload-processing-5b54b7fbb7-7q576\" (UID: \"4b1b10bf-d7ac-4e51-82ad-9c247a8b4365\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7q576" Sep 15 21:36:11.505187 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:11.505146 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sn97\" (UniqueName: \"kubernetes.io/projected/4b1b10bf-d7ac-4e51-82ad-9c247a8b4365-kube-api-access-8sn97\") pod \"payload-processing-5b54b7fbb7-7q576\" (UID: \"4b1b10bf-d7ac-4e51-82ad-9c247a8b4365\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7q576" Sep 15 21:36:11.505405 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:11.505257 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b1b10bf-d7ac-4e51-82ad-9c247a8b4365-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-7q576\" (UID: \"4b1b10bf-d7ac-4e51-82ad-9c247a8b4365\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7q576" Sep 15 21:36:11.506065 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:11.506046 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b1b10bf-d7ac-4e51-82ad-9c247a8b4365-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-7q576\" (UID: \"4b1b10bf-d7ac-4e51-82ad-9c247a8b4365\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7q576" Sep 15 21:36:11.521696 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:11.521663 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sn97\" (UniqueName: \"kubernetes.io/projected/4b1b10bf-d7ac-4e51-82ad-9c247a8b4365-kube-api-access-8sn97\") pod \"payload-processing-5b54b7fbb7-7q576\" (UID: \"4b1b10bf-d7ac-4e51-82ad-9c247a8b4365\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7q576" Sep 15 21:36:11.672201 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:11.671812 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-7q576" Sep 15 21:36:11.924872 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:11.924773 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:36:11.956002 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:11.955978 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-7q576"] Sep 15 21:36:11.957680 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:36:11.957654 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b1b10bf_d7ac_4e51_82ad_9c247a8b4365.slice/crio-ed47137816c12225913b1895977ce421a6e7947c8905f89a1189e72e0356ab4c WatchSource:0}: Error finding container ed47137816c12225913b1895977ce421a6e7947c8905f89a1189e72e0356ab4c: Status 404 returned error can't find the container with id ed47137816c12225913b1895977ce421a6e7947c8905f89a1189e72e0356ab4c Sep 15 21:36:11.959594 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:11.959574 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 21:36:12.591011 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:12.590973 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:36:12.961525 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:12.961429 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-7q576" event={"ID":"4b1b10bf-d7ac-4e51-82ad-9c247a8b4365","Type":"ContainerStarted","Data":"ed47137816c12225913b1895977ce421a6e7947c8905f89a1189e72e0356ab4c"} Sep 15 21:36:13.972860 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:13.972804 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-7q576" event={"ID":"4b1b10bf-d7ac-4e51-82ad-9c247a8b4365","Type":"ContainerStarted","Data":"8d607641277c0dc3848af6e7cf3271bae7f0774fb2736cc29e7b53b87c2982c1"} Sep 15 21:36:13.973446 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:13.973425 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-7q576" Sep 15 21:36:13.991348 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:13.991270 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-7q576" podStartSLOduration=1.600981531 podStartE2EDuration="2.991246638s" totalImagesPullingTime="1.390265107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:36:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:36:13.989340036 +0000 UTC m=+628.575937632" watchObservedRunningTime="2026-09-15 21:36:13.991246638 +0000 UTC m=+628.577844233" Sep 15 21:36:20.736647 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:20.736606 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:36:20.827082 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:20.827051 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:36:21.015640 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:21.015560 2573 generic.go:356] "Generic (PLEG): container finished" podID="bc8cd5e0-f1c1-4f75-9282-e5ad2386268f" containerID="53aa736e43338f37847474126e3190509dc2552d95af4b2409421e9228b5a390" exitCode=0 Sep 15 21:36:21.015640 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:21.015596 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" event={"ID":"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f","Type":"ContainerDied","Data":"53aa736e43338f37847474126e3190509dc2552d95af4b2409421e9228b5a390"} Sep 15 21:36:21.015998 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:21.015983 2573 scope.go:117] "RemoveContainer" containerID="53aa736e43338f37847474126e3190509dc2552d95af4b2409421e9228b5a390" Sep 15 21:36:21.017026 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:21.016998 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:36:21.017099 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:21.017064 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:36:21.017141 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:21.017099 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:36:22.021727 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:22.021692 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" event={"ID":"bc8cd5e0-f1c1-4f75-9282-e5ad2386268f","Type":"ContainerStarted","Data":"534001c6120b8aab24a509f617001949ba8378e825b90de00f6bd51ceb33b109"} Sep 15 21:36:22.695369 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:22.695330 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:36:22.695562 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:22.695542 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-qvvww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Sep 15 21:36:22.695624 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:22.695604 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" podUID="bc8cd5e0-f1c1-4f75-9282-e5ad2386268f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Sep 15 21:36:23.696105 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:23.696069 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-qvvww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Sep 15 21:36:23.696478 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:23.696134 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" podUID="bc8cd5e0-f1c1-4f75-9282-e5ad2386268f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Sep 15 21:36:24.696046 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:24.696009 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-qvvww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Sep 15 21:36:24.696238 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:24.696081 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" podUID="bc8cd5e0-f1c1-4f75-9282-e5ad2386268f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Sep 15 21:36:25.695806 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:25.695764 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-qvvww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Sep 15 21:36:25.696030 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:25.695835 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" podUID="bc8cd5e0-f1c1-4f75-9282-e5ad2386268f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Sep 15 21:36:25.990815 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:25.990788 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-7q576" Sep 15 21:36:26.696414 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:26.696372 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-qvvww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Sep 15 21:36:26.696602 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:26.696432 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" podUID="bc8cd5e0-f1c1-4f75-9282-e5ad2386268f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Sep 15 21:36:27.699090 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:27.699061 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:36:27.699454 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:27.699349 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:36:27.699978 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:27.699961 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww" Sep 15 21:36:35.908069 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:35.908029 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:36:39.158718 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:39.158678 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:36:51.662687 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:51.662653 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:36:58.530099 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:36:58.530057 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:37:02.326577 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.326519 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:37:02.731815 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.731782 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw"] Sep 15 21:37:02.735228 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.735208 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" Sep 15 21:37:02.737837 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.737781 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 15 21:37:02.737837 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.737783 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 15 21:37:02.738867 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.738822 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-r5v6f\"" Sep 15 21:37:02.738982 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.738881 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 15 21:37:02.748407 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.748386 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw"] Sep 15 21:37:02.751326 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.751303 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:37:02.754332 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.754312 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8cdb5194-77c3-4d9e-8c50-44763dca0ca3-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5tdnw\" (UID: \"8cdb5194-77c3-4d9e-8c50-44763dca0ca3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" Sep 15 21:37:02.754427 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.754413 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8cdb5194-77c3-4d9e-8c50-44763dca0ca3-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5tdnw\" (UID: \"8cdb5194-77c3-4d9e-8c50-44763dca0ca3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" Sep 15 21:37:02.754490 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.754437 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cdb5194-77c3-4d9e-8c50-44763dca0ca3-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5tdnw\" (UID: \"8cdb5194-77c3-4d9e-8c50-44763dca0ca3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" Sep 15 21:37:02.754546 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.754498 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw58q\" (UniqueName: \"kubernetes.io/projected/8cdb5194-77c3-4d9e-8c50-44763dca0ca3-kube-api-access-hw58q\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5tdnw\" (UID: \"8cdb5194-77c3-4d9e-8c50-44763dca0ca3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" Sep 15 21:37:02.754546 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.754541 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8cdb5194-77c3-4d9e-8c50-44763dca0ca3-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5tdnw\" (UID: \"8cdb5194-77c3-4d9e-8c50-44763dca0ca3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" Sep 15 21:37:02.754644 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.754580 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8cdb5194-77c3-4d9e-8c50-44763dca0ca3-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5tdnw\" (UID: \"8cdb5194-77c3-4d9e-8c50-44763dca0ca3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" Sep 15 21:37:02.855218 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.855179 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8cdb5194-77c3-4d9e-8c50-44763dca0ca3-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5tdnw\" (UID: \"8cdb5194-77c3-4d9e-8c50-44763dca0ca3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" Sep 15 21:37:02.855415 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.855234 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8cdb5194-77c3-4d9e-8c50-44763dca0ca3-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5tdnw\" (UID: \"8cdb5194-77c3-4d9e-8c50-44763dca0ca3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" Sep 15 21:37:02.855415 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.855276 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8cdb5194-77c3-4d9e-8c50-44763dca0ca3-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5tdnw\" (UID: \"8cdb5194-77c3-4d9e-8c50-44763dca0ca3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" Sep 15 21:37:02.855415 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.855375 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8cdb5194-77c3-4d9e-8c50-44763dca0ca3-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5tdnw\" (UID: \"8cdb5194-77c3-4d9e-8c50-44763dca0ca3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" Sep 15 21:37:02.855599 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.855429 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cdb5194-77c3-4d9e-8c50-44763dca0ca3-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5tdnw\" (UID: \"8cdb5194-77c3-4d9e-8c50-44763dca0ca3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" Sep 15 21:37:02.855599 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.855469 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw58q\" (UniqueName: \"kubernetes.io/projected/8cdb5194-77c3-4d9e-8c50-44763dca0ca3-kube-api-access-hw58q\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5tdnw\" (UID: \"8cdb5194-77c3-4d9e-8c50-44763dca0ca3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" Sep 15 21:37:02.855707 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.855632 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8cdb5194-77c3-4d9e-8c50-44763dca0ca3-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5tdnw\" (UID: \"8cdb5194-77c3-4d9e-8c50-44763dca0ca3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" Sep 15 21:37:02.855756 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.855700 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8cdb5194-77c3-4d9e-8c50-44763dca0ca3-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5tdnw\" (UID: \"8cdb5194-77c3-4d9e-8c50-44763dca0ca3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" Sep 15 21:37:02.855756 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.855719 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cdb5194-77c3-4d9e-8c50-44763dca0ca3-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5tdnw\" (UID: \"8cdb5194-77c3-4d9e-8c50-44763dca0ca3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" Sep 15 21:37:02.857592 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.857564 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8cdb5194-77c3-4d9e-8c50-44763dca0ca3-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5tdnw\" (UID: \"8cdb5194-77c3-4d9e-8c50-44763dca0ca3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" Sep 15 21:37:02.857896 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.857873 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8cdb5194-77c3-4d9e-8c50-44763dca0ca3-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5tdnw\" (UID: \"8cdb5194-77c3-4d9e-8c50-44763dca0ca3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" Sep 15 21:37:02.864747 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:02.864721 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw58q\" (UniqueName: \"kubernetes.io/projected/8cdb5194-77c3-4d9e-8c50-44763dca0ca3-kube-api-access-hw58q\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5tdnw\" (UID: \"8cdb5194-77c3-4d9e-8c50-44763dca0ca3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" Sep 15 21:37:03.045406 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:03.045303 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" Sep 15 21:37:03.318228 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:03.318196 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw"] Sep 15 21:37:03.319405 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:37:03.319380 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cdb5194_77c3_4d9e_8c50_44763dca0ca3.slice/crio-8448b560146306007505b904239509c4ba4dcae87c8f2c3436fe596766f80cb0 WatchSource:0}: Error finding container 8448b560146306007505b904239509c4ba4dcae87c8f2c3436fe596766f80cb0: Status 404 returned error can't find the container with id 8448b560146306007505b904239509c4ba4dcae87c8f2c3436fe596766f80cb0 Sep 15 21:37:04.242549 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:04.242514 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" event={"ID":"8cdb5194-77c3-4d9e-8c50-44763dca0ca3","Type":"ContainerStarted","Data":"8448b560146306007505b904239509c4ba4dcae87c8f2c3436fe596766f80cb0"} Sep 15 21:37:05.249311 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:05.249277 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" event={"ID":"8cdb5194-77c3-4d9e-8c50-44763dca0ca3","Type":"ContainerStarted","Data":"9b8fe372f65ebae5c7d6da849ba13e47bc733a70180b0215701c607a57d1891d"} Sep 15 21:37:05.269216 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:05.269164 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" podStartSLOduration=2.297731304 podStartE2EDuration="3.269149351s" totalImagesPullingTime="971.418047ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:37:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:37:05.266737545 +0000 UTC m=+679.853335138" watchObservedRunningTime="2026-09-15 21:37:05.269149351 +0000 UTC m=+679.855746974" Sep 15 21:37:13.046422 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:13.046379 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" Sep 15 21:37:13.046935 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:13.046456 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" Sep 15 21:37:13.058930 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:13.058904 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" Sep 15 21:37:13.301741 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:13.301651 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5tdnw" Sep 15 21:37:16.170657 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:16.170621 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:37:34.568770 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:34.568736 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:37:42.982835 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:42.982752 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:37:43.039526 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:43.039493 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:37:47.457548 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:37:47.457504 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:13.167654 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:13.167567 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:13.258196 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:13.258153 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:14.239967 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:14.239926 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:14.339420 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:14.339385 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:30.013632 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.013597 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:30.116841 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.116807 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:30.214472 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.214438 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:30.331986 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.331908 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z"] Sep 15 21:39:30.336100 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.336076 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.338794 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.338774 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-1af1db-openshift-default-dockercfg-dlp7q\"" Sep 15 21:39:30.345371 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.345348 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z"] Sep 15 21:39:30.365191 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.365163 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:30.397291 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.397257 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm"] Sep 15 21:39:30.400727 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.400706 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.403506 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.403481 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-360e43-openshift-default-dockercfg-b7s5q\"" Sep 15 21:39:30.415161 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.415129 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm"] Sep 15 21:39:30.437426 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.437382 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:30.456681 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.456647 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-credential-socket\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.456884 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.456687 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-workload-socket\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.456884 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.456705 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istio-envoy\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.456884 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.456775 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istio-data\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.456884 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.456818 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istio-token\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.457185 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.456884 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-workload-certs\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.457185 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.456933 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istiod-ca-cert\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.457185 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.457010 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istio-podinfo\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.457185 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.457065 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bj9g\" (UniqueName: \"kubernetes.io/projected/461c3497-1851-48ea-acdd-9cf97c9ea1a8-kube-api-access-2bj9g\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.460613 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.460586 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt"] Sep 15 21:39:30.464076 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.464057 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.466634 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.466610 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-56e305-openshift-default-dockercfg-v55gg\"" Sep 15 21:39:30.476196 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.476169 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt"] Sep 15 21:39:30.507570 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.507521 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:30.558231 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.558189 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-workload-socket\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.558422 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.558233 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istio-envoy\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.558422 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.558291 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istio-data\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.558422 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.558336 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istio-token\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.558422 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.558368 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istio-data\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.558422 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.558408 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-workload-certs\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.558642 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.558439 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-workload-certs\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.558642 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.558498 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istiod-ca-cert\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.558642 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.558536 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-credential-socket\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.558642 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.558563 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-workload-socket\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.558642 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.558586 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istio-envoy\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.558642 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.558635 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istio-podinfo\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.558901 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.558688 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istio-token\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.558901 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.558722 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bj9g\" (UniqueName: \"kubernetes.io/projected/461c3497-1851-48ea-acdd-9cf97c9ea1a8-kube-api-access-2bj9g\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.558901 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.558751 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istio-podinfo\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.558901 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.558798 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istiod-ca-cert\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.558901 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.558868 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-credential-socket\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.558901 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.558893 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9txhn\" (UniqueName: \"kubernetes.io/projected/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-kube-api-access-9txhn\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.559662 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.559632 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istio-data\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.560073 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.559834 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-credential-socket\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.560248 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.560221 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-workload-socket\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.560326 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.560280 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istiod-ca-cert\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.560449 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.560429 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-workload-certs\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.562171 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.562147 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istio-podinfo\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.562560 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.562539 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istio-envoy\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.572672 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.572647 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istio-token\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.572963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.572938 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bj9g\" (UniqueName: \"kubernetes.io/projected/461c3497-1851-48ea-acdd-9cf97c9ea1a8-kube-api-access-2bj9g\") pod \"e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.625493 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.625394 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:30.649327 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.649290 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:30.659469 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.659429 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istio-token\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.659469 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.659465 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16094ec4-2589-412c-80bc-dd53b7a91b38-istiod-ca-cert\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.659668 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.659490 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-istio-data\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.659668 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.659548 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istio-podinfo\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.659668 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.659604 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-istio-envoy\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.659668 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.659638 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istiod-ca-cert\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.659875 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.659668 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzr28\" (UniqueName: \"kubernetes.io/projected/16094ec4-2589-412c-80bc-dd53b7a91b38-kube-api-access-hzr28\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.659875 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.659731 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9txhn\" (UniqueName: \"kubernetes.io/projected/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-kube-api-access-9txhn\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.659875 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.659781 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istio-data\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.659875 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.659817 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-workload-certs\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.660082 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.659893 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-workload-certs\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.660082 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.659917 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16094ec4-2589-412c-80bc-dd53b7a91b38-istio-podinfo\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.660082 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.659943 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-workload-socket\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.660082 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.659964 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16094ec4-2589-412c-80bc-dd53b7a91b38-istio-token\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.660301 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.660151 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-credential-socket\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.660301 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.660182 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-workload-socket\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.660301 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.660205 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istio-envoy\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.660301 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.660233 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-credential-socket\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.660509 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.660298 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istio-data\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.660509 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.660351 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-workload-certs\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.660509 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.660457 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istiod-ca-cert\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.660686 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.660627 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-credential-socket\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.660896 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.660837 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-workload-socket\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.662544 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.662523 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istio-envoy\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.662769 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.662742 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istio-podinfo\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.667233 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.667203 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istio-token\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.667494 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.667474 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9txhn\" (UniqueName: \"kubernetes.io/projected/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-kube-api-access-9txhn\") pod \"e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.713315 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.713256 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:30.761135 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.761088 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-workload-certs\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.761135 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.761137 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16094ec4-2589-412c-80bc-dd53b7a91b38-istio-podinfo\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.761375 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.761167 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-workload-socket\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.761375 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.761188 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16094ec4-2589-412c-80bc-dd53b7a91b38-istio-token\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.761375 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.761247 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-credential-socket\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.761375 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.761313 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16094ec4-2589-412c-80bc-dd53b7a91b38-istiod-ca-cert\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.761375 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.761342 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-istio-data\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.761625 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.761384 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-istio-envoy\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.761625 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.761426 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzr28\" (UniqueName: \"kubernetes.io/projected/16094ec4-2589-412c-80bc-dd53b7a91b38-kube-api-access-hzr28\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.761625 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.761428 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-workload-certs\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.761769 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.761649 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-credential-socket\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.762479 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.762175 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-istio-data\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.762479 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.762400 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-workload-socket\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.762671 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.762594 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16094ec4-2589-412c-80bc-dd53b7a91b38-istiod-ca-cert\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.765094 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.765067 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-istio-envoy\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.765221 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.765205 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16094ec4-2589-412c-80bc-dd53b7a91b38-istio-podinfo\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.769277 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.769246 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzr28\" (UniqueName: \"kubernetes.io/projected/16094ec4-2589-412c-80bc-dd53b7a91b38-kube-api-access-hzr28\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.769361 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.769349 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16094ec4-2589-412c-80bc-dd53b7a91b38-istio-token\") pod \"e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.775776 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.775695 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:30.857311 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.857273 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:30.934233 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.934206 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z"] Sep 15 21:39:30.935413 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.935379 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:30.935789 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:39:30.935767 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod461c3497_1851_48ea_acdd_9cf97c9ea1a8.slice/crio-bc045670f19577908018dd38cee4129aec7b8f033ec198f2114793c64ab7f678 WatchSource:0}: Error finding container bc045670f19577908018dd38cee4129aec7b8f033ec198f2114793c64ab7f678: Status 404 returned error can't find the container with id bc045670f19577908018dd38cee4129aec7b8f033ec198f2114793c64ab7f678 Sep 15 21:39:30.937890 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.937816 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:39:30.937953 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.937894 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:39:30.937953 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:30.937923 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:39:31.002557 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:31.002528 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm"] Sep 15 21:39:31.003279 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:31.003249 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" event={"ID":"461c3497-1851-48ea-acdd-9cf97c9ea1a8","Type":"ContainerStarted","Data":"bc045670f19577908018dd38cee4129aec7b8f033ec198f2114793c64ab7f678"} Sep 15 21:39:31.003401 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:39:31.003372 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd5ec189_e2d2_47c0_8f15_f9ec1c97e056.slice/crio-8817ed5cc4abd23a6289f10d07b853e4cf7568dc4ae5b9c963042207a11761ee WatchSource:0}: Error finding container 8817ed5cc4abd23a6289f10d07b853e4cf7568dc4ae5b9c963042207a11761ee: Status 404 returned error can't find the container with id 8817ed5cc4abd23a6289f10d07b853e4cf7568dc4ae5b9c963042207a11761ee Sep 15 21:39:31.005706 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:31.005664 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:39:31.005789 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:31.005760 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:39:31.005830 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:31.005807 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:39:31.069839 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:39:31.069790 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16094ec4_2589_412c_80bc_dd53b7a91b38.slice/crio-e00e25ef6f09a66239bc7801cdfa19ed2dada22a0ad06565090b5c7a581d0489 WatchSource:0}: Error finding container e00e25ef6f09a66239bc7801cdfa19ed2dada22a0ad06565090b5c7a581d0489: Status 404 returned error can't find the container with id e00e25ef6f09a66239bc7801cdfa19ed2dada22a0ad06565090b5c7a581d0489 Sep 15 21:39:31.070262 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:31.069943 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt"] Sep 15 21:39:31.072324 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:31.072287 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:39:31.072457 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:31.072359 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:39:31.072457 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:31.072394 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:39:31.491648 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:31.491612 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:31.592977 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:31.592944 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:31.929610 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:31.929517 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:32.009825 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:32.009780 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" event={"ID":"461c3497-1851-48ea-acdd-9cf97c9ea1a8","Type":"ContainerStarted","Data":"2bb8714ea7b170d943b6c7c77059c05bf9a1ed263c14bc7806f5a15b4d9e0ee5"} Sep 15 21:39:32.011517 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:32.011492 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" event={"ID":"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056","Type":"ContainerStarted","Data":"9e495a94682e7c275b79f86687022cb141eacfd0f6c82d5eaeac3fbc9a45d955"} Sep 15 21:39:32.011640 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:32.011531 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" event={"ID":"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056","Type":"ContainerStarted","Data":"8817ed5cc4abd23a6289f10d07b853e4cf7568dc4ae5b9c963042207a11761ee"} Sep 15 21:39:32.013098 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:32.013066 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" event={"ID":"16094ec4-2589-412c-80bc-dd53b7a91b38","Type":"ContainerStarted","Data":"c52c2135387331876ae6528c430636986a4b4499ccf394a5373c0d466a00a451"} Sep 15 21:39:32.013184 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:32.013109 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" event={"ID":"16094ec4-2589-412c-80bc-dd53b7a91b38","Type":"ContainerStarted","Data":"e00e25ef6f09a66239bc7801cdfa19ed2dada22a0ad06565090b5c7a581d0489"} Sep 15 21:39:32.030618 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:32.030569 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" podStartSLOduration=2.030556246 podStartE2EDuration="2.030556246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:39:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:39:32.029351552 +0000 UTC m=+826.615949144" watchObservedRunningTime="2026-09-15 21:39:32.030556246 +0000 UTC m=+826.617153838" Sep 15 21:39:32.048856 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:32.048806 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" podStartSLOduration=2.048793504 podStartE2EDuration="2.048793504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:39:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:39:32.046820531 +0000 UTC m=+826.633418124" watchObservedRunningTime="2026-09-15 21:39:32.048793504 +0000 UTC m=+826.635391090" Sep 15 21:39:32.065196 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:32.065152 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" podStartSLOduration=2.065135744 podStartE2EDuration="2.065135744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:39:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:39:32.064917144 +0000 UTC m=+826.651514738" watchObservedRunningTime="2026-09-15 21:39:32.065135744 +0000 UTC m=+826.651733333" Sep 15 21:39:32.650306 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:32.650270 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:32.655618 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:32.655593 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:32.713817 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:32.713785 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:32.718756 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:32.718733 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:32.776192 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:32.776152 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:32.781635 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:32.781610 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:33.018289 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:33.018257 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:33.018499 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:33.018316 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:33.018499 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:33.018493 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:33.019300 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:33.019280 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:33.019398 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:33.019328 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:33.019398 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:33.019358 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:34.147402 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:34.147365 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:34.254338 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:34.254304 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:34.463371 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:34.463334 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:34.580494 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:34.580464 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:35.583707 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:35.583661 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:35.683292 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:35.683255 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:35.868508 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:35.868417 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:36.094319 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:36.094278 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:36.180041 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:36.179960 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:36.228858 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:36.228824 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp"] Sep 15 21:39:36.232527 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:36.232510 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp" Sep 15 21:39:36.235316 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:36.235288 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-1af1db-dockercfg-6dsjt\"" Sep 15 21:39:36.235459 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:36.235336 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-1af1db\"" Sep 15 21:39:36.240430 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:36.240324 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp"] Sep 15 21:39:36.314336 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:36.314302 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfzk4\" (UniqueName: \"kubernetes.io/projected/c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70-kube-api-access-kfzk4\") pod \"payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp\" (UID: \"c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70\") " pod="openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp" Sep 15 21:39:36.314546 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:36.314357 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp\" (UID: \"c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70\") " pod="openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp" Sep 15 21:39:36.414945 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:36.414913 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfzk4\" (UniqueName: \"kubernetes.io/projected/c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70-kube-api-access-kfzk4\") pod \"payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp\" (UID: \"c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70\") " pod="openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp" Sep 15 21:39:36.415137 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:36.414956 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp\" (UID: \"c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70\") " pod="openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp" Sep 15 21:39:36.415589 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:36.415569 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp\" (UID: \"c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70\") " pod="openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp" Sep 15 21:39:36.422667 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:36.422638 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfzk4\" (UniqueName: \"kubernetes.io/projected/c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70-kube-api-access-kfzk4\") pod \"payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp\" (UID: \"c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70\") " pod="openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp" Sep 15 21:39:36.544247 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:36.544209 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp" Sep 15 21:39:36.632393 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:36.632356 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:36.744291 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:36.744258 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:36.840420 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:36.840391 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp"] Sep 15 21:39:36.842166 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:39:36.842137 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc53a30f0_b1bc_4efa_ba5f_ed9abdffeb70.slice/crio-566729ccd01cb2673ea8eae26391a4ee469adeab8d74cb2cb482562e7aad72b5 WatchSource:0}: Error finding container 566729ccd01cb2673ea8eae26391a4ee469adeab8d74cb2cb482562e7aad72b5: Status 404 returned error can't find the container with id 566729ccd01cb2673ea8eae26391a4ee469adeab8d74cb2cb482562e7aad72b5 Sep 15 21:39:37.024649 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:37.024580 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:37.046077 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:37.046030 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp" event={"ID":"c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70","Type":"ContainerStarted","Data":"f264ec0d2c4ef87595a6a96c826d71d688dfea10fb1cc96408dd0ba416fe43d9"} Sep 15 21:39:37.046281 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:37.046091 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp" event={"ID":"c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70","Type":"ContainerStarted","Data":"566729ccd01cb2673ea8eae26391a4ee469adeab8d74cb2cb482562e7aad72b5"} Sep 15 21:39:37.046281 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:37.046161 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp" Sep 15 21:39:37.068682 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:37.066549 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp" podStartSLOduration=1.066523635 podStartE2EDuration="1.066523635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:39:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:39:37.062527914 +0000 UTC m=+831.649125505" watchObservedRunningTime="2026-09-15 21:39:37.066523635 +0000 UTC m=+831.653121228" Sep 15 21:39:37.204141 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:37.204053 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:37.297162 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:37.297130 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:37.663248 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:37.663215 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:37.718440 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:37.718405 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:37.818640 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:37.818605 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:38.120261 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.120207 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:38.207430 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.207385 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c"] Sep 15 21:39:38.209768 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.209737 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:38.211111 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.211093 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c" Sep 15 21:39:38.213512 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.213490 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-56e305-dockercfg-wb8zw\"" Sep 15 21:39:38.213727 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.213709 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-56e305\"" Sep 15 21:39:38.222038 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.222013 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c"] Sep 15 21:39:38.233006 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.232949 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx5kk\" (UniqueName: \"kubernetes.io/projected/47ace233-bc09-435d-b03f-dd19ed22d010-kube-api-access-tx5kk\") pod \"payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c\" (UID: \"47ace233-bc09-435d-b03f-dd19ed22d010\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c" Sep 15 21:39:38.233145 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.233007 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47ace233-bc09-435d-b03f-dd19ed22d010-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c\" (UID: \"47ace233-bc09-435d-b03f-dd19ed22d010\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c" Sep 15 21:39:38.268513 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.268477 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj"] Sep 15 21:39:38.271900 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.271883 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj" Sep 15 21:39:38.284009 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.283985 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj"] Sep 15 21:39:38.334115 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.334087 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx5kk\" (UniqueName: \"kubernetes.io/projected/47ace233-bc09-435d-b03f-dd19ed22d010-kube-api-access-tx5kk\") pod \"payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c\" (UID: \"47ace233-bc09-435d-b03f-dd19ed22d010\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c" Sep 15 21:39:38.334304 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.334126 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47ace233-bc09-435d-b03f-dd19ed22d010-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c\" (UID: \"47ace233-bc09-435d-b03f-dd19ed22d010\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c" Sep 15 21:39:38.334304 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.334151 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7lxh\" (UniqueName: \"kubernetes.io/projected/3a7ae857-7728-4934-b57c-8c57c687ba17-kube-api-access-t7lxh\") pod \"payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj\" (UID: \"3a7ae857-7728-4934-b57c-8c57c687ba17\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj" Sep 15 21:39:38.334304 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.334212 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a7ae857-7728-4934-b57c-8c57c687ba17-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj\" (UID: \"3a7ae857-7728-4934-b57c-8c57c687ba17\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj" Sep 15 21:39:38.334840 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.334820 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47ace233-bc09-435d-b03f-dd19ed22d010-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c\" (UID: \"47ace233-bc09-435d-b03f-dd19ed22d010\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c" Sep 15 21:39:38.348056 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.347940 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx5kk\" (UniqueName: \"kubernetes.io/projected/47ace233-bc09-435d-b03f-dd19ed22d010-kube-api-access-tx5kk\") pod \"payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c\" (UID: \"47ace233-bc09-435d-b03f-dd19ed22d010\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c" Sep 15 21:39:38.435396 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.435309 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7lxh\" (UniqueName: \"kubernetes.io/projected/3a7ae857-7728-4934-b57c-8c57c687ba17-kube-api-access-t7lxh\") pod \"payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj\" (UID: \"3a7ae857-7728-4934-b57c-8c57c687ba17\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj" Sep 15 21:39:38.435396 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.435363 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a7ae857-7728-4934-b57c-8c57c687ba17-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj\" (UID: \"3a7ae857-7728-4934-b57c-8c57c687ba17\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj" Sep 15 21:39:38.436112 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.436093 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a7ae857-7728-4934-b57c-8c57c687ba17-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj\" (UID: \"3a7ae857-7728-4934-b57c-8c57c687ba17\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj" Sep 15 21:39:38.443863 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.443829 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7lxh\" (UniqueName: \"kubernetes.io/projected/3a7ae857-7728-4934-b57c-8c57c687ba17-kube-api-access-t7lxh\") pod \"payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj\" (UID: \"3a7ae857-7728-4934-b57c-8c57c687ba17\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj" Sep 15 21:39:38.522799 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.522762 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c" Sep 15 21:39:38.583630 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.583337 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj" Sep 15 21:39:38.665569 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.665537 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:38.794705 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.794677 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c"] Sep 15 21:39:38.795747 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:39:38.795722 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47ace233_bc09_435d_b03f_dd19ed22d010.slice/crio-07c2e49432a0959f639680a7652f796817a7c3a6f089fa80641105379c2ed3a3 WatchSource:0}: Error finding container 07c2e49432a0959f639680a7652f796817a7c3a6f089fa80641105379c2ed3a3: Status 404 returned error can't find the container with id 07c2e49432a0959f639680a7652f796817a7c3a6f089fa80641105379c2ed3a3 Sep 15 21:39:38.874983 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:38.874958 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj"] Sep 15 21:39:38.877352 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:39:38.877327 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a7ae857_7728_4934_b57c_8c57c687ba17.slice/crio-3721bc0eebb84bf2d258547df28a8b6efd69c914a217d5f3c817d8813c84260b WatchSource:0}: Error finding container 3721bc0eebb84bf2d258547df28a8b6efd69c914a217d5f3c817d8813c84260b: Status 404 returned error can't find the container with id 3721bc0eebb84bf2d258547df28a8b6efd69c914a217d5f3c817d8813c84260b Sep 15 21:39:39.058974 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:39.058882 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj" event={"ID":"3a7ae857-7728-4934-b57c-8c57c687ba17","Type":"ContainerStarted","Data":"4fe08582905f364f45f022f1eaacdccf0e98ad0318f4f00e90f007bf51eb6c60"} Sep 15 21:39:39.058974 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:39.058946 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj" event={"ID":"3a7ae857-7728-4934-b57c-8c57c687ba17","Type":"ContainerStarted","Data":"3721bc0eebb84bf2d258547df28a8b6efd69c914a217d5f3c817d8813c84260b"} Sep 15 21:39:39.059206 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:39.059007 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj" Sep 15 21:39:39.060546 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:39.060523 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c" event={"ID":"47ace233-bc09-435d-b03f-dd19ed22d010","Type":"ContainerStarted","Data":"5330bea6dbd3c73c9625c6c7d04e353e4ea460a0943ec25a4838e9c2e17a0807"} Sep 15 21:39:39.060710 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:39.060565 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c" event={"ID":"47ace233-bc09-435d-b03f-dd19ed22d010","Type":"ContainerStarted","Data":"07c2e49432a0959f639680a7652f796817a7c3a6f089fa80641105379c2ed3a3"} Sep 15 21:39:39.060710 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:39.060611 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c" Sep 15 21:39:39.077171 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:39.077119 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj" podStartSLOduration=1.0771045830000001 podStartE2EDuration="1.077104583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:39:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:39:39.074631404 +0000 UTC m=+833.661228995" watchObservedRunningTime="2026-09-15 21:39:39.077104583 +0000 UTC m=+833.663702175" Sep 15 21:39:39.093950 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:39.093890 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c" podStartSLOduration=1.093870115 podStartE2EDuration="1.093870115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:39:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:39:39.092909689 +0000 UTC m=+833.679507282" watchObservedRunningTime="2026-09-15 21:39:39.093870115 +0000 UTC m=+833.680467700" Sep 15 21:39:39.104596 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:39.104565 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:39.206633 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:39.206590 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:39.317055 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:39.316967 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:39.419688 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:39.419650 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:39.635806 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:39.635719 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:39.739523 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:39.739465 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:39.835180 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:39.835141 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:40.076865 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.076817 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n"] Sep 15 21:39:40.080271 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.080251 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.083026 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.083003 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-5416b7-openshift-default-dockercfg-h2m46\"" Sep 15 21:39:40.096018 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.095989 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n"] Sep 15 21:39:40.098469 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.098441 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:40.152095 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.152059 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-credential-socket\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.152266 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.152251 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-istio-data\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.152314 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.152283 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c597d73-2bb8-4114-8bf3-8e62707df599-istiod-ca-cert\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.152370 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.152311 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c597d73-2bb8-4114-8bf3-8e62707df599-istio-token\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.152431 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.152375 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-workload-certs\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.152504 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.152488 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-workload-socket\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.152552 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.152532 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-istio-envoy\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.152601 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.152564 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb7rt\" (UniqueName: \"kubernetes.io/projected/3c597d73-2bb8-4114-8bf3-8e62707df599-kube-api-access-nb7rt\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.152660 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.152611 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c597d73-2bb8-4114-8bf3-8e62707df599-istio-podinfo\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.248886 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.248825 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:40.253881 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.253838 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-istio-data\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.253979 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.253894 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c597d73-2bb8-4114-8bf3-8e62707df599-istiod-ca-cert\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.253979 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.253914 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c597d73-2bb8-4114-8bf3-8e62707df599-istio-token\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.253979 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.253939 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-workload-certs\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.254147 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.253986 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-workload-socket\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.254147 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.254018 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-istio-envoy\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.254147 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.254041 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb7rt\" (UniqueName: \"kubernetes.io/projected/3c597d73-2bb8-4114-8bf3-8e62707df599-kube-api-access-nb7rt\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.254147 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.254067 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c597d73-2bb8-4114-8bf3-8e62707df599-istio-podinfo\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.254147 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.254107 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-credential-socket\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.254646 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.254363 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-istio-data\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.254646 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.254421 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-workload-certs\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.254646 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.254506 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-workload-socket\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.254646 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.254634 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-credential-socket\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.254808 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.254716 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c597d73-2bb8-4114-8bf3-8e62707df599-istiod-ca-cert\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.256323 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.256303 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-istio-envoy\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.256652 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.256632 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c597d73-2bb8-4114-8bf3-8e62707df599-istio-podinfo\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.263036 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.263006 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c597d73-2bb8-4114-8bf3-8e62707df599-istio-token\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.263266 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.263247 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb7rt\" (UniqueName: \"kubernetes.io/projected/3c597d73-2bb8-4114-8bf3-8e62707df599-kube-api-access-nb7rt\") pod \"e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.350204 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.350093 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:40.392231 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.392195 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:40.667566 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.667521 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n"] Sep 15 21:39:40.669079 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:39:40.669050 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c597d73_2bb8_4114_8bf3_8e62707df599.slice/crio-ca42c249bd045e905e240f363ab9f84aeaa15f2d7274383572be4a03d82f696e WatchSource:0}: Error finding container ca42c249bd045e905e240f363ab9f84aeaa15f2d7274383572be4a03d82f696e: Status 404 returned error can't find the container with id ca42c249bd045e905e240f363ab9f84aeaa15f2d7274383572be4a03d82f696e Sep 15 21:39:40.671911 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.671871 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:39:40.672035 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.671957 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:39:40.672035 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:40.672001 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:39:41.074943 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:41.074906 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" event={"ID":"3c597d73-2bb8-4114-8bf3-8e62707df599","Type":"ContainerStarted","Data":"044f7e1c3f34b3fb0c1f19905ad210aaf23923f85acbc3f21e750587f5c8828b"} Sep 15 21:39:41.075340 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:41.074966 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" event={"ID":"3c597d73-2bb8-4114-8bf3-8e62707df599","Type":"ContainerStarted","Data":"ca42c249bd045e905e240f363ab9f84aeaa15f2d7274383572be4a03d82f696e"} Sep 15 21:39:41.097546 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:41.097497 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" podStartSLOduration=1.097480518 podStartE2EDuration="1.097480518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:39:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:39:41.095038683 +0000 UTC m=+835.681636276" watchObservedRunningTime="2026-09-15 21:39:41.097480518 +0000 UTC m=+835.684078186" Sep 15 21:39:41.392893 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:41.392782 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:41.398031 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:41.398003 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:42.080978 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:42.080950 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:42.082122 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:42.082104 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:39:42.998625 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:42.998556 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:43.359704 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:43.359552 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:43.523303 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:43.523267 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:44.260863 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:44.260806 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:44.998088 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:44.997997 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:45.094943 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:45.094873 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:45.196104 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:45.196072 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:45.999869 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:45.999339 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:46.093872 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:46.093338 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:46.192667 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:46.192622 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:46.522434 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:46.522394 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:46.622130 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:46.622090 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:46.961979 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:46.961881 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:47.062841 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:47.062804 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:47.208039 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:47.208000 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:47.434002 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:47.433964 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:47.524153 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:47.524107 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:47.961255 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:47.961219 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:48.057150 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:48.057118 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp" Sep 15 21:39:48.705730 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:48.705632 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:48.798310 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:48.798265 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:48.862186 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:48.862149 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:49.037393 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.037349 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:49.279940 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.279813 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:49.364831 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.364796 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt"] Sep 15 21:39:49.370553 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.370524 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.375018 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.374794 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-a2d9c4-openshift-default-dockercfg-xpgnt\"" Sep 15 21:39:49.386785 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.386439 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt"] Sep 15 21:39:49.393259 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.393227 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:49.400050 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.398327 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cd63baa-d66d-420c-b239-a845375496ee-istio-podinfo\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.400050 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.398394 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-workload-socket\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.400050 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.398457 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cd63baa-d66d-420c-b239-a845375496ee-istio-token\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.400050 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.398555 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-istio-data\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.400050 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.398635 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn2j8\" (UniqueName: \"kubernetes.io/projected/8cd63baa-d66d-420c-b239-a845375496ee-kube-api-access-wn2j8\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.400050 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.398695 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-istio-envoy\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.400050 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.398772 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-workload-certs\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.400050 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.398885 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cd63baa-d66d-420c-b239-a845375496ee-istiod-ca-cert\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.400050 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.398929 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-credential-socket\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.500116 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.500076 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-istio-data\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.500334 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.500140 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn2j8\" (UniqueName: \"kubernetes.io/projected/8cd63baa-d66d-420c-b239-a845375496ee-kube-api-access-wn2j8\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.500334 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.500185 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-istio-envoy\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.500334 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.500227 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-workload-certs\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.500334 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.500299 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cd63baa-d66d-420c-b239-a845375496ee-istiod-ca-cert\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.500595 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.500345 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-credential-socket\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.500595 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.500383 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cd63baa-d66d-420c-b239-a845375496ee-istio-podinfo\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.500595 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.500436 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-workload-socket\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.500595 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.500536 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cd63baa-d66d-420c-b239-a845375496ee-istio-token\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.502005 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.501921 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:49.502373 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.502344 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-istio-data\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.502640 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.502616 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-credential-socket\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.502803 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.502780 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cd63baa-d66d-420c-b239-a845375496ee-istiod-ca-cert\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.504889 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.504820 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-workload-certs\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.505146 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.505122 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-workload-socket\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.505963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.505891 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cd63baa-d66d-420c-b239-a845375496ee-istio-podinfo\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.506064 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.506014 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-istio-envoy\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.510213 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.510187 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cd63baa-d66d-420c-b239-a845375496ee-istio-token\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.510618 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.510601 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn2j8\" (UniqueName: \"kubernetes.io/projected/8cd63baa-d66d-420c-b239-a845375496ee-kube-api-access-wn2j8\") pod \"e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.618087 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.617825 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:49.694073 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.694024 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:49.777520 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:49.777362 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:50.006131 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:50.006094 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt"] Sep 15 21:39:50.008837 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:39:50.008787 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cd63baa_d66d_420c_b239_a845375496ee.slice/crio-c5431801dfc5c614d5ab3bf135daac6774055dba585ce2363bd0302b226fc409 WatchSource:0}: Error finding container c5431801dfc5c614d5ab3bf135daac6774055dba585ce2363bd0302b226fc409: Status 404 returned error can't find the container with id c5431801dfc5c614d5ab3bf135daac6774055dba585ce2363bd0302b226fc409 Sep 15 21:39:50.012452 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:50.012390 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:39:50.012576 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:50.012476 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:39:50.012576 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:50.012520 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:39:50.069397 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:50.069364 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c" Sep 15 21:39:50.070268 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:50.070014 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj" Sep 15 21:39:50.178031 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:50.177839 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" event={"ID":"8cd63baa-d66d-420c-b239-a845375496ee","Type":"ContainerStarted","Data":"2dfd1aebea2e6e9ebeb765ccc1d2af55c91426923a2e8b4ffda07ebeaaa02af1"} Sep 15 21:39:50.178031 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:50.177961 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" event={"ID":"8cd63baa-d66d-420c-b239-a845375496ee","Type":"ContainerStarted","Data":"c5431801dfc5c614d5ab3bf135daac6774055dba585ce2363bd0302b226fc409"} Sep 15 21:39:50.199216 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:50.199149 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" podStartSLOduration=1.19912638 podStartE2EDuration="1.19912638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:39:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:39:50.198331921 +0000 UTC m=+844.784929518" watchObservedRunningTime="2026-09-15 21:39:50.19912638 +0000 UTC m=+844.785723973" Sep 15 21:39:50.578093 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:50.578015 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:50.694653 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:50.694609 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:51.427638 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:51.427602 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:51.528601 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:51.528558 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:51.662918 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:51.662876 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:51.701051 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:51.700953 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:51.755582 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:51.755539 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:51.854773 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:51.854736 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:52.155332 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:52.155300 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:53.506812 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:52.191377 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:53.506812 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:52.192444 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:39:53.506812 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:52.246627 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:53.506812 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:52.346350 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:53.506812 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:53.110969 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:53.506812 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:53.495436 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:53.857425 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:53.857321 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:54.208673 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:54.208585 2573 generic.go:356] "Generic (PLEG): container finished" podID="bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" containerID="9e495a94682e7c275b79f86687022cb141eacfd0f6c82d5eaeac3fbc9a45d955" exitCode=0 Sep 15 21:39:54.208858 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:54.208666 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" event={"ID":"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056","Type":"ContainerDied","Data":"9e495a94682e7c275b79f86687022cb141eacfd0f6c82d5eaeac3fbc9a45d955"} Sep 15 21:39:54.209277 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:54.209240 2573 scope.go:117] "RemoveContainer" containerID="9e495a94682e7c275b79f86687022cb141eacfd0f6c82d5eaeac3fbc9a45d955" Sep 15 21:39:54.210698 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:54.210668 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:39:54.210800 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:54.210772 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:39:54.210896 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:54.210823 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:39:54.211572 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:54.211188 2573 generic.go:356] "Generic (PLEG): container finished" podID="16094ec4-2589-412c-80bc-dd53b7a91b38" containerID="c52c2135387331876ae6528c430636986a4b4499ccf394a5373c0d466a00a451" exitCode=0 Sep 15 21:39:54.211572 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:54.211271 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" event={"ID":"16094ec4-2589-412c-80bc-dd53b7a91b38","Type":"ContainerDied","Data":"c52c2135387331876ae6528c430636986a4b4499ccf394a5373c0d466a00a451"} Sep 15 21:39:54.211797 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:54.211707 2573 scope.go:117] "RemoveContainer" containerID="c52c2135387331876ae6528c430636986a4b4499ccf394a5373c0d466a00a451" Sep 15 21:39:54.213115 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:54.213081 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:39:54.213214 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:54.213180 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:39:54.213274 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:54.213228 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:39:54.217702 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:54.217010 2573 generic.go:356] "Generic (PLEG): container finished" podID="461c3497-1851-48ea-acdd-9cf97c9ea1a8" containerID="2bb8714ea7b170d943b6c7c77059c05bf9a1ed263c14bc7806f5a15b4d9e0ee5" exitCode=0 Sep 15 21:39:54.217806 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:54.217754 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" event={"ID":"461c3497-1851-48ea-acdd-9cf97c9ea1a8","Type":"ContainerDied","Data":"2bb8714ea7b170d943b6c7c77059c05bf9a1ed263c14bc7806f5a15b4d9e0ee5"} Sep 15 21:39:54.218196 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:54.218168 2573 scope.go:117] "RemoveContainer" containerID="2bb8714ea7b170d943b6c7c77059c05bf9a1ed263c14bc7806f5a15b4d9e0ee5" Sep 15 21:39:54.220664 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:54.220633 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:39:54.221133 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:54.220746 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:39:54.221133 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:54.220800 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:39:54.310370 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:54.310342 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:54.411789 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:54.411560 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:54.517464 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:54.517427 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:55.191870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:55.191569 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:55.232320 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:55.232276 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" event={"ID":"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056","Type":"ContainerStarted","Data":"d9ff27db5005a2c9c82ea5878b2b586ff1ec8cf74a656f43d44f4bb09455f054"} Sep 15 21:39:55.235895 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:55.235859 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" event={"ID":"16094ec4-2589-412c-80bc-dd53b7a91b38","Type":"ContainerStarted","Data":"fcbdd3f0abb2e6c3ea6314a7c097a96621f2a9ba1e0211a6a557bc2510f51414"} Sep 15 21:39:55.240550 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:55.239740 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" event={"ID":"461c3497-1851-48ea-acdd-9cf97c9ea1a8","Type":"ContainerStarted","Data":"a6f8608e01c99caa23eb63fdd4b33a150f0944654c91bf3268ce355e4ff8dae4"} Sep 15 21:39:55.262692 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:55.262657 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:55.333883 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:55.331543 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:55.643577 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:55.643543 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:55.653392 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:55.653354 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:39:55.653779 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:55.653756 2573 patch_prober.go:28] interesting pod/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Sep 15 21:39:55.653980 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:55.653957 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" podUID="461c3497-1851-48ea-acdd-9cf97c9ea1a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Sep 15 21:39:55.718388 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:55.718347 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:39:55.718772 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:55.718735 2573 patch_prober.go:28] interesting pod/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Sep 15 21:39:55.718979 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:55.718943 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" podUID="bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Sep 15 21:39:55.732936 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:55.732902 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:55.773924 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:55.773885 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv"] Sep 15 21:39:55.776578 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:55.776545 2573 patch_prober.go:28] interesting pod/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Sep 15 21:39:55.777339 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:55.777309 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" podUID="16094ec4-2589-412c-80bc-dd53b7a91b38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Sep 15 21:39:55.783077 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:55.783050 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:39:55.784931 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:55.783344 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv" Sep 15 21:39:55.789600 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:55.789570 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-a2d9c4-dockercfg-r9cqn\"" Sep 15 21:39:55.789899 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:55.789880 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-a2d9c4\"" Sep 15 21:39:55.790123 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:55.790104 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv"] Sep 15 21:39:55.918937 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:55.905443 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv\" (UID: \"3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170\") " pod="openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv" Sep 15 21:39:55.918937 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:55.905496 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft8zw\" (UniqueName: \"kubernetes.io/projected/3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170-kube-api-access-ft8zw\") pod \"payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv\" (UID: \"3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170\") " pod="openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv" Sep 15 21:39:56.007778 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:56.007493 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv\" (UID: \"3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170\") " pod="openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv" Sep 15 21:39:56.007778 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:56.007549 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft8zw\" (UniqueName: \"kubernetes.io/projected/3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170-kube-api-access-ft8zw\") pod \"payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv\" (UID: \"3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170\") " pod="openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv" Sep 15 21:39:56.010914 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:56.009500 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv\" (UID: \"3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170\") " pod="openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv" Sep 15 21:39:56.032872 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:56.031595 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft8zw\" (UniqueName: \"kubernetes.io/projected/3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170-kube-api-access-ft8zw\") pod \"payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv\" (UID: \"3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170\") " pod="openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv" Sep 15 21:39:56.112411 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:56.110982 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv" Sep 15 21:39:56.184931 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:56.177338 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:56.658244 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:56.655184 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv"] Sep 15 21:39:56.658244 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:56.655799 2573 patch_prober.go:28] interesting pod/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Sep 15 21:39:56.658244 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:56.655874 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" podUID="461c3497-1851-48ea-acdd-9cf97c9ea1a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Sep 15 21:39:56.716714 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:56.716079 2573 patch_prober.go:28] interesting pod/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Sep 15 21:39:56.716714 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:56.716137 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" podUID="bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Sep 15 21:39:56.776825 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:56.776778 2573 patch_prober.go:28] interesting pod/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Sep 15 21:39:56.777116 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:56.777075 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" podUID="16094ec4-2589-412c-80bc-dd53b7a91b38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Sep 15 21:39:56.862721 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:56.862669 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:57.261637 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:57.261596 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv" event={"ID":"3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170","Type":"ContainerStarted","Data":"91ad4711a76024c7eecb131629c0cfc5b28f5a4850edfcd643874cb34caed522"} Sep 15 21:39:57.261870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:57.261674 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv" event={"ID":"3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170","Type":"ContainerStarted","Data":"7334e99e6a27043c45b0fc55dd17329148713cdb51c70736b07f2bff2d983f57"} Sep 15 21:39:57.262571 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:57.262545 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv" Sep 15 21:39:57.281343 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:57.281280 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv" podStartSLOduration=2.281258532 podStartE2EDuration="2.281258532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:39:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:39:57.277982889 +0000 UTC m=+851.864580482" watchObservedRunningTime="2026-09-15 21:39:57.281258532 +0000 UTC m=+851.867856129" Sep 15 21:39:57.507949 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:57.507906 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:57.650137 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:57.650040 2573 patch_prober.go:28] interesting pod/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Sep 15 21:39:57.650397 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:57.650368 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" podUID="461c3497-1851-48ea-acdd-9cf97c9ea1a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Sep 15 21:39:57.714024 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:57.713983 2573 patch_prober.go:28] interesting pod/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Sep 15 21:39:57.714530 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:57.714063 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" podUID="bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Sep 15 21:39:57.776553 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:57.776507 2573 patch_prober.go:28] interesting pod/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Sep 15 21:39:57.776876 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:57.776810 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" podUID="16094ec4-2589-412c-80bc-dd53b7a91b38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Sep 15 21:39:58.363944 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:58.363810 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:58.650263 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:58.650157 2573 patch_prober.go:28] interesting pod/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Sep 15 21:39:58.650529 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:58.650498 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" podUID="461c3497-1851-48ea-acdd-9cf97c9ea1a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Sep 15 21:39:58.717877 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:58.717547 2573 patch_prober.go:28] interesting pod/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Sep 15 21:39:58.717877 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:58.717611 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" podUID="bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Sep 15 21:39:58.776867 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:58.776440 2573 patch_prober.go:28] interesting pod/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Sep 15 21:39:58.776867 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:58.776517 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" podUID="16094ec4-2589-412c-80bc-dd53b7a91b38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Sep 15 21:39:59.076962 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:59.076926 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:59.613666 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:59.613613 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:59.650369 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:59.649841 2573 patch_prober.go:28] interesting pod/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Sep 15 21:39:59.650369 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:59.649935 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" podUID="461c3497-1851-48ea-acdd-9cf97c9ea1a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Sep 15 21:39:59.692641 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:59.692613 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:59.715460 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:59.715425 2573 patch_prober.go:28] interesting pod/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Sep 15 21:39:59.715794 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:59.715745 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" podUID="bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Sep 15 21:39:59.776402 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:59.776366 2573 patch_prober.go:28] interesting pod/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Sep 15 21:39:59.777051 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:59.777002 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" podUID="16094ec4-2589-412c-80bc-dd53b7a91b38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Sep 15 21:39:59.797050 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:59.797004 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:39:59.968776 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:39:59.968743 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:00.650232 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:00.649725 2573 patch_prober.go:28] interesting pod/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Sep 15 21:40:00.650232 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:00.649793 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" podUID="461c3497-1851-48ea-acdd-9cf97c9ea1a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Sep 15 21:40:00.714625 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:00.714585 2573 patch_prober.go:28] interesting pod/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Sep 15 21:40:00.714974 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:00.714939 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" podUID="bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Sep 15 21:40:00.735107 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:00.735076 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:00.776271 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:00.776234 2573 patch_prober.go:28] interesting pod/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Sep 15 21:40:00.776564 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:00.776522 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" podUID="16094ec4-2589-412c-80bc-dd53b7a91b38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Sep 15 21:40:01.470682 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:01.470647 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:01.720554 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:01.720519 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:40:01.721241 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:01.721161 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:40:01.722519 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:01.722499 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:40:01.797366 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:01.797326 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:40:01.799560 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:01.799541 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:40:01.803105 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:01.803087 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:40:01.815877 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:01.814695 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:40:01.815877 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:01.815833 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:40:01.819590 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:01.819251 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:40:02.125166 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:02.125066 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:02.983765 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:02.983733 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:03.100567 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:03.100529 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:03.654619 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:03.654580 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:04.647445 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:04.647412 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:05.358881 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:05.358838 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:05.941581 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:05.941475 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:06.061011 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:06.060972 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:06.141823 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:06.141782 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:06.355864 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:06.355820 2573 generic.go:356] "Generic (PLEG): container finished" podID="3c597d73-2bb8-4114-8bf3-8e62707df599" containerID="044f7e1c3f34b3fb0c1f19905ad210aaf23923f85acbc3f21e750587f5c8828b" exitCode=0 Sep 15 21:40:06.356057 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:06.355898 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" event={"ID":"3c597d73-2bb8-4114-8bf3-8e62707df599","Type":"ContainerDied","Data":"044f7e1c3f34b3fb0c1f19905ad210aaf23923f85acbc3f21e750587f5c8828b"} Sep 15 21:40:06.356354 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:06.356336 2573 scope.go:117] "RemoveContainer" containerID="044f7e1c3f34b3fb0c1f19905ad210aaf23923f85acbc3f21e750587f5c8828b" Sep 15 21:40:06.357529 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:06.357494 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:40:06.357607 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:06.357569 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:40:06.357646 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:06.357627 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:40:06.475662 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:06.475625 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:06.780475 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:06.780440 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:07.294739 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:07.294705 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:07.369654 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:07.369609 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" event={"ID":"3c597d73-2bb8-4114-8bf3-8e62707df599","Type":"ContainerStarted","Data":"ee4fbc2f863f7a424bc508db4bec1c7c5bd77d5428a9aa2525566651e40d4aae"} Sep 15 21:40:07.392942 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:07.392906 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:40:07.393149 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:07.393079 2573 patch_prober.go:28] interesting pod/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Sep 15 21:40:07.393149 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:07.393138 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" podUID="3c597d73-2bb8-4114-8bf3-8e62707df599" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Sep 15 21:40:07.475744 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:07.475702 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:08.169068 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:08.169034 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:08.393807 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:08.393760 2573 patch_prober.go:28] interesting pod/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Sep 15 21:40:08.394322 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:08.393837 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" podUID="3c597d73-2bb8-4114-8bf3-8e62707df599" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Sep 15 21:40:08.974991 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:08.974951 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:09.284124 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:09.284035 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv" Sep 15 21:40:09.393168 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:09.393136 2573 patch_prober.go:28] interesting pod/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Sep 15 21:40:09.393431 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:09.393404 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" podUID="3c597d73-2bb8-4114-8bf3-8e62707df599" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Sep 15 21:40:09.710078 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:09.709977 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:10.392966 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:10.392921 2573 patch_prober.go:28] interesting pod/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Sep 15 21:40:10.393189 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:10.392992 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" podUID="3c597d73-2bb8-4114-8bf3-8e62707df599" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Sep 15 21:40:10.469154 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:10.469114 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:11.042331 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:11.042258 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:11.131953 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:11.131915 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:11.211331 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:11.211299 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:11.400520 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:11.400422 2573 patch_prober.go:28] interesting pod/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Sep 15 21:40:11.400800 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:11.400753 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" podUID="3c597d73-2bb8-4114-8bf3-8e62707df599" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Sep 15 21:40:11.428480 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:11.428441 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:11.618951 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:11.618912 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:11.719149 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:11.719105 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:11.825912 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:11.825758 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:11.926510 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:11.926472 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:12.026044 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:12.025954 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:12.080932 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:12.080894 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:40:12.335915 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:12.335797 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:12.393681 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:12.393646 2573 patch_prober.go:28] interesting pod/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Sep 15 21:40:12.393985 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:12.393955 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" podUID="3c597d73-2bb8-4114-8bf3-8e62707df599" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Sep 15 21:40:12.521139 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:12.521100 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:12.791701 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:12.791664 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:12.890110 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:12.890074 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:13.052058 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:13.051958 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:13.210621 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:13.210589 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:13.397502 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:13.397415 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:40:13.398530 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:13.398509 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:40:13.865512 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:13.865474 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:14.666741 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:14.666708 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:15.437194 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:15.437156 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:15.541289 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:15.541255 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:15.642535 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:15.642489 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:16.402999 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:16.402944 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:16.461760 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:16.461677 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:16.463669 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:16.463646 2573 generic.go:356] "Generic (PLEG): container finished" podID="8cd63baa-d66d-420c-b239-a845375496ee" containerID="2dfd1aebea2e6e9ebeb765ccc1d2af55c91426923a2e8b4ffda07ebeaaa02af1" exitCode=0 Sep 15 21:40:16.463791 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:16.463723 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" event={"ID":"8cd63baa-d66d-420c-b239-a845375496ee","Type":"ContainerDied","Data":"2dfd1aebea2e6e9ebeb765ccc1d2af55c91426923a2e8b4ffda07ebeaaa02af1"} Sep 15 21:40:16.464181 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:16.464163 2573 scope.go:117] "RemoveContainer" containerID="2dfd1aebea2e6e9ebeb765ccc1d2af55c91426923a2e8b4ffda07ebeaaa02af1" Sep 15 21:40:16.465298 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:16.465266 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:40:16.465362 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:16.465342 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:40:16.465400 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:16.465376 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:40:16.561501 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:16.561468 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:16.948223 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:16.948136 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:17.013519 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:17.013485 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:17.387299 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:17.387257 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:17.471442 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:17.471408 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" event={"ID":"8cd63baa-d66d-420c-b239-a845375496ee","Type":"ContainerStarted","Data":"706394a76cb57e357c83ee3c48c7649c0da6ad265c306dd34aad098373f48d83"} Sep 15 21:40:17.695285 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:17.695191 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:40:17.696589 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:17.696556 2573 patch_prober.go:28] interesting pod/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Sep 15 21:40:17.696721 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:17.696621 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" podUID="8cd63baa-d66d-420c-b239-a845375496ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Sep 15 21:40:18.062089 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:18.062051 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:18.683980 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:18.683938 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:18.694780 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:18.694745 2573 patch_prober.go:28] interesting pod/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Sep 15 21:40:18.694956 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:18.694796 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" podUID="8cd63baa-d66d-420c-b239-a845375496ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Sep 15 21:40:19.354146 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:19.354119 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:19.695623 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:19.695530 2573 patch_prober.go:28] interesting pod/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Sep 15 21:40:19.696099 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:19.695612 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" podUID="8cd63baa-d66d-420c-b239-a845375496ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Sep 15 21:40:20.069904 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:20.069864 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:20.695234 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:20.695196 2573 patch_prober.go:28] interesting pod/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Sep 15 21:40:20.695438 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:20.695259 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" podUID="8cd63baa-d66d-420c-b239-a845375496ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Sep 15 21:40:21.695215 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:21.695179 2573 patch_prober.go:28] interesting pod/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Sep 15 21:40:21.695579 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:21.695231 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" podUID="8cd63baa-d66d-420c-b239-a845375496ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Sep 15 21:40:22.191604 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:22.191566 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:40:22.694941 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:22.694890 2573 patch_prober.go:28] interesting pod/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Sep 15 21:40:22.695114 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:22.694973 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" podUID="8cd63baa-d66d-420c-b239-a845375496ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Sep 15 21:40:23.699044 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:23.699014 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:40:23.700035 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:23.700012 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:40:38.365475 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:38.365391 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:39.120161 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:39.120123 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:39.862681 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:39.862637 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:40.771323 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:40.771291 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:41.421455 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:41.421420 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:42.150427 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:42.150392 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:42.773391 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:42.773358 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:43.465433 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:43.465382 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:44.257346 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:44.257308 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:44.897283 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:44.897249 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:45.894256 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:45.894217 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/1.log" Sep 15 21:40:45.897032 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:45.896998 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/1.log" Sep 15 21:40:45.953249 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:45.953209 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:46.331450 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:46.331415 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:46.661802 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:46.661725 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:46.727491 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:46.727456 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:46.828291 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:46.828260 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:46.886511 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:46.886473 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:47.017141 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:47.017107 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:47.270170 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:47.270077 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:47.465314 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:47.465282 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:47.774591 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:47.774557 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:47.874260 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:47.874221 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:48.056291 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:48.056203 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:48.825533 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:48.825480 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:49.643792 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:49.643756 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:50.458445 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:50.458413 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:50.556730 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:50.556693 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:51.264644 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:51.264610 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:52.165929 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:52.165893 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:52.267868 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:52.267796 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:52.397833 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:52.397792 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:52.643605 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:52.643569 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:52.741841 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:52.741804 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:53.063412 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:53.063372 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:53.761173 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:53.761138 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:54.549341 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:54.549303 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:55.201473 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:55.201438 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:40:55.856021 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:40:55.855985 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:01.722368 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:01.722326 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:01.775384 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:01.775352 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:14.030678 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:14.030644 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:15.441524 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:15.441484 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:16.139208 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:16.139128 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:16.883269 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:16.883237 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:17.223207 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:17.223178 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:17.873788 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:17.873749 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:18.384794 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:18.384765 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:19.037738 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:19.037691 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:19.769622 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:19.769581 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:20.458840 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:20.458802 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:21.086644 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:21.086609 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:21.699393 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:21.699363 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:21.768313 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:21.768275 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:21.865569 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:21.865532 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:21.924917 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:21.924881 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:22.259284 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:22.259251 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:22.959539 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:22.959505 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:23.079043 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:23.079011 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:23.515938 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:23.515908 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:23.653416 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:23.653355 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:23.839557 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:23.839467 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:24.150333 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:24.150242 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:24.724236 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:24.724190 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:25.376284 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:25.376253 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:26.052772 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:26.052735 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:26.750195 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:26.750149 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:27.322457 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:27.322419 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:27.411748 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:27.411717 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:27.576690 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:27.576599 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:28.281867 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:28.281798 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:29.237253 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:29.237224 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:29.882134 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:29.882090 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:30.526327 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:30.526291 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:31.339485 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:31.339452 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:31.442083 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:31.442047 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:31.802174 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:31.802131 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:31.866487 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:31.866455 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:31.942360 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:31.942318 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:33.879680 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:33.879649 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:41.039081 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:41.039043 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:52.230574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:52.230541 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:53.429115 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:53.429084 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:54.168605 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:54.168565 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:55.051474 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:55.051440 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:55.173300 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:55.173259 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:55.456454 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:55.456360 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:56.264636 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:56.264600 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:56.947754 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:56.947722 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:58.056628 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:58.056593 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:58.795248 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:58.795206 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:41:59.453237 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:41:59.453202 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:00.263615 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:00.263578 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:01.398701 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:01.398657 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:01.669810 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:01.669713 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:02.360806 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:02.360775 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:07.162323 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:07.162288 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:08.854642 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:08.854557 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:09.066262 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:09.066220 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:09.680195 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:09.680157 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:10.378945 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:10.378902 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:11.161251 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:11.161215 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:11.845815 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:11.845773 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:12.633661 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:12.633629 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:13.361273 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:13.361234 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:13.906722 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:13.906690 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:13.971420 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:13.971381 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:14.072348 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:14.072314 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:14.137742 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:14.137704 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:14.257793 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:14.257757 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:14.369967 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:14.369914 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:14.588713 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:14.588616 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:14.913304 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:14.913215 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:15.011349 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:15.011314 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:15.111572 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:15.111521 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:15.337376 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:15.337340 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:16.094423 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:16.094383 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:16.511728 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:16.511686 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:16.843393 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:16.843248 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:17.542684 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:17.542650 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:18.191724 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:18.191689 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:19.666161 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:19.666105 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:19.735876 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:19.735809 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:19.792330 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:19.792295 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:19.858376 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:19.858321 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:20.239967 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:20.239932 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:20.341431 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:20.341395 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:20.966090 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:20.966055 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:21.652254 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:21.652221 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:22.360677 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:22.360643 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:22.589790 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:22.589758 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:22.690122 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:22.690030 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:22.818767 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:22.818727 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:22.926786 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:22.926751 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:23.246069 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:23.246029 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:23.346013 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:23.345971 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:26.047307 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:26.047265 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:26.116659 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:26.116625 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:26.301961 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:26.301872 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n"] Sep 15 21:42:26.302195 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:26.302128 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" podUID="3c597d73-2bb8-4114-8bf3-8e62707df599" containerName="istio-proxy" containerID="cri-o://ee4fbc2f863f7a424bc508db4bec1c7c5bd77d5428a9aa2525566651e40d4aae" gracePeriod=30 Sep 15 21:42:26.316905 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:26.316823 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:26.775335 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:26.775303 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:27.084445 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:27.084356 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:27.171558 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:27.171520 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:28.400279 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:28.400246 2573 patch_prober.go:28] interesting pod/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 15 21:42:28.400669 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:28.400313 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" podUID="3c597d73-2bb8-4114-8bf3-8e62707df599" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 15 21:42:29.829278 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:29.829240 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:30.562117 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:30.562078 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:30.665496 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:30.665455 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:30.767806 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:30.767765 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:31.475699 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.475663 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:31.564226 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.564150 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:42:31.727045 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.727008 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-workload-certs\") pod \"3c597d73-2bb8-4114-8bf3-8e62707df599\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " Sep 15 21:42:31.727208 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.727052 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-credential-socket\") pod \"3c597d73-2bb8-4114-8bf3-8e62707df599\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " Sep 15 21:42:31.727208 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.727108 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-istio-envoy\") pod \"3c597d73-2bb8-4114-8bf3-8e62707df599\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " Sep 15 21:42:31.727208 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.727167 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c597d73-2bb8-4114-8bf3-8e62707df599-istio-podinfo\") pod \"3c597d73-2bb8-4114-8bf3-8e62707df599\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " Sep 15 21:42:31.727208 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.727188 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-workload-socket\") pod \"3c597d73-2bb8-4114-8bf3-8e62707df599\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " Sep 15 21:42:31.727439 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.727213 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nb7rt\" (UniqueName: \"kubernetes.io/projected/3c597d73-2bb8-4114-8bf3-8e62707df599-kube-api-access-nb7rt\") pod \"3c597d73-2bb8-4114-8bf3-8e62707df599\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " Sep 15 21:42:31.727439 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.727255 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c597d73-2bb8-4114-8bf3-8e62707df599-istiod-ca-cert\") pod \"3c597d73-2bb8-4114-8bf3-8e62707df599\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " Sep 15 21:42:31.727439 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.727285 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c597d73-2bb8-4114-8bf3-8e62707df599-istio-token\") pod \"3c597d73-2bb8-4114-8bf3-8e62707df599\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " Sep 15 21:42:31.727439 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.727296 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3c597d73-2bb8-4114-8bf3-8e62707df599" (UID: "3c597d73-2bb8-4114-8bf3-8e62707df599"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:42:31.727439 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.727349 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-istio-data\") pod \"3c597d73-2bb8-4114-8bf3-8e62707df599\" (UID: \"3c597d73-2bb8-4114-8bf3-8e62707df599\") " Sep 15 21:42:31.727439 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.727378 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3c597d73-2bb8-4114-8bf3-8e62707df599" (UID: "3c597d73-2bb8-4114-8bf3-8e62707df599"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:42:31.727790 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.727504 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3c597d73-2bb8-4114-8bf3-8e62707df599" (UID: "3c597d73-2bb8-4114-8bf3-8e62707df599"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:42:31.727790 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.727627 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c597d73-2bb8-4114-8bf3-8e62707df599-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3c597d73-2bb8-4114-8bf3-8e62707df599" (UID: "3c597d73-2bb8-4114-8bf3-8e62707df599"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:42:31.727790 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.727719 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-istio-data" (OuterVolumeSpecName: "istio-data") pod "3c597d73-2bb8-4114-8bf3-8e62707df599" (UID: "3c597d73-2bb8-4114-8bf3-8e62707df599"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:42:31.727943 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.727867 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-workload-certs\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:42:31.727943 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.727888 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-credential-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:42:31.727943 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.727905 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-workload-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:42:31.727943 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.727918 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c597d73-2bb8-4114-8bf3-8e62707df599-istiod-ca-cert\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:42:31.727943 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.727931 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-istio-data\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:42:31.729542 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.729517 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3c597d73-2bb8-4114-8bf3-8e62707df599" (UID: "3c597d73-2bb8-4114-8bf3-8e62707df599"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:42:31.729679 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.729564 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3c597d73-2bb8-4114-8bf3-8e62707df599-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3c597d73-2bb8-4114-8bf3-8e62707df599" (UID: "3c597d73-2bb8-4114-8bf3-8e62707df599"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 15 21:42:31.729767 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.729751 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c597d73-2bb8-4114-8bf3-8e62707df599-istio-token" (OuterVolumeSpecName: "istio-token") pod "3c597d73-2bb8-4114-8bf3-8e62707df599" (UID: "3c597d73-2bb8-4114-8bf3-8e62707df599"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:42:31.729805 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.729772 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c597d73-2bb8-4114-8bf3-8e62707df599-kube-api-access-nb7rt" (OuterVolumeSpecName: "kube-api-access-nb7rt") pod "3c597d73-2bb8-4114-8bf3-8e62707df599" (UID: "3c597d73-2bb8-4114-8bf3-8e62707df599"). InnerVolumeSpecName "kube-api-access-nb7rt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:42:31.829473 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.829391 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c597d73-2bb8-4114-8bf3-8e62707df599-istio-token\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:42:31.829473 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.829421 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c597d73-2bb8-4114-8bf3-8e62707df599-istio-envoy\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:42:31.829473 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.829430 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c597d73-2bb8-4114-8bf3-8e62707df599-istio-podinfo\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:42:31.829473 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:31.829438 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nb7rt\" (UniqueName: \"kubernetes.io/projected/3c597d73-2bb8-4114-8bf3-8e62707df599-kube-api-access-nb7rt\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:42:32.161932 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:32.161810 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:32.288468 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:32.288428 2573 generic.go:356] "Generic (PLEG): container finished" podID="3c597d73-2bb8-4114-8bf3-8e62707df599" containerID="ee4fbc2f863f7a424bc508db4bec1c7c5bd77d5428a9aa2525566651e40d4aae" exitCode=0 Sep 15 21:42:32.288635 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:32.288493 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" Sep 15 21:42:32.288635 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:32.288506 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" event={"ID":"3c597d73-2bb8-4114-8bf3-8e62707df599","Type":"ContainerDied","Data":"ee4fbc2f863f7a424bc508db4bec1c7c5bd77d5428a9aa2525566651e40d4aae"} Sep 15 21:42:32.288635 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:32.288582 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n" event={"ID":"3c597d73-2bb8-4114-8bf3-8e62707df599","Type":"ContainerDied","Data":"ca42c249bd045e905e240f363ab9f84aeaa15f2d7274383572be4a03d82f696e"} Sep 15 21:42:32.288635 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:32.288604 2573 scope.go:117] "RemoveContainer" containerID="ee4fbc2f863f7a424bc508db4bec1c7c5bd77d5428a9aa2525566651e40d4aae" Sep 15 21:42:32.300347 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:32.300322 2573 scope.go:117] "RemoveContainer" containerID="044f7e1c3f34b3fb0c1f19905ad210aaf23923f85acbc3f21e750587f5c8828b" Sep 15 21:42:32.306868 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:32.306832 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n"] Sep 15 21:42:32.310402 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:32.310381 2573 scope.go:117] "RemoveContainer" containerID="ee4fbc2f863f7a424bc508db4bec1c7c5bd77d5428a9aa2525566651e40d4aae" Sep 15 21:42:32.310715 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:42:32.310696 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee4fbc2f863f7a424bc508db4bec1c7c5bd77d5428a9aa2525566651e40d4aae\": container with ID starting with ee4fbc2f863f7a424bc508db4bec1c7c5bd77d5428a9aa2525566651e40d4aae not found: ID does not exist" containerID="ee4fbc2f863f7a424bc508db4bec1c7c5bd77d5428a9aa2525566651e40d4aae" Sep 15 21:42:32.310789 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:32.310722 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee4fbc2f863f7a424bc508db4bec1c7c5bd77d5428a9aa2525566651e40d4aae"} err="failed to get container status \"ee4fbc2f863f7a424bc508db4bec1c7c5bd77d5428a9aa2525566651e40d4aae\": rpc error: code = NotFound desc = could not find container \"ee4fbc2f863f7a424bc508db4bec1c7c5bd77d5428a9aa2525566651e40d4aae\": container with ID starting with ee4fbc2f863f7a424bc508db4bec1c7c5bd77d5428a9aa2525566651e40d4aae not found: ID does not exist" Sep 15 21:42:32.310789 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:32.310740 2573 scope.go:117] "RemoveContainer" containerID="044f7e1c3f34b3fb0c1f19905ad210aaf23923f85acbc3f21e750587f5c8828b" Sep 15 21:42:32.311037 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:42:32.311021 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"044f7e1c3f34b3fb0c1f19905ad210aaf23923f85acbc3f21e750587f5c8828b\": container with ID starting with 044f7e1c3f34b3fb0c1f19905ad210aaf23923f85acbc3f21e750587f5c8828b not found: ID does not exist" containerID="044f7e1c3f34b3fb0c1f19905ad210aaf23923f85acbc3f21e750587f5c8828b" Sep 15 21:42:32.311116 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:32.311040 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"044f7e1c3f34b3fb0c1f19905ad210aaf23923f85acbc3f21e750587f5c8828b"} err="failed to get container status \"044f7e1c3f34b3fb0c1f19905ad210aaf23923f85acbc3f21e750587f5c8828b\": rpc error: code = NotFound desc = could not find container \"044f7e1c3f34b3fb0c1f19905ad210aaf23923f85acbc3f21e750587f5c8828b\": container with ID starting with 044f7e1c3f34b3fb0c1f19905ad210aaf23923f85acbc3f21e750587f5c8828b not found: ID does not exist" Sep 15 21:42:32.311396 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:32.311379 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n"] Sep 15 21:42:33.008501 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:33.008469 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:33.661801 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:33.661764 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:33.762969 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:33.762914 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:33.933899 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:33.933797 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c597d73-2bb8-4114-8bf3-8e62707df599" path="/var/lib/kubelet/pods/3c597d73-2bb8-4114-8bf3-8e62707df599/volumes" Sep 15 21:42:33.985313 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:33.985277 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:34.110608 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:34.110576 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:34.211533 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:34.211444 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:39.941683 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:39.941650 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:40.042789 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:40.042735 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:49.178247 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:49.178209 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:55.116068 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:55.116014 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:55.223231 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:55.223187 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:55.316641 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:55.316607 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:55.610500 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:55.610472 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:55.710385 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:55.710356 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:56.374750 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:56.374712 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:57.061476 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:57.061435 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:57.843277 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:57.843237 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:58.567016 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:58.566977 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:42:59.180714 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:42:59.180685 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:05.941775 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:05.941744 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:11.162008 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:11.161974 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:16.910806 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:16.910764 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:17.020546 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:17.020497 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:17.111625 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:17.111588 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:21.362582 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:21.362547 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:26.765543 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:26.765506 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:27.618993 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:27.618955 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:28.372890 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:28.372859 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:34.017440 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.017397 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:34.127046 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.127007 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:34.151760 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.151732 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz"] Sep 15 21:43:34.152157 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.152144 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c597d73-2bb8-4114-8bf3-8e62707df599" containerName="istio-proxy" Sep 15 21:43:34.152215 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.152159 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c597d73-2bb8-4114-8bf3-8e62707df599" containerName="istio-proxy" Sep 15 21:43:34.152252 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.152229 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c597d73-2bb8-4114-8bf3-8e62707df599" containerName="istio-proxy" Sep 15 21:43:34.155469 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.155434 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:43:34.158581 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.158558 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a2d9c4\"/\"kube-root-ca.crt\"" Sep 15 21:43:34.158692 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.158558 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a2d9c4\"/\"openshift-service-ca.crt\"" Sep 15 21:43:34.159686 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.159663 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a2d9c4\"/\"default-dockercfg-9x7zs\"" Sep 15 21:43:34.159803 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.159708 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a2d9c4\"/\"test-model-a2d9c4-kserve-self-signed-certs\"" Sep 15 21:43:34.165882 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.165834 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz"] Sep 15 21:43:34.217748 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.217713 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:34.228839 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.228814 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/727c26c8-7f6b-4cbd-b2e3-502407a36324-model-cache\") pod \"test-model-a2d9c4-kserve-5b7b976dbc-xgzvz\" (UID: \"727c26c8-7f6b-4cbd-b2e3-502407a36324\") " pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:43:34.229012 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.228911 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr46c\" (UniqueName: \"kubernetes.io/projected/727c26c8-7f6b-4cbd-b2e3-502407a36324-kube-api-access-pr46c\") pod \"test-model-a2d9c4-kserve-5b7b976dbc-xgzvz\" (UID: \"727c26c8-7f6b-4cbd-b2e3-502407a36324\") " pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:43:34.229012 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.229001 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/727c26c8-7f6b-4cbd-b2e3-502407a36324-tls-certs\") pod \"test-model-a2d9c4-kserve-5b7b976dbc-xgzvz\" (UID: \"727c26c8-7f6b-4cbd-b2e3-502407a36324\") " pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:43:34.229129 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.229040 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/727c26c8-7f6b-4cbd-b2e3-502407a36324-home\") pod \"test-model-a2d9c4-kserve-5b7b976dbc-xgzvz\" (UID: \"727c26c8-7f6b-4cbd-b2e3-502407a36324\") " pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:43:34.229129 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.229112 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/727c26c8-7f6b-4cbd-b2e3-502407a36324-tmp-dir\") pod \"test-model-a2d9c4-kserve-5b7b976dbc-xgzvz\" (UID: \"727c26c8-7f6b-4cbd-b2e3-502407a36324\") " pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:43:34.229215 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.229186 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/727c26c8-7f6b-4cbd-b2e3-502407a36324-dshm\") pod \"test-model-a2d9c4-kserve-5b7b976dbc-xgzvz\" (UID: \"727c26c8-7f6b-4cbd-b2e3-502407a36324\") " pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:43:34.274431 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.274345 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:34.332097 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.332057 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/727c26c8-7f6b-4cbd-b2e3-502407a36324-tls-certs\") pod \"test-model-a2d9c4-kserve-5b7b976dbc-xgzvz\" (UID: \"727c26c8-7f6b-4cbd-b2e3-502407a36324\") " pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:43:34.332302 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.332113 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/727c26c8-7f6b-4cbd-b2e3-502407a36324-home\") pod \"test-model-a2d9c4-kserve-5b7b976dbc-xgzvz\" (UID: \"727c26c8-7f6b-4cbd-b2e3-502407a36324\") " pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:43:34.332302 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.332167 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/727c26c8-7f6b-4cbd-b2e3-502407a36324-tmp-dir\") pod \"test-model-a2d9c4-kserve-5b7b976dbc-xgzvz\" (UID: \"727c26c8-7f6b-4cbd-b2e3-502407a36324\") " pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:43:34.332302 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.332237 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/727c26c8-7f6b-4cbd-b2e3-502407a36324-dshm\") pod \"test-model-a2d9c4-kserve-5b7b976dbc-xgzvz\" (UID: \"727c26c8-7f6b-4cbd-b2e3-502407a36324\") " pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:43:34.332302 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.332271 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/727c26c8-7f6b-4cbd-b2e3-502407a36324-model-cache\") pod \"test-model-a2d9c4-kserve-5b7b976dbc-xgzvz\" (UID: \"727c26c8-7f6b-4cbd-b2e3-502407a36324\") " pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:43:34.332535 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.332311 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr46c\" (UniqueName: \"kubernetes.io/projected/727c26c8-7f6b-4cbd-b2e3-502407a36324-kube-api-access-pr46c\") pod \"test-model-a2d9c4-kserve-5b7b976dbc-xgzvz\" (UID: \"727c26c8-7f6b-4cbd-b2e3-502407a36324\") " pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:43:34.333357 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.333324 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/727c26c8-7f6b-4cbd-b2e3-502407a36324-tmp-dir\") pod \"test-model-a2d9c4-kserve-5b7b976dbc-xgzvz\" (UID: \"727c26c8-7f6b-4cbd-b2e3-502407a36324\") " pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:43:34.333588 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.333564 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/727c26c8-7f6b-4cbd-b2e3-502407a36324-home\") pod \"test-model-a2d9c4-kserve-5b7b976dbc-xgzvz\" (UID: \"727c26c8-7f6b-4cbd-b2e3-502407a36324\") " pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:43:34.334144 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.334120 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/727c26c8-7f6b-4cbd-b2e3-502407a36324-model-cache\") pod \"test-model-a2d9c4-kserve-5b7b976dbc-xgzvz\" (UID: \"727c26c8-7f6b-4cbd-b2e3-502407a36324\") " pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:43:34.337440 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.337414 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/727c26c8-7f6b-4cbd-b2e3-502407a36324-dshm\") pod \"test-model-a2d9c4-kserve-5b7b976dbc-xgzvz\" (UID: \"727c26c8-7f6b-4cbd-b2e3-502407a36324\") " pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:43:34.337946 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.337926 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/727c26c8-7f6b-4cbd-b2e3-502407a36324-tls-certs\") pod \"test-model-a2d9c4-kserve-5b7b976dbc-xgzvz\" (UID: \"727c26c8-7f6b-4cbd-b2e3-502407a36324\") " pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:43:34.341075 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.341044 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr46c\" (UniqueName: \"kubernetes.io/projected/727c26c8-7f6b-4cbd-b2e3-502407a36324-kube-api-access-pr46c\") pod \"test-model-a2d9c4-kserve-5b7b976dbc-xgzvz\" (UID: \"727c26c8-7f6b-4cbd-b2e3-502407a36324\") " pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:43:34.467354 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.467312 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:43:34.741014 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.740978 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz"] Sep 15 21:43:34.742590 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:43:34.742564 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod727c26c8_7f6b_4cbd_b2e3_502407a36324.slice/crio-a606125fbe652b64cb130ff73bb991891c719d906b209b017550a0b678d33720 WatchSource:0}: Error finding container a606125fbe652b64cb130ff73bb991891c719d906b209b017550a0b678d33720: Status 404 returned error can't find the container with id a606125fbe652b64cb130ff73bb991891c719d906b209b017550a0b678d33720 Sep 15 21:43:34.998990 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:34.998904 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:35.079131 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:35.079096 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:35.666754 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:35.666715 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" event={"ID":"727c26c8-7f6b-4cbd-b2e3-502407a36324","Type":"ContainerStarted","Data":"77cb51308eff4e3ef8885bcb5babf7afc997b29d1c8264829994970a23778241"} Sep 15 21:43:35.666754 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:35.666758 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" event={"ID":"727c26c8-7f6b-4cbd-b2e3-502407a36324","Type":"ContainerStarted","Data":"a606125fbe652b64cb130ff73bb991891c719d906b209b017550a0b678d33720"} Sep 15 21:43:35.685516 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:35.685468 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" podStartSLOduration=1.685453215 podStartE2EDuration="1.685453215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:43:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:43:35.684091466 +0000 UTC m=+1070.270689059" watchObservedRunningTime="2026-09-15 21:43:35.685453215 +0000 UTC m=+1070.272050807" Sep 15 21:43:36.564101 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:36.564070 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:42.944423 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:42.944315 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:43.007284 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:43.007227 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:43.595528 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:43.595491 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:44.467733 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:44.467695 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:43:44.468152 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:44.467754 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:43:44.480132 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:44.480103 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:43:44.729792 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:44.729706 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:43:47.854703 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:47.854659 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:49.943462 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:49.943409 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:50.042883 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.042833 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:50.174207 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.174165 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:50.446488 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.446448 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv"] Sep 15 21:43:50.446893 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.446877 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c597d73-2bb8-4114-8bf3-8e62707df599" containerName="istio-proxy" Sep 15 21:43:50.446893 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.446892 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c597d73-2bb8-4114-8bf3-8e62707df599" containerName="istio-proxy" Sep 15 21:43:50.447041 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.446959 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c597d73-2bb8-4114-8bf3-8e62707df599" containerName="istio-proxy" Sep 15 21:43:50.450020 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.449990 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.452546 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.452518 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e2d4753a-openshift-default-dockercfg-4dzrd\"" Sep 15 21:43:50.461404 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.461379 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv"] Sep 15 21:43:50.471785 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.471746 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:50.597333 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.597298 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-istio-envoy\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.597333 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.597332 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39792c5f-4984-4e13-af3c-46013d467cb5-istio-podinfo\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.597567 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.597432 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39792c5f-4984-4e13-af3c-46013d467cb5-istiod-ca-cert\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.597567 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.597467 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39792c5f-4984-4e13-af3c-46013d467cb5-istio-token\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.597567 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.597483 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-credential-socket\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.597567 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.597506 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-workload-certs\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.597567 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.597532 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-istio-data\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.597741 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.597617 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-workload-socket\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.597741 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.597647 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48nqf\" (UniqueName: \"kubernetes.io/projected/39792c5f-4984-4e13-af3c-46013d467cb5-kube-api-access-48nqf\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.698964 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.698882 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39792c5f-4984-4e13-af3c-46013d467cb5-istiod-ca-cert\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.698964 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.698933 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39792c5f-4984-4e13-af3c-46013d467cb5-istio-token\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.699151 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.699047 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-credential-socket\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.699151 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.699103 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-workload-certs\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.699247 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.699149 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-istio-data\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.699247 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.699198 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-workload-socket\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.699247 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.699223 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48nqf\" (UniqueName: \"kubernetes.io/projected/39792c5f-4984-4e13-af3c-46013d467cb5-kube-api-access-48nqf\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.699395 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.699307 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-istio-envoy\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.699395 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.699337 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39792c5f-4984-4e13-af3c-46013d467cb5-istio-podinfo\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.699512 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.699424 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-credential-socket\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.699571 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.699551 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-workload-socket\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.699625 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.699584 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-istio-data\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.699708 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.699691 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-workload-certs\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.699745 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.699711 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39792c5f-4984-4e13-af3c-46013d467cb5-istiod-ca-cert\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.701510 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.701493 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-istio-envoy\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.701748 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.701726 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39792c5f-4984-4e13-af3c-46013d467cb5-istio-podinfo\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.707500 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.707473 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48nqf\" (UniqueName: \"kubernetes.io/projected/39792c5f-4984-4e13-af3c-46013d467cb5-kube-api-access-48nqf\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.707604 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.707587 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39792c5f-4984-4e13-af3c-46013d467cb5-istio-token\") pod \"e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:50.761988 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:50.761963 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:51.068342 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:51.068310 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv"] Sep 15 21:43:51.070563 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:43:51.070537 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39792c5f_4984_4e13_af3c_46013d467cb5.slice/crio-3dfa42d5dd1a0e6f08402e4f5c7fe86f056e357c436fa233d8eebefcff5d7e0d WatchSource:0}: Error finding container 3dfa42d5dd1a0e6f08402e4f5c7fe86f056e357c436fa233d8eebefcff5d7e0d: Status 404 returned error can't find the container with id 3dfa42d5dd1a0e6f08402e4f5c7fe86f056e357c436fa233d8eebefcff5d7e0d Sep 15 21:43:51.073089 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:51.073051 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:43:51.073159 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:51.073138 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:43:51.073202 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:51.073184 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:43:51.136321 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:51.136289 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:51.758831 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:51.758795 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" event={"ID":"39792c5f-4984-4e13-af3c-46013d467cb5","Type":"ContainerStarted","Data":"35b03dc25e70e07a3596656cabd0ecba74c5a5c3a455c759c729d45242b2258e"} Sep 15 21:43:51.759042 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:51.758871 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" event={"ID":"39792c5f-4984-4e13-af3c-46013d467cb5","Type":"ContainerStarted","Data":"3dfa42d5dd1a0e6f08402e4f5c7fe86f056e357c436fa233d8eebefcff5d7e0d"} Sep 15 21:43:51.762162 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:51.762137 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:51.783602 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:51.783558 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" podStartSLOduration=1.7835444900000001 podStartE2EDuration="1.78354449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:43:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:43:51.782284114 +0000 UTC m=+1086.368881721" watchObservedRunningTime="2026-09-15 21:43:51.78354449 +0000 UTC m=+1086.370142082" Sep 15 21:43:52.772781 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:52.772748 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:53.772553 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:53.772524 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:53.773520 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:53.773500 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:43:55.957353 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:55.957315 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:56.218327 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:56.218296 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:56.354517 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:56.354478 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:56.766273 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:56.766230 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:57.530765 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:57.530729 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:58.193180 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:58.193144 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:58.858495 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:58.858442 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:59.591086 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:59.591051 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:43:59.655430 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:43:59.655396 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:00.119634 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:00.119598 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:00.221700 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:00.221657 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:00.284235 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:00.284191 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:11.033339 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:11.033303 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:11.084347 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:11.084276 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:21.566250 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:21.566213 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:22.466315 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:22.466220 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:23.185760 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:23.185717 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:24.056742 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:24.056654 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:24.814020 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:24.813978 2573 patch_prober.go:28] interesting pod/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Sep 15 21:44:24.814552 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:24.814073 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" podUID="39792c5f-4984-4e13-af3c-46013d467cb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 15 21:44:24.869814 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:24.869779 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:25.502766 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:25.502689 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:26.163815 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:26.163770 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:26.266439 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:26.266396 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:26.937909 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:26.937833 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:26.966509 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:26.966476 2573 generic.go:356] "Generic (PLEG): container finished" podID="39792c5f-4984-4e13-af3c-46013d467cb5" containerID="35b03dc25e70e07a3596656cabd0ecba74c5a5c3a455c759c729d45242b2258e" exitCode=0 Sep 15 21:44:26.966685 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:26.966551 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" event={"ID":"39792c5f-4984-4e13-af3c-46013d467cb5","Type":"ContainerDied","Data":"35b03dc25e70e07a3596656cabd0ecba74c5a5c3a455c759c729d45242b2258e"} Sep 15 21:44:26.966980 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:26.966966 2573 scope.go:117] "RemoveContainer" containerID="35b03dc25e70e07a3596656cabd0ecba74c5a5c3a455c759c729d45242b2258e" Sep 15 21:44:26.968171 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:26.968133 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:44:26.968270 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:26.968205 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:44:26.968270 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:26.968242 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:44:27.032181 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:27.032145 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:27.134606 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:27.134432 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:27.358791 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:27.358739 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:27.789895 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:27.789820 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:27.974153 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:27.974117 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" event={"ID":"39792c5f-4984-4e13-af3c-46013d467cb5","Type":"ContainerStarted","Data":"97ffa33af1a1eab5834a4e0c068024326d19041386e31704b5b63f7518da8a5e"} Sep 15 21:44:28.483712 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:28.483667 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:28.762900 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:28.762801 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:44:28.763059 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:28.763015 2573 patch_prober.go:28] interesting pod/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Sep 15 21:44:28.763109 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:28.763074 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" podUID="39792c5f-4984-4e13-af3c-46013d467cb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Sep 15 21:44:29.762884 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:29.762823 2573 patch_prober.go:28] interesting pod/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Sep 15 21:44:29.763289 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:29.762910 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" podUID="39792c5f-4984-4e13-af3c-46013d467cb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Sep 15 21:44:30.763372 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:30.763332 2573 patch_prober.go:28] interesting pod/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Sep 15 21:44:30.763766 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:30.763394 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" podUID="39792c5f-4984-4e13-af3c-46013d467cb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Sep 15 21:44:31.762485 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:31.762445 2573 patch_prober.go:28] interesting pod/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Sep 15 21:44:31.762667 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:31.762501 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" podUID="39792c5f-4984-4e13-af3c-46013d467cb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Sep 15 21:44:32.763201 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:32.763159 2573 patch_prober.go:28] interesting pod/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Sep 15 21:44:32.763701 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:32.763219 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" podUID="39792c5f-4984-4e13-af3c-46013d467cb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Sep 15 21:44:32.906603 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:32.906571 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:33.007954 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:33.007912 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:33.243379 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:33.243345 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2d4753a-nsw8g"] Sep 15 21:44:33.247444 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:33.247418 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2d4753a-nsw8g" Sep 15 21:44:33.249693 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:33.249673 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p7cdh\"" Sep 15 21:44:33.249862 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:33.249834 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 15 21:44:33.257628 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:33.257603 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2d4753a-nsw8g"] Sep 15 21:44:33.292869 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:33.289468 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:33.329049 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:33.329019 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e81c7a80-911a-4ecd-9310-6391c7d93728-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e2d4753a-nsw8g\" (UID: \"e81c7a80-911a-4ecd-9310-6391c7d93728\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2d4753a-nsw8g" Sep 15 21:44:33.429778 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:33.429741 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e81c7a80-911a-4ecd-9310-6391c7d93728-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e2d4753a-nsw8g\" (UID: \"e81c7a80-911a-4ecd-9310-6391c7d93728\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2d4753a-nsw8g" Sep 15 21:44:33.430455 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:33.430435 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e81c7a80-911a-4ecd-9310-6391c7d93728-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e2d4753a-nsw8g\" (UID: \"e81c7a80-911a-4ecd-9310-6391c7d93728\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2d4753a-nsw8g" Sep 15 21:44:33.559709 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:33.559626 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2d4753a-nsw8g" Sep 15 21:44:33.766535 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:33.766504 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:44:33.766928 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:33.766885 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:44:33.767484 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:33.767464 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:44:33.847260 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:44:33.847192 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode81c7a80_911a_4ecd_9310_6391c7d93728.slice/crio-569e7c7d16d63de6656a08dcf73dbcd7fc7c5bfacb79c3884ec0b5b279041d24 WatchSource:0}: Error finding container 569e7c7d16d63de6656a08dcf73dbcd7fc7c5bfacb79c3884ec0b5b279041d24: Status 404 returned error can't find the container with id 569e7c7d16d63de6656a08dcf73dbcd7fc7c5bfacb79c3884ec0b5b279041d24 Sep 15 21:44:33.847594 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:33.847567 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2d4753a-nsw8g"] Sep 15 21:44:33.849595 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:33.849576 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 21:44:33.996235 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:33.996200 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:34.017459 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:34.017428 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2d4753a-nsw8g" event={"ID":"e81c7a80-911a-4ecd-9310-6391c7d93728","Type":"ContainerStarted","Data":"569e7c7d16d63de6656a08dcf73dbcd7fc7c5bfacb79c3884ec0b5b279041d24"} Sep 15 21:44:34.724777 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:34.724740 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:35.456518 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:35.456481 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:36.248634 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:36.248597 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:36.878899 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:36.878835 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:37.038052 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:37.037966 2573 generic.go:356] "Generic (PLEG): container finished" podID="e81c7a80-911a-4ecd-9310-6391c7d93728" containerID="529fef0c5d34fbea3f48b5a26f95e534bf6b6045e4fb53fc2c53fa1cf2b768d0" exitCode=0 Sep 15 21:44:37.038212 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:37.038049 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2d4753a-nsw8g" event={"ID":"e81c7a80-911a-4ecd-9310-6391c7d93728","Type":"ContainerDied","Data":"529fef0c5d34fbea3f48b5a26f95e534bf6b6045e4fb53fc2c53fa1cf2b768d0"} Sep 15 21:44:37.546151 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:37.546120 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:38.170583 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:38.170557 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2d4753a-nsw8g" Sep 15 21:44:38.260826 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:38.260791 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:38.282411 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:38.282378 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e81c7a80-911a-4ecd-9310-6391c7d93728-maas-api-service-ca\") pod \"e81c7a80-911a-4ecd-9310-6391c7d93728\" (UID: \"e81c7a80-911a-4ecd-9310-6391c7d93728\") " Sep 15 21:44:38.282833 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:38.282804 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e81c7a80-911a-4ecd-9310-6391c7d93728-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e81c7a80-911a-4ecd-9310-6391c7d93728" (UID: "e81c7a80-911a-4ecd-9310-6391c7d93728"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:44:38.362732 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:38.362634 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:38.383580 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:38.383552 2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e81c7a80-911a-4ecd-9310-6391c7d93728-maas-api-service-ca\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:44:38.431390 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:38.431354 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:38.491284 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:38.491247 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:38.830508 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:38.830473 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:38.913566 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:38.913527 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:39.052075 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:39.052045 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2d4753a-nsw8g" Sep 15 21:44:39.052075 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:39.052064 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2d4753a-nsw8g" event={"ID":"e81c7a80-911a-4ecd-9310-6391c7d93728","Type":"ContainerDied","Data":"569e7c7d16d63de6656a08dcf73dbcd7fc7c5bfacb79c3884ec0b5b279041d24"} Sep 15 21:44:39.052283 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:39.052114 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="569e7c7d16d63de6656a08dcf73dbcd7fc7c5bfacb79c3884ec0b5b279041d24" Sep 15 21:44:39.560264 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:39.560207 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:40.248287 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:40.248247 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:41.163715 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:41.163667 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:41.797174 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:41.797136 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:42.480154 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:42.480111 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:43.546103 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:43.546041 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:43.861315 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:43.861226 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:44.104343 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:44.104313 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:44.170842 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:44.170742 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:44.273376 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:44.273334 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:44.282483 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:44.282454 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2d4753a-nsw8g"] Sep 15 21:44:44.285052 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:44.285032 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2d4753a-nsw8g"] Sep 15 21:44:44.338448 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:44.338413 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:44.637373 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:44.637338 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:44.781764 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:44.781729 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:45.444645 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:45.444605 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:45.934986 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:45.934955 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e81c7a80-911a-4ecd-9310-6391c7d93728" path="/var/lib/kubelet/pods/e81c7a80-911a-4ecd-9310-6391c7d93728/volumes" Sep 15 21:44:46.369385 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:46.369351 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:47.013917 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:47.013879 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:47.656179 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:47.656144 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:50.334672 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:50.334632 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:50.437404 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:50.437365 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:50.579366 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:50.579333 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv"] Sep 15 21:44:50.579604 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:50.579579 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" podUID="39792c5f-4984-4e13-af3c-46013d467cb5" containerName="istio-proxy" containerID="cri-o://97ffa33af1a1eab5834a4e0c068024326d19041386e31704b5b63f7518da8a5e" gracePeriod=30 Sep 15 21:44:50.605552 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:50.605449 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:50.933729 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:50.933575 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:51.027602 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:51.027558 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:51.138667 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:51.138603 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:55.833210 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.833186 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:44:55.872895 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.872788 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-istio-envoy\") pod \"39792c5f-4984-4e13-af3c-46013d467cb5\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " Sep 15 21:44:55.872895 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.872878 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-workload-socket\") pod \"39792c5f-4984-4e13-af3c-46013d467cb5\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " Sep 15 21:44:55.873086 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.872961 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39792c5f-4984-4e13-af3c-46013d467cb5-istio-token\") pod \"39792c5f-4984-4e13-af3c-46013d467cb5\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " Sep 15 21:44:55.873086 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.873004 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48nqf\" (UniqueName: \"kubernetes.io/projected/39792c5f-4984-4e13-af3c-46013d467cb5-kube-api-access-48nqf\") pod \"39792c5f-4984-4e13-af3c-46013d467cb5\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " Sep 15 21:44:55.873086 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.873055 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-workload-certs\") pod \"39792c5f-4984-4e13-af3c-46013d467cb5\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " Sep 15 21:44:55.873239 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.873134 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39792c5f-4984-4e13-af3c-46013d467cb5-istio-podinfo\") pod \"39792c5f-4984-4e13-af3c-46013d467cb5\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " Sep 15 21:44:55.873239 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.873151 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "39792c5f-4984-4e13-af3c-46013d467cb5" (UID: "39792c5f-4984-4e13-af3c-46013d467cb5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:44:55.873239 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.873162 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39792c5f-4984-4e13-af3c-46013d467cb5-istiod-ca-cert\") pod \"39792c5f-4984-4e13-af3c-46013d467cb5\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " Sep 15 21:44:55.873239 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.873221 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-credential-socket\") pod \"39792c5f-4984-4e13-af3c-46013d467cb5\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " Sep 15 21:44:55.873449 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.873253 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-istio-data\") pod \"39792c5f-4984-4e13-af3c-46013d467cb5\" (UID: \"39792c5f-4984-4e13-af3c-46013d467cb5\") " Sep 15 21:44:55.873503 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.873439 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "39792c5f-4984-4e13-af3c-46013d467cb5" (UID: "39792c5f-4984-4e13-af3c-46013d467cb5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:44:55.873561 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.873511 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39792c5f-4984-4e13-af3c-46013d467cb5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "39792c5f-4984-4e13-af3c-46013d467cb5" (UID: "39792c5f-4984-4e13-af3c-46013d467cb5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:44:55.873681 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.873653 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-istio-data" (OuterVolumeSpecName: "istio-data") pod "39792c5f-4984-4e13-af3c-46013d467cb5" (UID: "39792c5f-4984-4e13-af3c-46013d467cb5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:44:55.873757 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.873720 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "39792c5f-4984-4e13-af3c-46013d467cb5" (UID: "39792c5f-4984-4e13-af3c-46013d467cb5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:44:55.873966 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.873877 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-workload-certs\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:44:55.873966 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.873902 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39792c5f-4984-4e13-af3c-46013d467cb5-istiod-ca-cert\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:44:55.873966 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.873917 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-credential-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:44:55.873966 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.873929 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-istio-data\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:44:55.873966 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.873944 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-workload-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:44:55.875608 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.875580 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39792c5f-4984-4e13-af3c-46013d467cb5-kube-api-access-48nqf" (OuterVolumeSpecName: "kube-api-access-48nqf") pod "39792c5f-4984-4e13-af3c-46013d467cb5" (UID: "39792c5f-4984-4e13-af3c-46013d467cb5"). InnerVolumeSpecName "kube-api-access-48nqf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:44:55.875732 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.875661 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39792c5f-4984-4e13-af3c-46013d467cb5-istio-token" (OuterVolumeSpecName: "istio-token") pod "39792c5f-4984-4e13-af3c-46013d467cb5" (UID: "39792c5f-4984-4e13-af3c-46013d467cb5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:44:55.875804 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.875759 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/39792c5f-4984-4e13-af3c-46013d467cb5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "39792c5f-4984-4e13-af3c-46013d467cb5" (UID: "39792c5f-4984-4e13-af3c-46013d467cb5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 15 21:44:55.875922 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.875901 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "39792c5f-4984-4e13-af3c-46013d467cb5" (UID: "39792c5f-4984-4e13-af3c-46013d467cb5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:44:55.974934 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.974903 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39792c5f-4984-4e13-af3c-46013d467cb5-istio-podinfo\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:44:55.974934 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.974931 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39792c5f-4984-4e13-af3c-46013d467cb5-istio-envoy\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:44:55.974934 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.974942 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39792c5f-4984-4e13-af3c-46013d467cb5-istio-token\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:44:55.975159 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:55.974950 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48nqf\" (UniqueName: \"kubernetes.io/projected/39792c5f-4984-4e13-af3c-46013d467cb5-kube-api-access-48nqf\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:44:56.159998 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:56.159904 2573 generic.go:356] "Generic (PLEG): container finished" podID="39792c5f-4984-4e13-af3c-46013d467cb5" containerID="97ffa33af1a1eab5834a4e0c068024326d19041386e31704b5b63f7518da8a5e" exitCode=0 Sep 15 21:44:56.159998 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:56.159954 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" Sep 15 21:44:56.160219 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:56.159991 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" event={"ID":"39792c5f-4984-4e13-af3c-46013d467cb5","Type":"ContainerDied","Data":"97ffa33af1a1eab5834a4e0c068024326d19041386e31704b5b63f7518da8a5e"} Sep 15 21:44:56.160219 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:56.160057 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv" event={"ID":"39792c5f-4984-4e13-af3c-46013d467cb5","Type":"ContainerDied","Data":"3dfa42d5dd1a0e6f08402e4f5c7fe86f056e357c436fa233d8eebefcff5d7e0d"} Sep 15 21:44:56.160219 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:56.160069 2573 scope.go:117] "RemoveContainer" containerID="97ffa33af1a1eab5834a4e0c068024326d19041386e31704b5b63f7518da8a5e" Sep 15 21:44:56.170422 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:56.170403 2573 scope.go:117] "RemoveContainer" containerID="35b03dc25e70e07a3596656cabd0ecba74c5a5c3a455c759c729d45242b2258e" Sep 15 21:44:56.179663 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:56.179632 2573 scope.go:117] "RemoveContainer" containerID="97ffa33af1a1eab5834a4e0c068024326d19041386e31704b5b63f7518da8a5e" Sep 15 21:44:56.180949 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:44:56.180926 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97ffa33af1a1eab5834a4e0c068024326d19041386e31704b5b63f7518da8a5e\": container with ID starting with 97ffa33af1a1eab5834a4e0c068024326d19041386e31704b5b63f7518da8a5e not found: ID does not exist" containerID="97ffa33af1a1eab5834a4e0c068024326d19041386e31704b5b63f7518da8a5e" Sep 15 21:44:56.181068 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:56.180963 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97ffa33af1a1eab5834a4e0c068024326d19041386e31704b5b63f7518da8a5e"} err="failed to get container status \"97ffa33af1a1eab5834a4e0c068024326d19041386e31704b5b63f7518da8a5e\": rpc error: code = NotFound desc = could not find container \"97ffa33af1a1eab5834a4e0c068024326d19041386e31704b5b63f7518da8a5e\": container with ID starting with 97ffa33af1a1eab5834a4e0c068024326d19041386e31704b5b63f7518da8a5e not found: ID does not exist" Sep 15 21:44:56.181068 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:56.180991 2573 scope.go:117] "RemoveContainer" containerID="35b03dc25e70e07a3596656cabd0ecba74c5a5c3a455c759c729d45242b2258e" Sep 15 21:44:56.181315 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:56.181287 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv"] Sep 15 21:44:56.181389 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:44:56.181291 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35b03dc25e70e07a3596656cabd0ecba74c5a5c3a455c759c729d45242b2258e\": container with ID starting with 35b03dc25e70e07a3596656cabd0ecba74c5a5c3a455c759c729d45242b2258e not found: ID does not exist" containerID="35b03dc25e70e07a3596656cabd0ecba74c5a5c3a455c759c729d45242b2258e" Sep 15 21:44:56.181389 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:56.181345 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35b03dc25e70e07a3596656cabd0ecba74c5a5c3a455c759c729d45242b2258e"} err="failed to get container status \"35b03dc25e70e07a3596656cabd0ecba74c5a5c3a455c759c729d45242b2258e\": rpc error: code = NotFound desc = could not find container \"35b03dc25e70e07a3596656cabd0ecba74c5a5c3a455c759c729d45242b2258e\": container with ID starting with 35b03dc25e70e07a3596656cabd0ecba74c5a5c3a455c759c729d45242b2258e not found: ID does not exist" Sep 15 21:44:56.185583 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:56.185559 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv"] Sep 15 21:44:56.859491 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:56.859457 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:57.017568 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:57.017537 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:57.129804 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:57.129726 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:57.216836 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:57.216795 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:57.337422 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:57.337385 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:44:57.934758 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:44:57.934727 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39792c5f-4984-4e13-af3c-46013d467cb5" path="/var/lib/kubelet/pods/39792c5f-4984-4e13-af3c-46013d467cb5/volumes" Sep 15 21:45:00.147368 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:00.147333 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-360e43-29825145-rmd74"] Sep 15 21:45:00.148059 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:00.148036 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e81c7a80-911a-4ecd-9310-6391c7d93728" containerName="revoke-keys" Sep 15 21:45:00.148163 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:00.148061 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e81c7a80-911a-4ecd-9310-6391c7d93728" containerName="revoke-keys" Sep 15 21:45:00.148163 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:00.148096 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39792c5f-4984-4e13-af3c-46013d467cb5" containerName="istio-proxy" Sep 15 21:45:00.148163 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:00.148105 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="39792c5f-4984-4e13-af3c-46013d467cb5" containerName="istio-proxy" Sep 15 21:45:00.148163 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:00.148114 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39792c5f-4984-4e13-af3c-46013d467cb5" containerName="istio-proxy" Sep 15 21:45:00.148163 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:00.148122 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="39792c5f-4984-4e13-af3c-46013d467cb5" containerName="istio-proxy" Sep 15 21:45:00.148408 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:00.148229 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="39792c5f-4984-4e13-af3c-46013d467cb5" containerName="istio-proxy" Sep 15 21:45:00.148408 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:00.148241 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e81c7a80-911a-4ecd-9310-6391c7d93728" containerName="revoke-keys" Sep 15 21:45:00.148408 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:00.148250 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="39792c5f-4984-4e13-af3c-46013d467cb5" containerName="istio-proxy" Sep 15 21:45:00.152836 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:00.152812 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-56e305-29825145-t85md"] Sep 15 21:45:00.153006 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:00.152936 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-360e43-29825145-rmd74" Sep 15 21:45:00.155626 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:00.155603 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p7cdh\"" Sep 15 21:45:00.156518 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:00.156501 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-56e305-29825145-t85md" Sep 15 21:45:00.163143 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:00.163114 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-360e43-29825145-rmd74"] Sep 15 21:45:00.166922 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:00.166892 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-56e305-29825145-t85md"] Sep 15 21:45:00.167698 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:00.167678 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-360e43-29825145-rmd74" Sep 15 21:45:00.177882 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:00.177820 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-56e305-29825145-t85md" Sep 15 21:45:00.449940 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:00.449910 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-360e43-29825145-rmd74"] Sep 15 21:45:00.450280 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:45:00.450251 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb41fb4c_04f5_49ba_9a9d_d6c724695d31.slice/crio-1e1caa576397e17173bbb68e80ca77a524eeb57db3f10a049eed9097acb955c7 WatchSource:0}: Error finding container 1e1caa576397e17173bbb68e80ca77a524eeb57db3f10a049eed9097acb955c7: Status 404 returned error can't find the container with id 1e1caa576397e17173bbb68e80ca77a524eeb57db3f10a049eed9097acb955c7 Sep 15 21:45:00.463757 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:00.463729 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-56e305-29825145-t85md"] Sep 15 21:45:00.465961 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:45:00.465929 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96e2d281_f474_4a14_af7a_0ee64ea3793d.slice/crio-9589f831f54b1066832543b0e7a67ab4189177531ee7b2e2d02987e6da5a5bf5 WatchSource:0}: Error finding container 9589f831f54b1066832543b0e7a67ab4189177531ee7b2e2d02987e6da5a5bf5: Status 404 returned error can't find the container with id 9589f831f54b1066832543b0e7a67ab4189177531ee7b2e2d02987e6da5a5bf5 Sep 15 21:45:01.195349 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:01.195247 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-56e305-29825145-t85md" event={"ID":"96e2d281-f474-4a14-af7a-0ee64ea3793d","Type":"ContainerStarted","Data":"fcf7ae6b3297cad1f1e91f79c2f6f6bd8f90f255d6665ce78e3be08f60882d16"} Sep 15 21:45:01.195349 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:01.195311 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-56e305-29825145-t85md" event={"ID":"96e2d281-f474-4a14-af7a-0ee64ea3793d","Type":"ContainerStarted","Data":"9589f831f54b1066832543b0e7a67ab4189177531ee7b2e2d02987e6da5a5bf5"} Sep 15 21:45:01.197051 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:01.197020 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-360e43-29825145-rmd74" event={"ID":"eb41fb4c-04f5-49ba-9a9d-d6c724695d31","Type":"ContainerStarted","Data":"9dc319e25bf5fbcfe685e95d66f6aba6d281f63604baedf835973dcd063eec49"} Sep 15 21:45:01.197181 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:01.197064 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-360e43-29825145-rmd74" event={"ID":"eb41fb4c-04f5-49ba-9a9d-d6c724695d31","Type":"ContainerStarted","Data":"1e1caa576397e17173bbb68e80ca77a524eeb57db3f10a049eed9097acb955c7"} Sep 15 21:45:01.212344 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:01.212294 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-56e305-29825145-t85md" podStartSLOduration=1.212273707 podStartE2EDuration="1.212273707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:45:01.209520242 +0000 UTC m=+1155.796117831" watchObservedRunningTime="2026-09-15 21:45:01.212273707 +0000 UTC m=+1155.798871300" Sep 15 21:45:01.223915 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:01.223866 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-360e43-29825145-rmd74" podStartSLOduration=1.223830624 podStartE2EDuration="1.223830624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:45:01.222681543 +0000 UTC m=+1155.809279136" watchObservedRunningTime="2026-09-15 21:45:01.223830624 +0000 UTC m=+1155.810428215" Sep 15 21:45:01.457193 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:01.457112 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:02.209957 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:02.209916 2573 generic.go:356] "Generic (PLEG): container finished" podID="eb41fb4c-04f5-49ba-9a9d-d6c724695d31" containerID="9dc319e25bf5fbcfe685e95d66f6aba6d281f63604baedf835973dcd063eec49" exitCode=0 Sep 15 21:45:02.210390 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:02.209998 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-360e43-29825145-rmd74" event={"ID":"eb41fb4c-04f5-49ba-9a9d-d6c724695d31","Type":"ContainerDied","Data":"9dc319e25bf5fbcfe685e95d66f6aba6d281f63604baedf835973dcd063eec49"} Sep 15 21:45:02.211798 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:02.211767 2573 generic.go:356] "Generic (PLEG): container finished" podID="96e2d281-f474-4a14-af7a-0ee64ea3793d" containerID="fcf7ae6b3297cad1f1e91f79c2f6f6bd8f90f255d6665ce78e3be08f60882d16" exitCode=0 Sep 15 21:45:02.211954 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:02.211794 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-56e305-29825145-t85md" event={"ID":"96e2d281-f474-4a14-af7a-0ee64ea3793d","Type":"ContainerDied","Data":"fcf7ae6b3297cad1f1e91f79c2f6f6bd8f90f255d6665ce78e3be08f60882d16"} Sep 15 21:45:02.982117 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:02.982079 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:03.176639 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:03.176606 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:03.283587 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:03.283464 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:03.376434 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:03.376408 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-56e305-29825145-t85md" Sep 15 21:45:03.379713 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:03.379692 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-360e43-29825145-rmd74" Sep 15 21:45:04.106517 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:04.106483 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:04.227700 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:04.227670 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-56e305-29825145-t85md" Sep 15 21:45:04.227915 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:04.227714 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-56e305-29825145-t85md" event={"ID":"96e2d281-f474-4a14-af7a-0ee64ea3793d","Type":"ContainerDied","Data":"9589f831f54b1066832543b0e7a67ab4189177531ee7b2e2d02987e6da5a5bf5"} Sep 15 21:45:04.227915 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:04.227770 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9589f831f54b1066832543b0e7a67ab4189177531ee7b2e2d02987e6da5a5bf5" Sep 15 21:45:04.229178 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:04.229160 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-360e43-29825145-rmd74" Sep 15 21:45:04.229292 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:04.229153 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-360e43-29825145-rmd74" event={"ID":"eb41fb4c-04f5-49ba-9a9d-d6c724695d31","Type":"ContainerDied","Data":"1e1caa576397e17173bbb68e80ca77a524eeb57db3f10a049eed9097acb955c7"} Sep 15 21:45:04.229292 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:04.229280 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e1caa576397e17173bbb68e80ca77a524eeb57db3f10a049eed9097acb955c7" Sep 15 21:45:04.449893 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:04.449840 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:04.583552 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:04.583451 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:06.880556 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:06.880520 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:07.634804 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:07.634771 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:07.733598 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:07.733565 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:07.834721 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:07.834687 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:08.578005 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:08.577926 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:09.348535 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:09.348497 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:09.994507 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:09.994470 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:10.881394 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:10.881356 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:10.982012 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:10.981975 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:11.428660 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:11.428624 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:11.526556 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:11.526525 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:12.076994 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:12.076964 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:20.064733 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:20.064694 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:20.424109 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:20.424026 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:20.987308 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:20.987274 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:31.981780 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:31.981746 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:33.285873 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:33.285826 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:33.960886 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:33.960815 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:34.768804 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:34.768765 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:35.365900 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:35.365839 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:35.466454 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:35.466416 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:35.565800 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:35.565771 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:35.636437 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:35.636355 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:36.103824 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.103791 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:36.212581 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.212549 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:36.400295 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.400216 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh"] Sep 15 21:45:36.400876 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.400824 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb41fb4c-04f5-49ba-9a9d-d6c724695d31" containerName="cleanup" Sep 15 21:45:36.400876 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.400861 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb41fb4c-04f5-49ba-9a9d-d6c724695d31" containerName="cleanup" Sep 15 21:45:36.400876 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.400876 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96e2d281-f474-4a14-af7a-0ee64ea3793d" containerName="cleanup" Sep 15 21:45:36.401149 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.400885 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="96e2d281-f474-4a14-af7a-0ee64ea3793d" containerName="cleanup" Sep 15 21:45:36.401149 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.400988 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="96e2d281-f474-4a14-af7a-0ee64ea3793d" containerName="cleanup" Sep 15 21:45:36.401149 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.401007 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb41fb4c-04f5-49ba-9a9d-d6c724695d31" containerName="cleanup" Sep 15 21:45:36.404932 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.404912 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.407474 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.407457 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-87ba8b-openshift-default-dockercfg-mb5sr\"" Sep 15 21:45:36.415203 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.415182 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh"] Sep 15 21:45:36.426937 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.426905 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:36.465390 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.465357 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-credential-socket\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.465562 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.465406 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83b73180-a42b-48ad-9479-19d18130bd51-istio-token\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.465562 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.465431 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76x5k\" (UniqueName: \"kubernetes.io/projected/83b73180-a42b-48ad-9479-19d18130bd51-kube-api-access-76x5k\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.465562 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.465481 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83b73180-a42b-48ad-9479-19d18130bd51-istiod-ca-cert\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.465562 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.465500 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-istio-data\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.465797 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.465689 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-workload-socket\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.465797 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.465733 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-istio-envoy\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.465797 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.465760 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83b73180-a42b-48ad-9479-19d18130bd51-istio-podinfo\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.465958 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.465804 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-workload-certs\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.566815 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.566778 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-workload-socket\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.566815 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.566818 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-istio-envoy\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.567099 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.566834 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83b73180-a42b-48ad-9479-19d18130bd51-istio-podinfo\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.567099 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.566896 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-workload-certs\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.567099 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.566928 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-credential-socket\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.567099 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.566960 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83b73180-a42b-48ad-9479-19d18130bd51-istio-token\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.567099 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.566983 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76x5k\" (UniqueName: \"kubernetes.io/projected/83b73180-a42b-48ad-9479-19d18130bd51-kube-api-access-76x5k\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.567099 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.567022 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83b73180-a42b-48ad-9479-19d18130bd51-istiod-ca-cert\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.567405 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.567246 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-istio-data\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.567405 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.567374 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-credential-socket\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.567512 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.567464 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-workload-socket\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.567512 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.567484 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-workload-certs\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.567690 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.567670 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-istio-data\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.567730 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.567708 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83b73180-a42b-48ad-9479-19d18130bd51-istiod-ca-cert\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.569114 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.569096 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-istio-envoy\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.569702 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.569687 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83b73180-a42b-48ad-9479-19d18130bd51-istio-podinfo\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.574617 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.574596 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83b73180-a42b-48ad-9479-19d18130bd51-istio-token\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.574719 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.574649 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76x5k\" (UniqueName: \"kubernetes.io/projected/83b73180-a42b-48ad-9479-19d18130bd51-kube-api-access-76x5k\") pod \"e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:36.717918 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:36.717877 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:37.000559 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:37.000528 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh"] Sep 15 21:45:37.001648 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:45:37.001618 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83b73180_a42b_48ad_9479_19d18130bd51.slice/crio-e4f7f0490879fe0921479a8ec1acfe0df61e337801da8adb5f2b53c64a4ed565 WatchSource:0}: Error finding container e4f7f0490879fe0921479a8ec1acfe0df61e337801da8adb5f2b53c64a4ed565: Status 404 returned error can't find the container with id e4f7f0490879fe0921479a8ec1acfe0df61e337801da8adb5f2b53c64a4ed565 Sep 15 21:45:37.003945 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:37.003911 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:45:37.004035 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:37.003978 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:45:37.004035 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:37.004006 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:45:37.068770 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:37.068736 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:37.186593 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:37.186543 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:37.435675 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:37.435596 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" event={"ID":"83b73180-a42b-48ad-9479-19d18130bd51","Type":"ContainerStarted","Data":"d0e566f4813f2fac0db68605be8d806b371f14447ac6a1bf8cb6f83f78010fe4"} Sep 15 21:45:37.435675 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:37.435654 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" event={"ID":"83b73180-a42b-48ad-9479-19d18130bd51","Type":"ContainerStarted","Data":"e4f7f0490879fe0921479a8ec1acfe0df61e337801da8adb5f2b53c64a4ed565"} Sep 15 21:45:37.458783 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:37.458730 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" podStartSLOduration=1.458715104 podStartE2EDuration="1.458715104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:45:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:45:37.456007482 +0000 UTC m=+1192.042605097" watchObservedRunningTime="2026-09-15 21:45:37.458715104 +0000 UTC m=+1192.045312695" Sep 15 21:45:37.682973 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:37.682937 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:37.718094 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:37.718061 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:37.783408 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:37.783375 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:37.886667 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:37.886630 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:38.105191 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.105073 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:38.201623 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.201517 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:38.345922 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.345839 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn"] Sep 15 21:45:38.352178 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.352150 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.354685 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.354660 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-8c1d2a-openshift-default-dockercfg-lbh4w\"" Sep 15 21:45:38.361930 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.361904 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn"] Sep 15 21:45:38.376144 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.376112 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:38.386289 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.386264 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istio-envoy\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.386456 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.386311 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istio-token\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.386456 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.386383 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-workload-socket\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.386571 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.386545 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-workload-certs\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.386628 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.386586 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-credential-socket\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.386685 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.386633 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istiod-ca-cert\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.386765 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.386749 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istio-data\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.386826 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.386779 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istio-podinfo\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.386894 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.386824 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbbxv\" (UniqueName: \"kubernetes.io/projected/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-kube-api-access-cbbxv\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.488001 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.487962 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-workload-certs\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.488001 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.488005 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-credential-socket\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.488269 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.488029 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istiod-ca-cert\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.488269 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.488078 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istio-data\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.488269 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.488100 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istio-podinfo\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.488269 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.488156 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbbxv\" (UniqueName: \"kubernetes.io/projected/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-kube-api-access-cbbxv\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.488269 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.488260 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istio-envoy\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.488537 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.488358 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istio-token\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.488537 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.488429 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-workload-socket\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.488642 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.488578 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-credential-socket\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.488642 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.488578 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istio-data\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.489250 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.488782 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-workload-socket\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.489250 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.489007 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-workload-certs\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.489250 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.489073 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istiod-ca-cert\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.491114 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.491091 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istio-envoy\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.491558 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.491539 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istio-podinfo\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.496277 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.496257 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbbxv\" (UniqueName: \"kubernetes.io/projected/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-kube-api-access-cbbxv\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.496405 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.496382 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istio-token\") pod \"e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.665476 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.665388 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:38.727017 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.726804 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:38.886531 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.886501 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:38.942200 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.942166 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn"] Sep 15 21:45:38.950672 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.950632 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:45:38.950817 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.950740 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:45:38.950817 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:38.950783 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:45:39.455860 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:39.455812 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" event={"ID":"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98","Type":"ContainerStarted","Data":"dba4b169014876f84b33f79a6ec53c3a0557d8b4c2fd2080056f8f7b3713e814"} Sep 15 21:45:39.456348 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:39.455886 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" event={"ID":"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98","Type":"ContainerStarted","Data":"cef1dde28a22d192f1fdc66a4fc77ee0738b3ddc44e73903c4d118d3197bb118"} Sep 15 21:45:39.456348 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:39.456113 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:39.457125 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:39.457105 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:45:39.474405 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:39.474348 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" podStartSLOduration=1.474328345 podStartE2EDuration="1.474328345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:45:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:45:39.472612006 +0000 UTC m=+1194.059209614" watchObservedRunningTime="2026-09-15 21:45:39.474328345 +0000 UTC m=+1194.060925939" Sep 15 21:45:39.666211 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:39.666177 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:40.670956 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:40.670926 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:40.768081 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:40.768044 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:41.435117 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:41.435069 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:41.468099 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:41.468063 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:41.468807 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:41.468782 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:45:41.534568 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:41.534532 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:42.176476 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:42.176437 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:42.955841 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:42.955799 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:43.874883 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:43.874823 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:44.535502 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:44.535453 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:45.261406 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:45.261373 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:45.361723 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:45.361680 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:45.461713 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:45.461664 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:45.757353 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:45.757317 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:45.824351 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:45.824312 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:45:45.941740 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:45.941714 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/1.log" Sep 15 21:45:45.942984 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:45:45.942953 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/1.log" Sep 15 21:46:08.073753 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:08.073714 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:08.856070 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:08.856039 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:09.480549 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:09.480508 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:09.647402 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:09.647371 2573 generic.go:356] "Generic (PLEG): container finished" podID="9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" containerID="dba4b169014876f84b33f79a6ec53c3a0557d8b4c2fd2080056f8f7b3713e814" exitCode=0 Sep 15 21:46:09.647573 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:09.647421 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" event={"ID":"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98","Type":"ContainerDied","Data":"dba4b169014876f84b33f79a6ec53c3a0557d8b4c2fd2080056f8f7b3713e814"} Sep 15 21:46:09.647902 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:09.647887 2573 scope.go:117] "RemoveContainer" containerID="dba4b169014876f84b33f79a6ec53c3a0557d8b4c2fd2080056f8f7b3713e814" Sep 15 21:46:09.649175 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:09.649146 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:46:09.649246 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:09.649216 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:46:09.649287 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:09.649249 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:46:10.148927 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:10.148876 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:10.655475 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:10.655439 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" event={"ID":"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98","Type":"ContainerStarted","Data":"8883bd0b3ac42de7d2213376e6122ff19ff0653bb50fb8322683a73daca4ebf0"} Sep 15 21:46:10.666242 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:10.666207 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:46:10.667479 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:10.667445 2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Sep 15 21:46:10.667596 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:10.667521 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" podUID="9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Sep 15 21:46:10.984649 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:10.984609 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:11.468368 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:11.468338 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:46:11.633878 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:11.633830 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:11.666113 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:11.666077 2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Sep 15 21:46:11.666700 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:11.666669 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" podUID="9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Sep 15 21:46:11.734963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:11.734879 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:12.022640 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:12.022553 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:12.377272 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:12.377157 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:12.666205 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:12.666103 2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Sep 15 21:46:12.667615 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:12.667580 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" podUID="9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Sep 15 21:46:13.666376 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:13.666333 2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Sep 15 21:46:13.666990 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:13.666957 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" podUID="9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Sep 15 21:46:14.666056 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:14.666011 2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Sep 15 21:46:14.666277 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:14.666084 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" podUID="9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Sep 15 21:46:15.665811 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:15.665772 2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Sep 15 21:46:15.666243 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:15.665832 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" podUID="9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Sep 15 21:46:16.671524 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:16.671483 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:46:16.672740 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:16.672715 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:46:20.579379 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:20.579343 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:20.890692 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:20.890612 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx"] Sep 15 21:46:20.894348 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:20.894327 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:20.896786 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:20.896757 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-459b305b-openshift-default-dockercfg-l6hng\"" Sep 15 21:46:20.905581 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:20.905559 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx"] Sep 15 21:46:21.057213 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.057171 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mqh9\" (UniqueName: \"kubernetes.io/projected/e969a826-3b76-4e67-b917-38fc467c21e8-kube-api-access-9mqh9\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.057397 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.057222 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-workload-socket\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.057397 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.057293 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-istio-envoy\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.057397 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.057385 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e969a826-3b76-4e67-b917-38fc467c21e8-istio-token\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.057523 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.057427 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e969a826-3b76-4e67-b917-38fc467c21e8-istiod-ca-cert\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.057523 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.057511 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e969a826-3b76-4e67-b917-38fc467c21e8-istio-podinfo\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.057623 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.057540 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-workload-certs\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.057675 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.057654 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-credential-socket\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.057728 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.057709 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-istio-data\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.158518 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.158432 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e969a826-3b76-4e67-b917-38fc467c21e8-istio-token\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.158518 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.158480 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e969a826-3b76-4e67-b917-38fc467c21e8-istiod-ca-cert\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.158739 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.158521 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e969a826-3b76-4e67-b917-38fc467c21e8-istio-podinfo\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.158739 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.158547 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-workload-certs\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.158739 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.158587 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-credential-socket\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.158739 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.158620 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-istio-data\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.158739 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.158657 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mqh9\" (UniqueName: \"kubernetes.io/projected/e969a826-3b76-4e67-b917-38fc467c21e8-kube-api-access-9mqh9\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.158739 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.158684 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-workload-socket\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.158739 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.158716 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-istio-envoy\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.159422 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.159391 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-workload-certs\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.159540 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.159430 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-credential-socket\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.159540 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.159523 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-workload-socket\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.159761 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.159735 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-istio-data\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.159886 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.159756 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e969a826-3b76-4e67-b917-38fc467c21e8-istiod-ca-cert\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.168037 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.167890 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-istio-envoy\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.169260 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.169242 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e969a826-3b76-4e67-b917-38fc467c21e8-istio-podinfo\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.171766 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.171746 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e969a826-3b76-4e67-b917-38fc467c21e8-istio-token\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.175156 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.175136 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mqh9\" (UniqueName: \"kubernetes.io/projected/e969a826-3b76-4e67-b917-38fc467c21e8-kube-api-access-9mqh9\") pod \"e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.206260 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.206214 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:21.489205 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.489178 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx"] Sep 15 21:46:21.490515 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:46:21.490485 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode969a826_3b76_4e67_b917_38fc467c21e8.slice/crio-cbdf85551b20d1d5f7fc76a060984ccab8dceb1db22ac996c02cfbac786bcf76 WatchSource:0}: Error finding container cbdf85551b20d1d5f7fc76a060984ccab8dceb1db22ac996c02cfbac786bcf76: Status 404 returned error can't find the container with id cbdf85551b20d1d5f7fc76a060984ccab8dceb1db22ac996c02cfbac786bcf76 Sep 15 21:46:21.492829 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.492799 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:46:21.492931 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.492886 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:46:21.492931 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.492919 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:46:21.738990 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.738883 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" event={"ID":"e969a826-3b76-4e67-b917-38fc467c21e8","Type":"ContainerStarted","Data":"de901add9c006dd7c909e02109d11a7e69e131614ef9757ae4e0b2fe61688e78"} Sep 15 21:46:21.738990 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.738954 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" event={"ID":"e969a826-3b76-4e67-b917-38fc467c21e8","Type":"ContainerStarted","Data":"cbdf85551b20d1d5f7fc76a060984ccab8dceb1db22ac996c02cfbac786bcf76"} Sep 15 21:46:21.764197 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:21.764150 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" podStartSLOduration=1.764134255 podStartE2EDuration="1.764134255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:46:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:46:21.760591937 +0000 UTC m=+1236.347189566" watchObservedRunningTime="2026-09-15 21:46:21.764134255 +0000 UTC m=+1236.350731847" Sep 15 21:46:22.168958 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:22.168874 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:22.207174 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:22.207143 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:22.213156 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:22.213126 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:22.745523 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:22.745486 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:22.746465 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:22.746442 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:23.680549 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:23.680512 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:23.798361 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:23.798321 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:23.902236 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:23.902196 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:24.766259 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:24.766224 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:25.550630 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:25.550598 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:26.270469 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:26.270426 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:27.069186 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:27.069148 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:27.793756 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:27.793721 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:28.730553 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:28.730491 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:28.832902 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:28.832864 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:29.035377 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:29.035289 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:29.181112 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:29.181077 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:29.276726 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:29.276691 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:34.535628 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:34.535543 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:50.263499 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:50.263460 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:50.459396 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:50.459354 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:50.939821 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:50.939790 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:50.951025 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:50.950992 2573 generic.go:356] "Generic (PLEG): container finished" podID="e969a826-3b76-4e67-b917-38fc467c21e8" containerID="de901add9c006dd7c909e02109d11a7e69e131614ef9757ae4e0b2fe61688e78" exitCode=0 Sep 15 21:46:50.951184 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:50.951069 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" event={"ID":"e969a826-3b76-4e67-b917-38fc467c21e8","Type":"ContainerDied","Data":"de901add9c006dd7c909e02109d11a7e69e131614ef9757ae4e0b2fe61688e78"} Sep 15 21:46:50.951526 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:50.951512 2573 scope.go:117] "RemoveContainer" containerID="de901add9c006dd7c909e02109d11a7e69e131614ef9757ae4e0b2fe61688e78" Sep 15 21:46:50.952710 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:50.952679 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:46:50.952778 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:50.952751 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:46:50.952815 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:50.952784 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:46:51.038648 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:51.038608 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:51.758709 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:51.758649 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:51.959559 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:51.959520 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" event={"ID":"e969a826-3b76-4e67-b917-38fc467c21e8","Type":"ContainerStarted","Data":"b5def39f02c32d33c94348017369643228b844f2998f3cfffa9e334478b61ab7"} Sep 15 21:46:52.206925 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:52.206798 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:52.208166 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:52.208138 2573 patch_prober.go:28] interesting pod/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Sep 15 21:46:52.208290 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:52.208188 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" podUID="e969a826-3b76-4e67-b917-38fc467c21e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Sep 15 21:46:52.435002 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:52.434970 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:52.745829 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:52.745793 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:53.207612 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:53.207525 2573 patch_prober.go:28] interesting pod/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Sep 15 21:46:53.207612 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:53.207600 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" podUID="e969a826-3b76-4e67-b917-38fc467c21e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Sep 15 21:46:53.279504 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:53.279466 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:53.814790 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:53.814749 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:53.980161 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:53.980120 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:54.207127 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:54.207033 2573 patch_prober.go:28] interesting pod/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Sep 15 21:46:54.207127 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:54.207110 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" podUID="e969a826-3b76-4e67-b917-38fc467c21e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Sep 15 21:46:54.770646 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:54.770604 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:55.207044 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:55.206944 2573 patch_prober.go:28] interesting pod/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Sep 15 21:46:55.207044 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:55.207008 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" podUID="e969a826-3b76-4e67-b917-38fc467c21e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Sep 15 21:46:55.448216 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:55.448175 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:56.074744 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:56.074705 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:56.207576 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:56.207532 2573 patch_prober.go:28] interesting pod/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Sep 15 21:46:56.207758 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:56.207589 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" podUID="e969a826-3b76-4e67-b917-38fc467c21e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Sep 15 21:46:56.851243 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:56.851202 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:46:57.206903 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:57.206802 2573 patch_prober.go:28] interesting pod/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Sep 15 21:46:57.206903 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:57.206892 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" podUID="e969a826-3b76-4e67-b917-38fc467c21e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Sep 15 21:46:58.211736 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:58.211706 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:46:58.212621 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:46:58.212602 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:47:16.827111 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:16.827073 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:19.105950 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:19.105919 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:19.210597 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:19.210556 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh"] Sep 15 21:47:19.211247 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:19.211172 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" podUID="83b73180-a42b-48ad-9479-19d18130bd51" containerName="istio-proxy" containerID="cri-o://d0e566f4813f2fac0db68605be8d806b371f14447ac6a1bf8cb6f83f78010fe4" gracePeriod=30 Sep 15 21:47:19.216066 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:19.216016 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:19.443065 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:19.442973 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:19.590944 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:19.590906 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:20.515951 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:20.515915 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz"] Sep 15 21:47:20.526893 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:20.526864 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:20.632598 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:20.632555 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1af1db-6brxr"] Sep 15 21:47:20.637202 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:20.637169 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1af1db-6brxr" Sep 15 21:47:20.640277 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:20.640250 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 15 21:47:20.640599 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:20.640575 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p7cdh\"" Sep 15 21:47:20.644250 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:20.644224 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1af1db-6brxr"] Sep 15 21:47:20.702671 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:20.702634 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d9cbace-973c-4e9c-bd7a-1592dc975ef9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-1af1db-6brxr\" (UID: \"9d9cbace-973c-4e9c-bd7a-1592dc975ef9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1af1db-6brxr" Sep 15 21:47:20.803358 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:20.803268 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d9cbace-973c-4e9c-bd7a-1592dc975ef9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-1af1db-6brxr\" (UID: \"9d9cbace-973c-4e9c-bd7a-1592dc975ef9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1af1db-6brxr" Sep 15 21:47:20.803910 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:20.803890 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d9cbace-973c-4e9c-bd7a-1592dc975ef9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-1af1db-6brxr\" (UID: \"9d9cbace-973c-4e9c-bd7a-1592dc975ef9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1af1db-6brxr" Sep 15 21:47:20.833351 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:20.833300 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:20.952103 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:20.952064 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1af1db-6brxr" Sep 15 21:47:21.224289 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:21.224260 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1af1db-6brxr"] Sep 15 21:47:21.225722 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:47:21.225697 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d9cbace_973c_4e9c_bd7a_1592dc975ef9.slice/crio-85ef608cea35bc5faa0aaa70ed15c2069c3d1247a546a8170b87c3224d54cf32 WatchSource:0}: Error finding container 85ef608cea35bc5faa0aaa70ed15c2069c3d1247a546a8170b87c3224d54cf32: Status 404 returned error can't find the container with id 85ef608cea35bc5faa0aaa70ed15c2069c3d1247a546a8170b87c3224d54cf32 Sep 15 21:47:21.563577 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:21.563487 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:22.159948 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:22.159913 2573 generic.go:356] "Generic (PLEG): container finished" podID="9d9cbace-973c-4e9c-bd7a-1592dc975ef9" containerID="1267ebaf0ea582a8889529996ba0672aa8bd6e8e528da0a4cb95300a48dd4afe" exitCode=0 Sep 15 21:47:22.160140 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:22.159955 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1af1db-6brxr" event={"ID":"9d9cbace-973c-4e9c-bd7a-1592dc975ef9","Type":"ContainerDied","Data":"1267ebaf0ea582a8889529996ba0672aa8bd6e8e528da0a4cb95300a48dd4afe"} Sep 15 21:47:22.160140 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:22.159993 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1af1db-6brxr" event={"ID":"9d9cbace-973c-4e9c-bd7a-1592dc975ef9","Type":"ContainerStarted","Data":"85ef608cea35bc5faa0aaa70ed15c2069c3d1247a546a8170b87c3224d54cf32"} Sep 15 21:47:22.344828 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:22.344796 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:22.963314 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:22.963284 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:23.308593 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:23.308565 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1af1db-6brxr" Sep 15 21:47:23.441271 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:23.441236 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d9cbace-973c-4e9c-bd7a-1592dc975ef9-maas-api-service-ca\") pod \"9d9cbace-973c-4e9c-bd7a-1592dc975ef9\" (UID: \"9d9cbace-973c-4e9c-bd7a-1592dc975ef9\") " Sep 15 21:47:23.441582 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:23.441559 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d9cbace-973c-4e9c-bd7a-1592dc975ef9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9d9cbace-973c-4e9c-bd7a-1592dc975ef9" (UID: "9d9cbace-973c-4e9c-bd7a-1592dc975ef9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:47:23.542370 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:23.542286 2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d9cbace-973c-4e9c-bd7a-1592dc975ef9-maas-api-service-ca\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:23.563963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:23.563925 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:24.176935 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.176901 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1af1db-6brxr" Sep 15 21:47:24.176935 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.176925 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1af1db-6brxr" event={"ID":"9d9cbace-973c-4e9c-bd7a-1592dc975ef9","Type":"ContainerDied","Data":"85ef608cea35bc5faa0aaa70ed15c2069c3d1247a546a8170b87c3224d54cf32"} Sep 15 21:47:24.177372 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.176971 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85ef608cea35bc5faa0aaa70ed15c2069c3d1247a546a8170b87c3224d54cf32" Sep 15 21:47:24.274748 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.274714 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:24.484983 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.484927 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:47:24.626396 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.626364 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:24.652603 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.652569 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-istio-data\") pod \"83b73180-a42b-48ad-9479-19d18130bd51\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " Sep 15 21:47:24.652768 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.652609 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-workload-certs\") pod \"83b73180-a42b-48ad-9479-19d18130bd51\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " Sep 15 21:47:24.652768 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.652654 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83b73180-a42b-48ad-9479-19d18130bd51-istiod-ca-cert\") pod \"83b73180-a42b-48ad-9479-19d18130bd51\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " Sep 15 21:47:24.652768 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.652685 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-istio-envoy\") pod \"83b73180-a42b-48ad-9479-19d18130bd51\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " Sep 15 21:47:24.652768 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.652721 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76x5k\" (UniqueName: \"kubernetes.io/projected/83b73180-a42b-48ad-9479-19d18130bd51-kube-api-access-76x5k\") pod \"83b73180-a42b-48ad-9479-19d18130bd51\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " Sep 15 21:47:24.653025 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.652782 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83b73180-a42b-48ad-9479-19d18130bd51-istio-token\") pod \"83b73180-a42b-48ad-9479-19d18130bd51\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " Sep 15 21:47:24.653025 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.652802 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83b73180-a42b-48ad-9479-19d18130bd51-istio-podinfo\") pod \"83b73180-a42b-48ad-9479-19d18130bd51\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " Sep 15 21:47:24.653025 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.652826 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-credential-socket\") pod \"83b73180-a42b-48ad-9479-19d18130bd51\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " Sep 15 21:47:24.653025 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.652881 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-workload-socket\") pod \"83b73180-a42b-48ad-9479-19d18130bd51\" (UID: \"83b73180-a42b-48ad-9479-19d18130bd51\") " Sep 15 21:47:24.653025 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.652906 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-istio-data" (OuterVolumeSpecName: "istio-data") pod "83b73180-a42b-48ad-9479-19d18130bd51" (UID: "83b73180-a42b-48ad-9479-19d18130bd51"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:47:24.653025 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.652990 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "83b73180-a42b-48ad-9479-19d18130bd51" (UID: "83b73180-a42b-48ad-9479-19d18130bd51"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:47:24.653333 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.653091 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83b73180-a42b-48ad-9479-19d18130bd51-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "83b73180-a42b-48ad-9479-19d18130bd51" (UID: "83b73180-a42b-48ad-9479-19d18130bd51"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:47:24.653333 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.653154 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "83b73180-a42b-48ad-9479-19d18130bd51" (UID: "83b73180-a42b-48ad-9479-19d18130bd51"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:47:24.653333 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.653306 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "83b73180-a42b-48ad-9479-19d18130bd51" (UID: "83b73180-a42b-48ad-9479-19d18130bd51"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:47:24.653500 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.653383 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-credential-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:24.653500 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.653404 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-istio-data\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:24.653500 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.653418 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-workload-certs\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:24.653500 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.653432 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83b73180-a42b-48ad-9479-19d18130bd51-istiod-ca-cert\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:24.655045 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.655022 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "83b73180-a42b-48ad-9479-19d18130bd51" (UID: "83b73180-a42b-48ad-9479-19d18130bd51"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:47:24.655175 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.655122 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/83b73180-a42b-48ad-9479-19d18130bd51-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "83b73180-a42b-48ad-9479-19d18130bd51" (UID: "83b73180-a42b-48ad-9479-19d18130bd51"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 15 21:47:24.655489 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.655462 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83b73180-a42b-48ad-9479-19d18130bd51-kube-api-access-76x5k" (OuterVolumeSpecName: "kube-api-access-76x5k") pod "83b73180-a42b-48ad-9479-19d18130bd51" (UID: "83b73180-a42b-48ad-9479-19d18130bd51"). InnerVolumeSpecName "kube-api-access-76x5k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:47:24.655489 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.655481 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83b73180-a42b-48ad-9479-19d18130bd51-istio-token" (OuterVolumeSpecName: "istio-token") pod "83b73180-a42b-48ad-9479-19d18130bd51" (UID: "83b73180-a42b-48ad-9479-19d18130bd51"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:47:24.754980 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.754889 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-istio-envoy\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:24.754980 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.754914 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76x5k\" (UniqueName: \"kubernetes.io/projected/83b73180-a42b-48ad-9479-19d18130bd51-kube-api-access-76x5k\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:24.754980 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.754926 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83b73180-a42b-48ad-9479-19d18130bd51-istio-token\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:24.754980 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.754935 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83b73180-a42b-48ad-9479-19d18130bd51-istio-podinfo\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:24.754980 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.754943 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83b73180-a42b-48ad-9479-19d18130bd51-workload-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:24.923627 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:24.923539 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:25.184962 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:25.184835 2573 generic.go:356] "Generic (PLEG): container finished" podID="83b73180-a42b-48ad-9479-19d18130bd51" containerID="d0e566f4813f2fac0db68605be8d806b371f14447ac6a1bf8cb6f83f78010fe4" exitCode=0 Sep 15 21:47:25.184962 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:25.184910 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" Sep 15 21:47:25.184962 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:25.184923 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" event={"ID":"83b73180-a42b-48ad-9479-19d18130bd51","Type":"ContainerDied","Data":"d0e566f4813f2fac0db68605be8d806b371f14447ac6a1bf8cb6f83f78010fe4"} Sep 15 21:47:25.185491 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:25.184979 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" event={"ID":"83b73180-a42b-48ad-9479-19d18130bd51","Type":"ContainerDied","Data":"e4f7f0490879fe0921479a8ec1acfe0df61e337801da8adb5f2b53c64a4ed565"} Sep 15 21:47:25.185491 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:25.185002 2573 scope.go:117] "RemoveContainer" containerID="d0e566f4813f2fac0db68605be8d806b371f14447ac6a1bf8cb6f83f78010fe4" Sep 15 21:47:25.195562 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:25.195545 2573 scope.go:117] "RemoveContainer" containerID="d0e566f4813f2fac0db68605be8d806b371f14447ac6a1bf8cb6f83f78010fe4" Sep 15 21:47:25.195840 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:47:25.195821 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0e566f4813f2fac0db68605be8d806b371f14447ac6a1bf8cb6f83f78010fe4\": container with ID starting with d0e566f4813f2fac0db68605be8d806b371f14447ac6a1bf8cb6f83f78010fe4 not found: ID does not exist" containerID="d0e566f4813f2fac0db68605be8d806b371f14447ac6a1bf8cb6f83f78010fe4" Sep 15 21:47:25.195964 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:25.195946 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0e566f4813f2fac0db68605be8d806b371f14447ac6a1bf8cb6f83f78010fe4"} err="failed to get container status \"d0e566f4813f2fac0db68605be8d806b371f14447ac6a1bf8cb6f83f78010fe4\": rpc error: code = NotFound desc = could not find container \"d0e566f4813f2fac0db68605be8d806b371f14447ac6a1bf8cb6f83f78010fe4\": container with ID starting with d0e566f4813f2fac0db68605be8d806b371f14447ac6a1bf8cb6f83f78010fe4 not found: ID does not exist" Sep 15 21:47:25.210907 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:25.210881 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh"] Sep 15 21:47:25.213514 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:25.213495 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh"] Sep 15 21:47:25.457649 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:25.457558 2573 patch_prober.go:28] interesting pod/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Sep 15 21:47:25.457649 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:25.457624 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh" podUID="83b73180-a42b-48ad-9479-19d18130bd51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 15 21:47:25.561087 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:25.561053 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:25.934449 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:25.934414 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83b73180-a42b-48ad-9479-19d18130bd51" path="/var/lib/kubelet/pods/83b73180-a42b-48ad-9479-19d18130bd51/volumes" Sep 15 21:47:26.274624 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:26.274589 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:31.079174 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:31.079142 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:31.109658 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:31.109623 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp"] Sep 15 21:47:31.109941 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:31.109911 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp" podUID="c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70" containerName="payload-processing" containerID="cri-o://f264ec0d2c4ef87595a6a96c826d71d688dfea10fb1cc96408dd0ba416fe43d9" gracePeriod=30 Sep 15 21:47:31.179157 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:31.179118 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:31.229964 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:31.229929 2573 generic.go:356] "Generic (PLEG): container finished" podID="c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70" containerID="f264ec0d2c4ef87595a6a96c826d71d688dfea10fb1cc96408dd0ba416fe43d9" exitCode=0 Sep 15 21:47:31.230083 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:31.229982 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp" event={"ID":"c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70","Type":"ContainerDied","Data":"f264ec0d2c4ef87595a6a96c826d71d688dfea10fb1cc96408dd0ba416fe43d9"} Sep 15 21:47:31.272373 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:31.272336 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1af1db-6brxr"] Sep 15 21:47:31.273597 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:31.273559 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:31.276466 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:31.276443 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1af1db-6brxr"] Sep 15 21:47:31.328746 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:31.328714 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:31.376636 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:31.376613 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp" Sep 15 21:47:31.527075 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:31.527039 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70-plugins-config-volume\") pod \"c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70\" (UID: \"c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70\") " Sep 15 21:47:31.527243 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:31.527174 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfzk4\" (UniqueName: \"kubernetes.io/projected/c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70-kube-api-access-kfzk4\") pod \"c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70\" (UID: \"c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70\") " Sep 15 21:47:31.527479 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:31.527452 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70" (UID: "c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:47:31.529206 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:31.529177 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70-kube-api-access-kfzk4" (OuterVolumeSpecName: "kube-api-access-kfzk4") pod "c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70" (UID: "c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70"). InnerVolumeSpecName "kube-api-access-kfzk4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:47:31.628103 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:31.628023 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfzk4\" (UniqueName: \"kubernetes.io/projected/c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70-kube-api-access-kfzk4\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:31.628103 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:31.628052 2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70-plugins-config-volume\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:31.637502 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:31.637471 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:31.717165 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:31.717133 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:31.934271 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:31.934192 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d9cbace-973c-4e9c-bd7a-1592dc975ef9" path="/var/lib/kubelet/pods/9d9cbace-973c-4e9c-bd7a-1592dc975ef9/volumes" Sep 15 21:47:32.237395 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:32.237364 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp" event={"ID":"c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70","Type":"ContainerDied","Data":"566729ccd01cb2673ea8eae26391a4ee469adeab8d74cb2cb482562e7aad72b5"} Sep 15 21:47:32.237395 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:32.237397 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp" Sep 15 21:47:32.237975 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:32.237437 2573 scope.go:117] "RemoveContainer" containerID="f264ec0d2c4ef87595a6a96c826d71d688dfea10fb1cc96408dd0ba416fe43d9" Sep 15 21:47:32.254094 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:32.254068 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp"] Sep 15 21:47:32.258007 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:32.257984 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp"] Sep 15 21:47:32.481670 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:32.481633 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:33.161584 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:33.161546 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:33.802999 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:33.802947 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:33.934141 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:33.934101 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70" path="/var/lib/kubelet/pods/c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70/volumes" Sep 15 21:47:34.679139 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:34.679100 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:35.341067 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:35.341031 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:35.535653 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:35.535613 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" podUID="727c26c8-7f6b-4cbd-b2e3-502407a36324" containerName="main" containerID="cri-o://77cb51308eff4e3ef8885bcb5babf7afc997b29d1c8264829994970a23778241" gracePeriod=45 Sep 15 21:47:35.792628 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:35.792602 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:47:35.869231 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:35.869195 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/727c26c8-7f6b-4cbd-b2e3-502407a36324-model-cache\") pod \"727c26c8-7f6b-4cbd-b2e3-502407a36324\" (UID: \"727c26c8-7f6b-4cbd-b2e3-502407a36324\") " Sep 15 21:47:35.869403 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:35.869256 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/727c26c8-7f6b-4cbd-b2e3-502407a36324-home\") pod \"727c26c8-7f6b-4cbd-b2e3-502407a36324\" (UID: \"727c26c8-7f6b-4cbd-b2e3-502407a36324\") " Sep 15 21:47:35.869403 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:35.869304 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/727c26c8-7f6b-4cbd-b2e3-502407a36324-tmp-dir\") pod \"727c26c8-7f6b-4cbd-b2e3-502407a36324\" (UID: \"727c26c8-7f6b-4cbd-b2e3-502407a36324\") " Sep 15 21:47:35.869403 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:35.869331 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/727c26c8-7f6b-4cbd-b2e3-502407a36324-dshm\") pod \"727c26c8-7f6b-4cbd-b2e3-502407a36324\" (UID: \"727c26c8-7f6b-4cbd-b2e3-502407a36324\") " Sep 15 21:47:35.869403 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:35.869395 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/727c26c8-7f6b-4cbd-b2e3-502407a36324-tls-certs\") pod \"727c26c8-7f6b-4cbd-b2e3-502407a36324\" (UID: \"727c26c8-7f6b-4cbd-b2e3-502407a36324\") " Sep 15 21:47:35.869614 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:35.869437 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr46c\" (UniqueName: \"kubernetes.io/projected/727c26c8-7f6b-4cbd-b2e3-502407a36324-kube-api-access-pr46c\") pod \"727c26c8-7f6b-4cbd-b2e3-502407a36324\" (UID: \"727c26c8-7f6b-4cbd-b2e3-502407a36324\") " Sep 15 21:47:35.869614 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:35.869487 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/727c26c8-7f6b-4cbd-b2e3-502407a36324-model-cache" (OuterVolumeSpecName: "model-cache") pod "727c26c8-7f6b-4cbd-b2e3-502407a36324" (UID: "727c26c8-7f6b-4cbd-b2e3-502407a36324"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:47:35.869614 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:35.869500 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/727c26c8-7f6b-4cbd-b2e3-502407a36324-home" (OuterVolumeSpecName: "home") pod "727c26c8-7f6b-4cbd-b2e3-502407a36324" (UID: "727c26c8-7f6b-4cbd-b2e3-502407a36324"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:47:35.869614 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:35.869583 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/727c26c8-7f6b-4cbd-b2e3-502407a36324-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "727c26c8-7f6b-4cbd-b2e3-502407a36324" (UID: "727c26c8-7f6b-4cbd-b2e3-502407a36324"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:47:35.869822 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:35.869806 2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/727c26c8-7f6b-4cbd-b2e3-502407a36324-model-cache\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:35.869894 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:35.869823 2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/727c26c8-7f6b-4cbd-b2e3-502407a36324-home\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:35.869894 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:35.869832 2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/727c26c8-7f6b-4cbd-b2e3-502407a36324-tmp-dir\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:35.871711 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:35.871685 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/727c26c8-7f6b-4cbd-b2e3-502407a36324-kube-api-access-pr46c" (OuterVolumeSpecName: "kube-api-access-pr46c") pod "727c26c8-7f6b-4cbd-b2e3-502407a36324" (UID: "727c26c8-7f6b-4cbd-b2e3-502407a36324"). InnerVolumeSpecName "kube-api-access-pr46c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:47:35.871711 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:35.871696 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/727c26c8-7f6b-4cbd-b2e3-502407a36324-dshm" (OuterVolumeSpecName: "dshm") pod "727c26c8-7f6b-4cbd-b2e3-502407a36324" (UID: "727c26c8-7f6b-4cbd-b2e3-502407a36324"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:47:35.871884 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:35.871717 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/727c26c8-7f6b-4cbd-b2e3-502407a36324-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "727c26c8-7f6b-4cbd-b2e3-502407a36324" (UID: "727c26c8-7f6b-4cbd-b2e3-502407a36324"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 21:47:35.970779 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:35.970745 2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/727c26c8-7f6b-4cbd-b2e3-502407a36324-dshm\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:35.970779 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:35.970771 2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/727c26c8-7f6b-4cbd-b2e3-502407a36324-tls-certs\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:35.970779 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:35.970782 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr46c\" (UniqueName: \"kubernetes.io/projected/727c26c8-7f6b-4cbd-b2e3-502407a36324-kube-api-access-pr46c\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:35.985839 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:35.985806 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:36.270426 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:36.270390 2573 generic.go:356] "Generic (PLEG): container finished" podID="727c26c8-7f6b-4cbd-b2e3-502407a36324" containerID="77cb51308eff4e3ef8885bcb5babf7afc997b29d1c8264829994970a23778241" exitCode=0 Sep 15 21:47:36.270588 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:36.270434 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" Sep 15 21:47:36.270588 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:36.270476 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" event={"ID":"727c26c8-7f6b-4cbd-b2e3-502407a36324","Type":"ContainerDied","Data":"77cb51308eff4e3ef8885bcb5babf7afc997b29d1c8264829994970a23778241"} Sep 15 21:47:36.270588 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:36.270517 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz" event={"ID":"727c26c8-7f6b-4cbd-b2e3-502407a36324","Type":"ContainerDied","Data":"a606125fbe652b64cb130ff73bb991891c719d906b209b017550a0b678d33720"} Sep 15 21:47:36.270588 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:36.270535 2573 scope.go:117] "RemoveContainer" containerID="77cb51308eff4e3ef8885bcb5babf7afc997b29d1c8264829994970a23778241" Sep 15 21:47:36.282259 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:36.282236 2573 scope.go:117] "RemoveContainer" containerID="77cb51308eff4e3ef8885bcb5babf7afc997b29d1c8264829994970a23778241" Sep 15 21:47:36.282801 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:47:36.282764 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77cb51308eff4e3ef8885bcb5babf7afc997b29d1c8264829994970a23778241\": container with ID starting with 77cb51308eff4e3ef8885bcb5babf7afc997b29d1c8264829994970a23778241 not found: ID does not exist" containerID="77cb51308eff4e3ef8885bcb5babf7afc997b29d1c8264829994970a23778241" Sep 15 21:47:36.282948 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:36.282810 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77cb51308eff4e3ef8885bcb5babf7afc997b29d1c8264829994970a23778241"} err="failed to get container status \"77cb51308eff4e3ef8885bcb5babf7afc997b29d1c8264829994970a23778241\": rpc error: code = NotFound desc = could not find container \"77cb51308eff4e3ef8885bcb5babf7afc997b29d1c8264829994970a23778241\": container with ID starting with 77cb51308eff4e3ef8885bcb5babf7afc997b29d1c8264829994970a23778241 not found: ID does not exist" Sep 15 21:47:36.286830 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:36.286808 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz"] Sep 15 21:47:36.293141 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:36.293118 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-a2d9c4/test-model-a2d9c4-kserve-5b7b976dbc-xgzvz"] Sep 15 21:47:37.229944 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.229911 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:37.290118 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.290080 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:37.492959 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.492881 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z"] Sep 15 21:47:37.493135 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.493111 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" podUID="461c3497-1851-48ea-acdd-9cf97c9ea1a8" containerName="istio-proxy" containerID="cri-o://a6f8608e01c99caa23eb63fdd4b33a150f0944654c91bf3268ce355e4ff8dae4" gracePeriod=30 Sep 15 21:47:37.506904 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.506818 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:37.861807 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.861711 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a2d9c4-6q584"] Sep 15 21:47:37.862237 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.862216 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d9cbace-973c-4e9c-bd7a-1592dc975ef9" containerName="revoke-keys" Sep 15 21:47:37.862338 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.862240 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d9cbace-973c-4e9c-bd7a-1592dc975ef9" containerName="revoke-keys" Sep 15 21:47:37.862338 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.862263 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70" containerName="payload-processing" Sep 15 21:47:37.862338 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.862271 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70" containerName="payload-processing" Sep 15 21:47:37.862338 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.862293 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="727c26c8-7f6b-4cbd-b2e3-502407a36324" containerName="main" Sep 15 21:47:37.862338 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.862302 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="727c26c8-7f6b-4cbd-b2e3-502407a36324" containerName="main" Sep 15 21:47:37.862338 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.862319 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83b73180-a42b-48ad-9479-19d18130bd51" containerName="istio-proxy" Sep 15 21:47:37.862338 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.862328 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="83b73180-a42b-48ad-9479-19d18130bd51" containerName="istio-proxy" Sep 15 21:47:37.862685 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.862441 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c53a30f0-b1bc-4efa-ba5f-ed9abdffeb70" containerName="payload-processing" Sep 15 21:47:37.862685 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.862453 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d9cbace-973c-4e9c-bd7a-1592dc975ef9" containerName="revoke-keys" Sep 15 21:47:37.862685 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.862464 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="83b73180-a42b-48ad-9479-19d18130bd51" containerName="istio-proxy" Sep 15 21:47:37.862685 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.862475 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="727c26c8-7f6b-4cbd-b2e3-502407a36324" containerName="main" Sep 15 21:47:37.866759 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.866738 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a2d9c4-6q584" Sep 15 21:47:37.869341 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.869317 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p7cdh\"" Sep 15 21:47:37.869465 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.869317 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 15 21:47:37.872296 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.872272 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a2d9c4-6q584"] Sep 15 21:47:37.888945 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.888918 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f51a74f-ad5b-445b-97a1-262b4eeadb6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a2d9c4-6q584\" (UID: \"1f51a74f-ad5b-445b-97a1-262b4eeadb6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a2d9c4-6q584" Sep 15 21:47:37.934374 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.934346 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="727c26c8-7f6b-4cbd-b2e3-502407a36324" path="/var/lib/kubelet/pods/727c26c8-7f6b-4cbd-b2e3-502407a36324/volumes" Sep 15 21:47:37.989674 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.989641 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f51a74f-ad5b-445b-97a1-262b4eeadb6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a2d9c4-6q584\" (UID: \"1f51a74f-ad5b-445b-97a1-262b4eeadb6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a2d9c4-6q584" Sep 15 21:47:37.990294 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:37.990275 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f51a74f-ad5b-445b-97a1-262b4eeadb6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a2d9c4-6q584\" (UID: \"1f51a74f-ad5b-445b-97a1-262b4eeadb6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a2d9c4-6q584" Sep 15 21:47:38.145795 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:38.145714 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:38.181607 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:38.181570 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a2d9c4-6q584" Sep 15 21:47:38.460887 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:38.460860 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a2d9c4-6q584"] Sep 15 21:47:38.461712 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:47:38.461686 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f51a74f_ad5b_445b_97a1_262b4eeadb6f.slice/crio-b3e724b22c5c73bdbb7f994a4acb869617b2cfa6b4cc1b4e8dd649ec0d189212 WatchSource:0}: Error finding container b3e724b22c5c73bdbb7f994a4acb869617b2cfa6b4cc1b4e8dd649ec0d189212: Status 404 returned error can't find the container with id b3e724b22c5c73bdbb7f994a4acb869617b2cfa6b4cc1b4e8dd649ec0d189212 Sep 15 21:47:38.864411 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:38.864375 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:39.293307 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:39.293275 2573 generic.go:356] "Generic (PLEG): container finished" podID="1f51a74f-ad5b-445b-97a1-262b4eeadb6f" containerID="e32c96b7d3411c19d5207edc4e994d7dbd8e98ae2d08b135df40a671376fb5ce" exitCode=0 Sep 15 21:47:39.293477 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:39.293359 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a2d9c4-6q584" event={"ID":"1f51a74f-ad5b-445b-97a1-262b4eeadb6f","Type":"ContainerDied","Data":"e32c96b7d3411c19d5207edc4e994d7dbd8e98ae2d08b135df40a671376fb5ce"} Sep 15 21:47:39.293477 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:39.293437 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a2d9c4-6q584" event={"ID":"1f51a74f-ad5b-445b-97a1-262b4eeadb6f","Type":"ContainerStarted","Data":"b3e724b22c5c73bdbb7f994a4acb869617b2cfa6b4cc1b4e8dd649ec0d189212"} Sep 15 21:47:39.363407 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:39.363375 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:39.553113 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:39.553070 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:40.438727 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:40.438697 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a2d9c4-6q584" Sep 15 21:47:40.466896 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:40.466834 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:40.531617 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:40.531592 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f51a74f-ad5b-445b-97a1-262b4eeadb6f-maas-api-service-ca\") pod \"1f51a74f-ad5b-445b-97a1-262b4eeadb6f\" (UID: \"1f51a74f-ad5b-445b-97a1-262b4eeadb6f\") " Sep 15 21:47:40.531950 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:40.531927 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f51a74f-ad5b-445b-97a1-262b4eeadb6f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1f51a74f-ad5b-445b-97a1-262b4eeadb6f" (UID: "1f51a74f-ad5b-445b-97a1-262b4eeadb6f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:47:40.633342 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:40.633254 2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f51a74f-ad5b-445b-97a1-262b4eeadb6f-maas-api-service-ca\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:41.096806 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:41.096772 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:41.306294 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:41.306265 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a2d9c4-6q584" Sep 15 21:47:41.306437 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:41.306300 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a2d9c4-6q584" event={"ID":"1f51a74f-ad5b-445b-97a1-262b4eeadb6f","Type":"ContainerDied","Data":"b3e724b22c5c73bdbb7f994a4acb869617b2cfa6b4cc1b4e8dd649ec0d189212"} Sep 15 21:47:41.306437 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:41.306347 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b3e724b22c5c73bdbb7f994a4acb869617b2cfa6b4cc1b4e8dd649ec0d189212" Sep 15 21:47:41.748190 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:41.748158 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:42.467702 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.467669 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:42.752331 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.752304 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:47:42.856755 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.856723 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istio-data\") pod \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " Sep 15 21:47:42.856947 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.856766 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istio-token\") pod \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " Sep 15 21:47:42.856947 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.856821 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istio-podinfo\") pod \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " Sep 15 21:47:42.856947 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.856874 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-workload-socket\") pod \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " Sep 15 21:47:42.856947 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.856928 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-credential-socket\") pod \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " Sep 15 21:47:42.857191 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.857003 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-workload-certs\") pod \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " Sep 15 21:47:42.857191 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.857074 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istiod-ca-cert\") pod \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " Sep 15 21:47:42.857191 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.857096 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istio-data" (OuterVolumeSpecName: "istio-data") pod "461c3497-1851-48ea-acdd-9cf97c9ea1a8" (UID: "461c3497-1851-48ea-acdd-9cf97c9ea1a8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:47:42.857191 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.857107 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istio-envoy\") pod \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " Sep 15 21:47:42.857410 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.857235 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "461c3497-1851-48ea-acdd-9cf97c9ea1a8" (UID: "461c3497-1851-48ea-acdd-9cf97c9ea1a8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:47:42.857410 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.857249 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bj9g\" (UniqueName: \"kubernetes.io/projected/461c3497-1851-48ea-acdd-9cf97c9ea1a8-kube-api-access-2bj9g\") pod \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\" (UID: \"461c3497-1851-48ea-acdd-9cf97c9ea1a8\") " Sep 15 21:47:42.857410 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.857351 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "461c3497-1851-48ea-acdd-9cf97c9ea1a8" (UID: "461c3497-1851-48ea-acdd-9cf97c9ea1a8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:47:42.857588 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.857451 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "461c3497-1851-48ea-acdd-9cf97c9ea1a8" (UID: "461c3497-1851-48ea-acdd-9cf97c9ea1a8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:47:42.857677 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.857657 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "461c3497-1851-48ea-acdd-9cf97c9ea1a8" (UID: "461c3497-1851-48ea-acdd-9cf97c9ea1a8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:47:42.857740 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.857673 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-workload-certs\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:42.857740 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.857692 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istio-data\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:42.857740 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.857705 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-workload-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:42.857740 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.857718 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-credential-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:42.859318 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.859290 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "461c3497-1851-48ea-acdd-9cf97c9ea1a8" (UID: "461c3497-1851-48ea-acdd-9cf97c9ea1a8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:47:42.859596 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.859577 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istio-token" (OuterVolumeSpecName: "istio-token") pod "461c3497-1851-48ea-acdd-9cf97c9ea1a8" (UID: "461c3497-1851-48ea-acdd-9cf97c9ea1a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:47:42.859682 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.859646 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/461c3497-1851-48ea-acdd-9cf97c9ea1a8-kube-api-access-2bj9g" (OuterVolumeSpecName: "kube-api-access-2bj9g") pod "461c3497-1851-48ea-acdd-9cf97c9ea1a8" (UID: "461c3497-1851-48ea-acdd-9cf97c9ea1a8"). InnerVolumeSpecName "kube-api-access-2bj9g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:47:42.859725 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.859697 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "461c3497-1851-48ea-acdd-9cf97c9ea1a8" (UID: "461c3497-1851-48ea-acdd-9cf97c9ea1a8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 15 21:47:42.958771 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.958731 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istiod-ca-cert\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:42.958771 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.958770 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istio-envoy\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:42.959003 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.958785 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bj9g\" (UniqueName: \"kubernetes.io/projected/461c3497-1851-48ea-acdd-9cf97c9ea1a8-kube-api-access-2bj9g\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:42.959003 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.958800 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istio-token\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:42.959003 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:42.958812 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/461c3497-1851-48ea-acdd-9cf97c9ea1a8-istio-podinfo\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:43.108469 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:43.108379 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:43.319259 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:43.319223 2573 generic.go:356] "Generic (PLEG): container finished" podID="461c3497-1851-48ea-acdd-9cf97c9ea1a8" containerID="a6f8608e01c99caa23eb63fdd4b33a150f0944654c91bf3268ce355e4ff8dae4" exitCode=0 Sep 15 21:47:43.319398 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:43.319283 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" event={"ID":"461c3497-1851-48ea-acdd-9cf97c9ea1a8","Type":"ContainerDied","Data":"a6f8608e01c99caa23eb63fdd4b33a150f0944654c91bf3268ce355e4ff8dae4"} Sep 15 21:47:43.319398 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:43.319342 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" event={"ID":"461c3497-1851-48ea-acdd-9cf97c9ea1a8","Type":"ContainerDied","Data":"bc045670f19577908018dd38cee4129aec7b8f033ec198f2114793c64ab7f678"} Sep 15 21:47:43.319398 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:43.319364 2573 scope.go:117] "RemoveContainer" containerID="a6f8608e01c99caa23eb63fdd4b33a150f0944654c91bf3268ce355e4ff8dae4" Sep 15 21:47:43.319398 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:43.319292 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z" Sep 15 21:47:43.329527 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:43.329508 2573 scope.go:117] "RemoveContainer" containerID="2bb8714ea7b170d943b6c7c77059c05bf9a1ed263c14bc7806f5a15b4d9e0ee5" Sep 15 21:47:43.338708 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:43.338689 2573 scope.go:117] "RemoveContainer" containerID="a6f8608e01c99caa23eb63fdd4b33a150f0944654c91bf3268ce355e4ff8dae4" Sep 15 21:47:43.339108 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:47:43.339087 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6f8608e01c99caa23eb63fdd4b33a150f0944654c91bf3268ce355e4ff8dae4\": container with ID starting with a6f8608e01c99caa23eb63fdd4b33a150f0944654c91bf3268ce355e4ff8dae4 not found: ID does not exist" containerID="a6f8608e01c99caa23eb63fdd4b33a150f0944654c91bf3268ce355e4ff8dae4" Sep 15 21:47:43.339208 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:43.339111 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6f8608e01c99caa23eb63fdd4b33a150f0944654c91bf3268ce355e4ff8dae4"} err="failed to get container status \"a6f8608e01c99caa23eb63fdd4b33a150f0944654c91bf3268ce355e4ff8dae4\": rpc error: code = NotFound desc = could not find container \"a6f8608e01c99caa23eb63fdd4b33a150f0944654c91bf3268ce355e4ff8dae4\": container with ID starting with a6f8608e01c99caa23eb63fdd4b33a150f0944654c91bf3268ce355e4ff8dae4 not found: ID does not exist" Sep 15 21:47:43.339208 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:43.339127 2573 scope.go:117] "RemoveContainer" containerID="2bb8714ea7b170d943b6c7c77059c05bf9a1ed263c14bc7806f5a15b4d9e0ee5" Sep 15 21:47:43.339405 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:47:43.339379 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bb8714ea7b170d943b6c7c77059c05bf9a1ed263c14bc7806f5a15b4d9e0ee5\": container with ID starting with 2bb8714ea7b170d943b6c7c77059c05bf9a1ed263c14bc7806f5a15b4d9e0ee5 not found: ID does not exist" containerID="2bb8714ea7b170d943b6c7c77059c05bf9a1ed263c14bc7806f5a15b4d9e0ee5" Sep 15 21:47:43.339466 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:43.339412 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bb8714ea7b170d943b6c7c77059c05bf9a1ed263c14bc7806f5a15b4d9e0ee5"} err="failed to get container status \"2bb8714ea7b170d943b6c7c77059c05bf9a1ed263c14bc7806f5a15b4d9e0ee5\": rpc error: code = NotFound desc = could not find container \"2bb8714ea7b170d943b6c7c77059c05bf9a1ed263c14bc7806f5a15b4d9e0ee5\": container with ID starting with 2bb8714ea7b170d943b6c7c77059c05bf9a1ed263c14bc7806f5a15b4d9e0ee5 not found: ID does not exist" Sep 15 21:47:43.341636 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:43.341609 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z"] Sep 15 21:47:43.344835 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:43.344813 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z"] Sep 15 21:47:43.935682 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:43.935648 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="461c3497-1851-48ea-acdd-9cf97c9ea1a8" path="/var/lib/kubelet/pods/461c3497-1851-48ea-acdd-9cf97c9ea1a8/volumes" Sep 15 21:47:48.375957 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:48.375913 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:48.413699 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:48.413657 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv"] Sep 15 21:47:48.414111 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:48.414074 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv" podUID="3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170" containerName="payload-processing" containerID="cri-o://91ad4711a76024c7eecb131629c0cfc5b28f5a4850edfcd643874cb34caed522" gracePeriod=30 Sep 15 21:47:48.475062 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:48.475011 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:48.557406 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:48.557364 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a2d9c4-6q584"] Sep 15 21:47:48.559027 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:48.558996 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:48.560302 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:48.560278 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a2d9c4-6q584"] Sep 15 21:47:48.619560 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:48.619479 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:48.685453 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:48.685427 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv" Sep 15 21:47:48.817011 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:48.816976 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ft8zw\" (UniqueName: \"kubernetes.io/projected/3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170-kube-api-access-ft8zw\") pod \"3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170\" (UID: \"3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170\") " Sep 15 21:47:48.817183 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:48.817100 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170-plugins-config-volume\") pod \"3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170\" (UID: \"3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170\") " Sep 15 21:47:48.817449 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:48.817412 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170" (UID: "3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:47:48.819243 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:48.819217 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170-kube-api-access-ft8zw" (OuterVolumeSpecName: "kube-api-access-ft8zw") pod "3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170" (UID: "3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170"). InnerVolumeSpecName "kube-api-access-ft8zw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:47:48.910140 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:48.910101 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:48.918242 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:48.918174 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft8zw\" (UniqueName: \"kubernetes.io/projected/3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170-kube-api-access-ft8zw\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:48.918242 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:48.918198 2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170-plugins-config-volume\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:47:49.011863 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:49.011616 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:49.365931 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:49.365894 2573 generic.go:356] "Generic (PLEG): container finished" podID="3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170" containerID="91ad4711a76024c7eecb131629c0cfc5b28f5a4850edfcd643874cb34caed522" exitCode=0 Sep 15 21:47:49.366151 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:49.365943 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv" Sep 15 21:47:49.366151 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:49.365989 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv" event={"ID":"3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170","Type":"ContainerDied","Data":"91ad4711a76024c7eecb131629c0cfc5b28f5a4850edfcd643874cb34caed522"} Sep 15 21:47:49.366151 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:49.366045 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv" event={"ID":"3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170","Type":"ContainerDied","Data":"7334e99e6a27043c45b0fc55dd17329148713cdb51c70736b07f2bff2d983f57"} Sep 15 21:47:49.366151 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:49.366066 2573 scope.go:117] "RemoveContainer" containerID="91ad4711a76024c7eecb131629c0cfc5b28f5a4850edfcd643874cb34caed522" Sep 15 21:47:49.375832 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:49.375816 2573 scope.go:117] "RemoveContainer" containerID="91ad4711a76024c7eecb131629c0cfc5b28f5a4850edfcd643874cb34caed522" Sep 15 21:47:49.376145 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:47:49.376126 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91ad4711a76024c7eecb131629c0cfc5b28f5a4850edfcd643874cb34caed522\": container with ID starting with 91ad4711a76024c7eecb131629c0cfc5b28f5a4850edfcd643874cb34caed522 not found: ID does not exist" containerID="91ad4711a76024c7eecb131629c0cfc5b28f5a4850edfcd643874cb34caed522" Sep 15 21:47:49.376396 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:49.376154 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91ad4711a76024c7eecb131629c0cfc5b28f5a4850edfcd643874cb34caed522"} err="failed to get container status \"91ad4711a76024c7eecb131629c0cfc5b28f5a4850edfcd643874cb34caed522\": rpc error: code = NotFound desc = could not find container \"91ad4711a76024c7eecb131629c0cfc5b28f5a4850edfcd643874cb34caed522\": container with ID starting with 91ad4711a76024c7eecb131629c0cfc5b28f5a4850edfcd643874cb34caed522 not found: ID does not exist" Sep 15 21:47:49.388115 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:49.388083 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv"] Sep 15 21:47:49.392793 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:49.392770 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv"] Sep 15 21:47:49.564258 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:49.564219 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:49.935065 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:49.935032 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f51a74f-ad5b-445b-97a1-262b4eeadb6f" path="/var/lib/kubelet/pods/1f51a74f-ad5b-445b-97a1-262b4eeadb6f/volumes" Sep 15 21:47:49.935410 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:49.935397 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170" path="/var/lib/kubelet/pods/3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170/volumes" Sep 15 21:47:50.231424 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:50.231382 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:51.281047 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:51.281007 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:51.914696 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:51.914663 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:52.632791 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:52.632755 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:54.707822 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:54.707784 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:54.807920 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:54.807875 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:54.936531 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:54.936489 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt"] Sep 15 21:47:54.936768 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:54.936739 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" podUID="8cd63baa-d66d-420c-b239-a845375496ee" containerName="istio-proxy" containerID="cri-o://706394a76cb57e357c83ee3c48c7649c0da6ad265c306dd34aad098373f48d83" gracePeriod=30 Sep 15 21:47:54.961173 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:54.961096 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:55.495043 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.495010 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:55.764886 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.764791 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5"] Sep 15 21:47:55.765420 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.765401 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="461c3497-1851-48ea-acdd-9cf97c9ea1a8" containerName="istio-proxy" Sep 15 21:47:55.765469 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.765425 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="461c3497-1851-48ea-acdd-9cf97c9ea1a8" containerName="istio-proxy" Sep 15 21:47:55.765469 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.765461 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f51a74f-ad5b-445b-97a1-262b4eeadb6f" containerName="revoke-keys" Sep 15 21:47:55.765575 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.765469 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f51a74f-ad5b-445b-97a1-262b4eeadb6f" containerName="revoke-keys" Sep 15 21:47:55.765575 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.765492 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170" containerName="payload-processing" Sep 15 21:47:55.765575 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.765500 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170" containerName="payload-processing" Sep 15 21:47:55.765677 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.765589 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="461c3497-1851-48ea-acdd-9cf97c9ea1a8" containerName="istio-proxy" Sep 15 21:47:55.765677 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.765602 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="461c3497-1851-48ea-acdd-9cf97c9ea1a8" containerName="istio-proxy" Sep 15 21:47:55.765677 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.765612 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ae0e0cc-a5b4-4dd6-935d-3fcb8831c170" containerName="payload-processing" Sep 15 21:47:55.765677 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.765623 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f51a74f-ad5b-445b-97a1-262b4eeadb6f" containerName="revoke-keys" Sep 15 21:47:55.770618 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.770597 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.772999 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.772970 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-ce3ab0-openshift-default-dockercfg-5dmnk\"" Sep 15 21:47:55.780092 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.780066 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5"] Sep 15 21:47:55.795272 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.795241 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:55.891111 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.891072 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-credential-socket\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.891390 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.891366 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9252m\" (UniqueName: \"kubernetes.io/projected/e2d63d60-cc36-4f88-847b-6f8b67faa894-kube-api-access-9252m\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.891585 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.891569 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2d63d60-cc36-4f88-847b-6f8b67faa894-istiod-ca-cert\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.891722 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.891706 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-istio-envoy\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.891891 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.891871 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2d63d60-cc36-4f88-847b-6f8b67faa894-istio-podinfo\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.892040 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.892024 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-workload-certs\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.892199 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.892183 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-workload-socket\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.892321 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.892304 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2d63d60-cc36-4f88-847b-6f8b67faa894-istio-token\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.892448 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.892432 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-istio-data\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.993908 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.993867 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-workload-socket\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.994093 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.993922 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2d63d60-cc36-4f88-847b-6f8b67faa894-istio-token\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.994093 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.993952 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-istio-data\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.994093 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.994002 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-credential-socket\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.994093 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.994036 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9252m\" (UniqueName: \"kubernetes.io/projected/e2d63d60-cc36-4f88-847b-6f8b67faa894-kube-api-access-9252m\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.994335 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.994122 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2d63d60-cc36-4f88-847b-6f8b67faa894-istiod-ca-cert\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.994335 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.994153 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-istio-envoy\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.994335 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.994214 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2d63d60-cc36-4f88-847b-6f8b67faa894-istio-podinfo\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.994335 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.994266 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-workload-socket\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.994335 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.994278 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-workload-certs\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.994564 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.994442 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-credential-socket\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.994564 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.994546 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-workload-certs\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.994650 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.994625 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-istio-data\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.994870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.994835 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2d63d60-cc36-4f88-847b-6f8b67faa894-istiod-ca-cert\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.996405 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.996381 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-istio-envoy\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:55.996520 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:55.996503 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2d63d60-cc36-4f88-847b-6f8b67faa894-istio-podinfo\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:56.001742 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:56.001716 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9252m\" (UniqueName: \"kubernetes.io/projected/e2d63d60-cc36-4f88-847b-6f8b67faa894-kube-api-access-9252m\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:56.001833 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:56.001754 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2d63d60-cc36-4f88-847b-6f8b67faa894-istio-token\") pod \"e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:56.082820 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:56.082723 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:56.235986 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:56.235924 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:56.357935 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:56.357900 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5"] Sep 15 21:47:56.358286 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:47:56.358263 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d63d60_cc36_4f88_847b_6f8b67faa894.slice/crio-36612756add4a0fb3edd7d360f00dfa4e6a058cd32fed1b9a21230d81fe5a337 WatchSource:0}: Error finding container 36612756add4a0fb3edd7d360f00dfa4e6a058cd32fed1b9a21230d81fe5a337: Status 404 returned error can't find the container with id 36612756add4a0fb3edd7d360f00dfa4e6a058cd32fed1b9a21230d81fe5a337 Sep 15 21:47:56.360605 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:56.360569 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:47:56.360715 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:56.360649 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:47:56.360715 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:56.360695 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:47:56.408786 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:56.408761 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" event={"ID":"e2d63d60-cc36-4f88-847b-6f8b67faa894","Type":"ContainerStarted","Data":"36612756add4a0fb3edd7d360f00dfa4e6a058cd32fed1b9a21230d81fe5a337"} Sep 15 21:47:57.415589 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:57.415553 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" event={"ID":"e2d63d60-cc36-4f88-847b-6f8b67faa894","Type":"ContainerStarted","Data":"57d18321c2ffbb24a7bfbef34fe37871b31ad4ad474d6520fc811a1ca8c1891c"} Sep 15 21:47:57.435582 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:57.435528 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" podStartSLOduration=2.435511282 podStartE2EDuration="2.435511282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:47:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:47:57.433085078 +0000 UTC m=+1332.019682672" watchObservedRunningTime="2026-09-15 21:47:57.435511282 +0000 UTC m=+1332.022108873" Sep 15 21:47:58.083184 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:58.083145 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:58.088749 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:58.088719 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:58.422946 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:58.422863 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:58.423754 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:58.423738 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:47:58.653838 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:58.653804 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:59.261606 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:59.261568 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:47:59.362119 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:47:59.362088 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:00.202713 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.202652 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:48:00.338067 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.338033 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-credential-socket\") pod \"8cd63baa-d66d-420c-b239-a845375496ee\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " Sep 15 21:48:00.338239 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.338078 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-workload-socket\") pod \"8cd63baa-d66d-420c-b239-a845375496ee\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " Sep 15 21:48:00.338239 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.338155 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cd63baa-d66d-420c-b239-a845375496ee-istiod-ca-cert\") pod \"8cd63baa-d66d-420c-b239-a845375496ee\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " Sep 15 21:48:00.338239 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.338208 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cd63baa-d66d-420c-b239-a845375496ee-istio-podinfo\") pod \"8cd63baa-d66d-420c-b239-a845375496ee\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " Sep 15 21:48:00.338239 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.338234 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-istio-data\") pod \"8cd63baa-d66d-420c-b239-a845375496ee\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " Sep 15 21:48:00.338470 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.338294 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8cd63baa-d66d-420c-b239-a845375496ee" (UID: "8cd63baa-d66d-420c-b239-a845375496ee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:48:00.338470 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.338377 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wn2j8\" (UniqueName: \"kubernetes.io/projected/8cd63baa-d66d-420c-b239-a845375496ee-kube-api-access-wn2j8\") pod \"8cd63baa-d66d-420c-b239-a845375496ee\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " Sep 15 21:48:00.338470 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.338390 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8cd63baa-d66d-420c-b239-a845375496ee" (UID: "8cd63baa-d66d-420c-b239-a845375496ee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:48:00.338470 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.338449 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-workload-certs\") pod \"8cd63baa-d66d-420c-b239-a845375496ee\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " Sep 15 21:48:00.338682 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.338479 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-istio-envoy\") pod \"8cd63baa-d66d-420c-b239-a845375496ee\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " Sep 15 21:48:00.338682 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.338503 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-istio-data" (OuterVolumeSpecName: "istio-data") pod "8cd63baa-d66d-420c-b239-a845375496ee" (UID: "8cd63baa-d66d-420c-b239-a845375496ee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:48:00.338682 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.338527 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cd63baa-d66d-420c-b239-a845375496ee-istio-token\") pod \"8cd63baa-d66d-420c-b239-a845375496ee\" (UID: \"8cd63baa-d66d-420c-b239-a845375496ee\") " Sep 15 21:48:00.338682 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.338564 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cd63baa-d66d-420c-b239-a845375496ee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8cd63baa-d66d-420c-b239-a845375496ee" (UID: "8cd63baa-d66d-420c-b239-a845375496ee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:48:00.338914 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.338693 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8cd63baa-d66d-420c-b239-a845375496ee" (UID: "8cd63baa-d66d-420c-b239-a845375496ee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:48:00.338914 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.338908 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-istio-data\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:48:00.339025 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.338928 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-workload-certs\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:48:00.339025 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.338943 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-credential-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:48:00.339025 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.338957 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-workload-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:48:00.339025 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.338971 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cd63baa-d66d-420c-b239-a845375496ee-istiod-ca-cert\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:48:00.340466 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.340431 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cd63baa-d66d-420c-b239-a845375496ee-kube-api-access-wn2j8" (OuterVolumeSpecName: "kube-api-access-wn2j8") pod "8cd63baa-d66d-420c-b239-a845375496ee" (UID: "8cd63baa-d66d-420c-b239-a845375496ee"). InnerVolumeSpecName "kube-api-access-wn2j8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:48:00.340466 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.340452 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8cd63baa-d66d-420c-b239-a845375496ee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8cd63baa-d66d-420c-b239-a845375496ee" (UID: "8cd63baa-d66d-420c-b239-a845375496ee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 15 21:48:00.340640 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.340482 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8cd63baa-d66d-420c-b239-a845375496ee" (UID: "8cd63baa-d66d-420c-b239-a845375496ee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:48:00.340640 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.340575 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cd63baa-d66d-420c-b239-a845375496ee-istio-token" (OuterVolumeSpecName: "istio-token") pod "8cd63baa-d66d-420c-b239-a845375496ee" (UID: "8cd63baa-d66d-420c-b239-a845375496ee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:48:00.360241 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.360216 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:00.440393 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.440350 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cd63baa-d66d-420c-b239-a845375496ee-istio-podinfo\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:48:00.440393 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.440382 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wn2j8\" (UniqueName: \"kubernetes.io/projected/8cd63baa-d66d-420c-b239-a845375496ee-kube-api-access-wn2j8\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:48:00.440393 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.440397 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cd63baa-d66d-420c-b239-a845375496ee-istio-envoy\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:48:00.440665 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.440410 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cd63baa-d66d-420c-b239-a845375496ee-istio-token\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:48:00.441717 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.441690 2573 generic.go:356] "Generic (PLEG): container finished" podID="8cd63baa-d66d-420c-b239-a845375496ee" containerID="706394a76cb57e357c83ee3c48c7649c0da6ad265c306dd34aad098373f48d83" exitCode=0 Sep 15 21:48:00.441874 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.441756 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" Sep 15 21:48:00.441874 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.441775 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" event={"ID":"8cd63baa-d66d-420c-b239-a845375496ee","Type":"ContainerDied","Data":"706394a76cb57e357c83ee3c48c7649c0da6ad265c306dd34aad098373f48d83"} Sep 15 21:48:00.441874 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.441842 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt" event={"ID":"8cd63baa-d66d-420c-b239-a845375496ee","Type":"ContainerDied","Data":"c5431801dfc5c614d5ab3bf135daac6774055dba585ce2363bd0302b226fc409"} Sep 15 21:48:00.442044 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.441907 2573 scope.go:117] "RemoveContainer" containerID="706394a76cb57e357c83ee3c48c7649c0da6ad265c306dd34aad098373f48d83" Sep 15 21:48:00.452166 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.452149 2573 scope.go:117] "RemoveContainer" containerID="2dfd1aebea2e6e9ebeb765ccc1d2af55c91426923a2e8b4ffda07ebeaaa02af1" Sep 15 21:48:00.460661 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.460643 2573 scope.go:117] "RemoveContainer" containerID="706394a76cb57e357c83ee3c48c7649c0da6ad265c306dd34aad098373f48d83" Sep 15 21:48:00.460974 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:48:00.460946 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"706394a76cb57e357c83ee3c48c7649c0da6ad265c306dd34aad098373f48d83\": container with ID starting with 706394a76cb57e357c83ee3c48c7649c0da6ad265c306dd34aad098373f48d83 not found: ID does not exist" containerID="706394a76cb57e357c83ee3c48c7649c0da6ad265c306dd34aad098373f48d83" Sep 15 21:48:00.461078 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.461032 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"706394a76cb57e357c83ee3c48c7649c0da6ad265c306dd34aad098373f48d83"} err="failed to get container status \"706394a76cb57e357c83ee3c48c7649c0da6ad265c306dd34aad098373f48d83\": rpc error: code = NotFound desc = could not find container \"706394a76cb57e357c83ee3c48c7649c0da6ad265c306dd34aad098373f48d83\": container with ID starting with 706394a76cb57e357c83ee3c48c7649c0da6ad265c306dd34aad098373f48d83 not found: ID does not exist" Sep 15 21:48:00.461078 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.461059 2573 scope.go:117] "RemoveContainer" containerID="2dfd1aebea2e6e9ebeb765ccc1d2af55c91426923a2e8b4ffda07ebeaaa02af1" Sep 15 21:48:00.461515 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:48:00.461453 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dfd1aebea2e6e9ebeb765ccc1d2af55c91426923a2e8b4ffda07ebeaaa02af1\": container with ID starting with 2dfd1aebea2e6e9ebeb765ccc1d2af55c91426923a2e8b4ffda07ebeaaa02af1 not found: ID does not exist" containerID="2dfd1aebea2e6e9ebeb765ccc1d2af55c91426923a2e8b4ffda07ebeaaa02af1" Sep 15 21:48:00.461515 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.461486 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dfd1aebea2e6e9ebeb765ccc1d2af55c91426923a2e8b4ffda07ebeaaa02af1"} err="failed to get container status \"2dfd1aebea2e6e9ebeb765ccc1d2af55c91426923a2e8b4ffda07ebeaaa02af1\": rpc error: code = NotFound desc = could not find container \"2dfd1aebea2e6e9ebeb765ccc1d2af55c91426923a2e8b4ffda07ebeaaa02af1\": container with ID starting with 2dfd1aebea2e6e9ebeb765ccc1d2af55c91426923a2e8b4ffda07ebeaaa02af1 not found: ID does not exist" Sep 15 21:48:00.467901 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.466482 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt"] Sep 15 21:48:00.473311 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:00.473290 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt"] Sep 15 21:48:01.160990 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:01.160950 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:01.573797 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:01.573764 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:01.836886 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:01.836784 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:01.934131 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:01.934096 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cd63baa-d66d-420c-b239-a845375496ee" path="/var/lib/kubelet/pods/8cd63baa-d66d-420c-b239-a845375496ee/volumes" Sep 15 21:48:02.578526 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:02.578493 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:03.337616 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.337580 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb"] Sep 15 21:48:03.338063 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.338045 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd63baa-d66d-420c-b239-a845375496ee" containerName="istio-proxy" Sep 15 21:48:03.338156 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.338065 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd63baa-d66d-420c-b239-a845375496ee" containerName="istio-proxy" Sep 15 21:48:03.338156 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.338081 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd63baa-d66d-420c-b239-a845375496ee" containerName="istio-proxy" Sep 15 21:48:03.338156 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.338090 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd63baa-d66d-420c-b239-a845375496ee" containerName="istio-proxy" Sep 15 21:48:03.338156 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.338129 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="461c3497-1851-48ea-acdd-9cf97c9ea1a8" containerName="istio-proxy" Sep 15 21:48:03.338156 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.338139 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="461c3497-1851-48ea-acdd-9cf97c9ea1a8" containerName="istio-proxy" Sep 15 21:48:03.338500 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.338256 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cd63baa-d66d-420c-b239-a845375496ee" containerName="istio-proxy" Sep 15 21:48:03.338500 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.338273 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cd63baa-d66d-420c-b239-a845375496ee" containerName="istio-proxy" Sep 15 21:48:03.342738 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.342718 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb" Sep 15 21:48:03.345929 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.345520 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-ce3ab0-serving-cert\"" Sep 15 21:48:03.345929 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.345736 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 15 21:48:03.346874 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.346834 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5bmlq\"" Sep 15 21:48:03.347005 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.346837 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 15 21:48:03.347092 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.346892 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 15 21:48:03.350974 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.350950 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb"] Sep 15 21:48:03.388703 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.388673 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:03.472964 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.472931 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2466ff73-beaf-48b1-91e9-6759264dd651-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb\" (UID: \"2466ff73-beaf-48b1-91e9-6759264dd651\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb" Sep 15 21:48:03.473138 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.472980 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2466ff73-beaf-48b1-91e9-6759264dd651-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb\" (UID: \"2466ff73-beaf-48b1-91e9-6759264dd651\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb" Sep 15 21:48:03.473138 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.473083 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z74wc\" (UniqueName: \"kubernetes.io/projected/2466ff73-beaf-48b1-91e9-6759264dd651-kube-api-access-z74wc\") pod \"maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb\" (UID: \"2466ff73-beaf-48b1-91e9-6759264dd651\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb" Sep 15 21:48:03.473217 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.473159 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2466ff73-beaf-48b1-91e9-6759264dd651-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb\" (UID: \"2466ff73-beaf-48b1-91e9-6759264dd651\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb" Sep 15 21:48:03.489935 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.489880 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:03.573895 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.573840 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2466ff73-beaf-48b1-91e9-6759264dd651-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb\" (UID: \"2466ff73-beaf-48b1-91e9-6759264dd651\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb" Sep 15 21:48:03.574089 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.573951 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2466ff73-beaf-48b1-91e9-6759264dd651-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb\" (UID: \"2466ff73-beaf-48b1-91e9-6759264dd651\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb" Sep 15 21:48:03.574089 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.573976 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2466ff73-beaf-48b1-91e9-6759264dd651-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb\" (UID: \"2466ff73-beaf-48b1-91e9-6759264dd651\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb" Sep 15 21:48:03.574089 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.574031 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z74wc\" (UniqueName: \"kubernetes.io/projected/2466ff73-beaf-48b1-91e9-6759264dd651-kube-api-access-z74wc\") pod \"maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb\" (UID: \"2466ff73-beaf-48b1-91e9-6759264dd651\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb" Sep 15 21:48:03.574679 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.574656 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2466ff73-beaf-48b1-91e9-6759264dd651-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb\" (UID: \"2466ff73-beaf-48b1-91e9-6759264dd651\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb" Sep 15 21:48:03.576278 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.576260 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2466ff73-beaf-48b1-91e9-6759264dd651-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb\" (UID: \"2466ff73-beaf-48b1-91e9-6759264dd651\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb" Sep 15 21:48:03.576379 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.576360 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2466ff73-beaf-48b1-91e9-6759264dd651-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb\" (UID: \"2466ff73-beaf-48b1-91e9-6759264dd651\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb" Sep 15 21:48:03.581501 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.581476 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z74wc\" (UniqueName: \"kubernetes.io/projected/2466ff73-beaf-48b1-91e9-6759264dd651-kube-api-access-z74wc\") pod \"maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb\" (UID: \"2466ff73-beaf-48b1-91e9-6759264dd651\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb" Sep 15 21:48:03.591011 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.590946 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:03.657502 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.657466 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb" Sep 15 21:48:03.916602 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.916517 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:03.934286 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:48:03.934226 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2466ff73_beaf_48b1_91e9_6759264dd651.slice/crio-05c3573135f9f1dae7611fa91beb05698e195c2e56c40fae23d1413b5e376d48 WatchSource:0}: Error finding container 05c3573135f9f1dae7611fa91beb05698e195c2e56c40fae23d1413b5e376d48: Status 404 returned error can't find the container with id 05c3573135f9f1dae7611fa91beb05698e195c2e56c40fae23d1413b5e376d48 Sep 15 21:48:03.935839 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:03.935817 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb"] Sep 15 21:48:04.020465 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.020426 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4"] Sep 15 21:48:04.021429 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.021392 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:04.025309 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.025291 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4" Sep 15 21:48:04.027714 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.027695 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-ce3ab0\"" Sep 15 21:48:04.027831 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.027733 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-ce3ab0-dockercfg-7jf4n\"" Sep 15 21:48:04.034273 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.034249 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4"] Sep 15 21:48:04.056409 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.056378 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd"] Sep 15 21:48:04.060060 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.060042 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd" Sep 15 21:48:04.071303 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.071258 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd"] Sep 15 21:48:04.180285 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.180183 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxph8\" (UniqueName: \"kubernetes.io/projected/2621b231-dfd0-49d5-9337-252efc1c9955-kube-api-access-hxph8\") pod \"payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd\" (UID: \"2621b231-dfd0-49d5-9337-252efc1c9955\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd" Sep 15 21:48:04.180466 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.180339 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47d9r\" (UniqueName: \"kubernetes.io/projected/9a66fe33-c761-43be-a3ee-a8457e6bf2b2-kube-api-access-47d9r\") pod \"payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4\" (UID: \"9a66fe33-c761-43be-a3ee-a8457e6bf2b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4" Sep 15 21:48:04.180466 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.180430 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2621b231-dfd0-49d5-9337-252efc1c9955-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd\" (UID: \"2621b231-dfd0-49d5-9337-252efc1c9955\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd" Sep 15 21:48:04.180595 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.180537 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a66fe33-c761-43be-a3ee-a8457e6bf2b2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4\" (UID: \"9a66fe33-c761-43be-a3ee-a8457e6bf2b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4" Sep 15 21:48:04.281759 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.281725 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47d9r\" (UniqueName: \"kubernetes.io/projected/9a66fe33-c761-43be-a3ee-a8457e6bf2b2-kube-api-access-47d9r\") pod \"payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4\" (UID: \"9a66fe33-c761-43be-a3ee-a8457e6bf2b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4" Sep 15 21:48:04.281941 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.281786 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2621b231-dfd0-49d5-9337-252efc1c9955-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd\" (UID: \"2621b231-dfd0-49d5-9337-252efc1c9955\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd" Sep 15 21:48:04.281941 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.281896 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a66fe33-c761-43be-a3ee-a8457e6bf2b2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4\" (UID: \"9a66fe33-c761-43be-a3ee-a8457e6bf2b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4" Sep 15 21:48:04.281941 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.281928 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxph8\" (UniqueName: \"kubernetes.io/projected/2621b231-dfd0-49d5-9337-252efc1c9955-kube-api-access-hxph8\") pod \"payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd\" (UID: \"2621b231-dfd0-49d5-9337-252efc1c9955\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd" Sep 15 21:48:04.282669 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.282648 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a66fe33-c761-43be-a3ee-a8457e6bf2b2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4\" (UID: \"9a66fe33-c761-43be-a3ee-a8457e6bf2b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4" Sep 15 21:48:04.282720 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.282689 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2621b231-dfd0-49d5-9337-252efc1c9955-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd\" (UID: \"2621b231-dfd0-49d5-9337-252efc1c9955\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd" Sep 15 21:48:04.289682 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.289657 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47d9r\" (UniqueName: \"kubernetes.io/projected/9a66fe33-c761-43be-a3ee-a8457e6bf2b2-kube-api-access-47d9r\") pod \"payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4\" (UID: \"9a66fe33-c761-43be-a3ee-a8457e6bf2b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4" Sep 15 21:48:04.289834 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.289807 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxph8\" (UniqueName: \"kubernetes.io/projected/2621b231-dfd0-49d5-9337-252efc1c9955-kube-api-access-hxph8\") pod \"payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd\" (UID: \"2621b231-dfd0-49d5-9337-252efc1c9955\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd" Sep 15 21:48:04.337660 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.337626 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4" Sep 15 21:48:04.372446 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.372417 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd" Sep 15 21:48:04.471090 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.471059 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb" event={"ID":"2466ff73-beaf-48b1-91e9-6759264dd651","Type":"ContainerStarted","Data":"05c3573135f9f1dae7611fa91beb05698e195c2e56c40fae23d1413b5e376d48"} Sep 15 21:48:04.611551 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.611518 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4"] Sep 15 21:48:04.612163 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:48:04.612134 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a66fe33_c761_43be_a3ee_a8457e6bf2b2.slice/crio-f2eeb168c7cdfb1cf8cc266123ab771b5b901a0de50160c43338a5e9b38fabe1 WatchSource:0}: Error finding container f2eeb168c7cdfb1cf8cc266123ab771b5b901a0de50160c43338a5e9b38fabe1: Status 404 returned error can't find the container with id f2eeb168c7cdfb1cf8cc266123ab771b5b901a0de50160c43338a5e9b38fabe1 Sep 15 21:48:04.653056 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:04.653031 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd"] Sep 15 21:48:04.655395 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:48:04.655368 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2621b231_dfd0_49d5_9337_252efc1c9955.slice/crio-587b66dcc23fd64e51a860e8ef431c2a5c48398e5faa6fbb31a94d6bf7294971 WatchSource:0}: Error finding container 587b66dcc23fd64e51a860e8ef431c2a5c48398e5faa6fbb31a94d6bf7294971: Status 404 returned error can't find the container with id 587b66dcc23fd64e51a860e8ef431c2a5c48398e5faa6fbb31a94d6bf7294971 Sep 15 21:48:05.483182 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:05.483138 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd" event={"ID":"2621b231-dfd0-49d5-9337-252efc1c9955","Type":"ContainerStarted","Data":"d1e009c035c7c4e6aa22ce5d1af359fef7c2000a845e789fde52f83699ddb0d9"} Sep 15 21:48:05.483345 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:05.483252 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd" event={"ID":"2621b231-dfd0-49d5-9337-252efc1c9955","Type":"ContainerStarted","Data":"587b66dcc23fd64e51a860e8ef431c2a5c48398e5faa6fbb31a94d6bf7294971"} Sep 15 21:48:05.483806 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:05.483783 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd" Sep 15 21:48:05.485445 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:05.485416 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4" event={"ID":"9a66fe33-c761-43be-a3ee-a8457e6bf2b2","Type":"ContainerStarted","Data":"b54284ee86b00d00089910938efab9bdf6fc8f3a72d713f477d6e01bb79196ec"} Sep 15 21:48:05.485575 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:05.485464 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4" event={"ID":"9a66fe33-c761-43be-a3ee-a8457e6bf2b2","Type":"ContainerStarted","Data":"f2eeb168c7cdfb1cf8cc266123ab771b5b901a0de50160c43338a5e9b38fabe1"} Sep 15 21:48:05.485903 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:05.485883 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4" Sep 15 21:48:05.501881 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:05.501811 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd" podStartSLOduration=1.50179467 podStartE2EDuration="1.50179467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:48:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:48:05.498312455 +0000 UTC m=+1340.084910048" watchObservedRunningTime="2026-09-15 21:48:05.50179467 +0000 UTC m=+1340.088392293" Sep 15 21:48:05.514189 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:05.514128 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4" podStartSLOduration=1.5141094229999998 podStartE2EDuration="1.514109423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:48:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:48:05.512204882 +0000 UTC m=+1340.098802477" watchObservedRunningTime="2026-09-15 21:48:05.514109423 +0000 UTC m=+1340.100707017" Sep 15 21:48:07.501945 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:07.501907 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb" event={"ID":"2466ff73-beaf-48b1-91e9-6759264dd651","Type":"ContainerStarted","Data":"6af0a168de5cd8f44fb664f0161b5bb13b7f3c7cfb4c8ba7aeb84c02575124ef"} Sep 15 21:48:07.502341 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:07.501973 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb" Sep 15 21:48:07.521237 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:07.521189 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb" podStartSLOduration=1.8338395859999999 podStartE2EDuration="4.521173239s" totalImagesPullingTime="2.687333653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:48:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:48:07.517790456 +0000 UTC m=+1342.104388043" watchObservedRunningTime="2026-09-15 21:48:07.521173239 +0000 UTC m=+1342.107770832" Sep 15 21:48:13.512893 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:13.512801 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb" Sep 15 21:48:16.496004 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:16.495973 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd" Sep 15 21:48:16.496362 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:16.496044 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4" Sep 15 21:48:25.405243 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:25.405203 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:26.123825 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:26.123783 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:26.758653 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:26.758623 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:27.392426 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:27.392392 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:28.187801 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:28.187761 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:28.288447 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:28.288404 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:28.848429 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:28.848388 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:29.376552 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:29.376513 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:29.464037 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:29.463994 2573 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Sep 15 21:48:29.464208 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:29.464059 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" podUID="e2d63d60-cc36-4f88-847b-6f8b67faa894" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 15 21:48:29.487960 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:29.487925 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:29.717082 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:29.717050 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:29.997253 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:29.997163 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb"] Sep 15 21:48:30.001231 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.001206 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.003549 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.003527 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-e7a648-openshift-default-dockercfg-kcq5g\"" Sep 15 21:48:30.012903 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.012875 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb"] Sep 15 21:48:30.021191 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.021162 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:30.150493 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.150462 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-workload-certs\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.150655 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.150513 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-workload-socket\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.150655 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.150543 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istio-data\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.150730 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.150687 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istiod-ca-cert\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.150770 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.150749 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istio-envoy\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.150819 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.150799 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istio-podinfo\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.150866 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.150836 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istio-token\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.150925 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.150909 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-credential-socket\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.150966 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.150941 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p5z7\" (UniqueName: \"kubernetes.io/projected/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-kube-api-access-7p5z7\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.251804 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.251720 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istio-podinfo\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.251804 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.251759 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istio-token\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.253278 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.251809 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-credential-socket\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.253278 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.251834 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p5z7\" (UniqueName: \"kubernetes.io/projected/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-kube-api-access-7p5z7\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.253278 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.251894 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-workload-certs\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.253278 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.251950 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-workload-socket\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.253278 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.251988 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istio-data\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.253278 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.252066 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istiod-ca-cert\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.253278 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.252109 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istio-envoy\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.253278 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.252360 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-credential-socket\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.253278 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.252482 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-workload-socket\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.253278 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.252508 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-workload-certs\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.253278 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.252546 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istio-data\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.253278 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.252907 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istiod-ca-cert\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.254274 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.254255 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istio-podinfo\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.254642 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.254625 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istio-envoy\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.259206 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.259181 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istio-token\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.259619 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.259598 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p5z7\" (UniqueName: \"kubernetes.io/projected/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-kube-api-access-7p5z7\") pod \"e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.314808 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.314782 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:30.380872 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.378828 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:30.590212 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.590188 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb"] Sep 15 21:48:30.591459 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:48:30.591432 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73721755_fbf7_4b60_8e61_2b4fc17ba3d7.slice/crio-5ade9fd2955f45e3cf0d7f1b3d8829c8ced1dd73a8c29ea31b1f9105ee4678cf WatchSource:0}: Error finding container 5ade9fd2955f45e3cf0d7f1b3d8829c8ced1dd73a8c29ea31b1f9105ee4678cf: Status 404 returned error can't find the container with id 5ade9fd2955f45e3cf0d7f1b3d8829c8ced1dd73a8c29ea31b1f9105ee4678cf Sep 15 21:48:30.594035 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.593994 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:48:30.594112 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.594091 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:48:30.594159 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.594144 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:48:30.643250 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.643201 2573 generic.go:356] "Generic (PLEG): container finished" podID="e2d63d60-cc36-4f88-847b-6f8b67faa894" containerID="57d18321c2ffbb24a7bfbef34fe37871b31ad4ad474d6520fc811a1ca8c1891c" exitCode=0 Sep 15 21:48:30.643250 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.643240 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" event={"ID":"e2d63d60-cc36-4f88-847b-6f8b67faa894","Type":"ContainerDied","Data":"57d18321c2ffbb24a7bfbef34fe37871b31ad4ad474d6520fc811a1ca8c1891c"} Sep 15 21:48:30.643760 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.643741 2573 scope.go:117] "RemoveContainer" containerID="57d18321c2ffbb24a7bfbef34fe37871b31ad4ad474d6520fc811a1ca8c1891c" Sep 15 21:48:30.644793 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.644770 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" event={"ID":"73721755-fbf7-4b60-8e61-2b4fc17ba3d7","Type":"ContainerStarted","Data":"5ade9fd2955f45e3cf0d7f1b3d8829c8ced1dd73a8c29ea31b1f9105ee4678cf"} Sep 15 21:48:30.644987 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.644962 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:48:30.645042 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.645026 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:48:30.645081 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:30.645059 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:48:31.652778 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:31.652734 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" event={"ID":"73721755-fbf7-4b60-8e61-2b4fc17ba3d7","Type":"ContainerStarted","Data":"de2090b2b689d127d1168af3aaaebaed36b4fe25f521deb0680eba580402e632"} Sep 15 21:48:31.654786 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:31.654765 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" event={"ID":"e2d63d60-cc36-4f88-847b-6f8b67faa894","Type":"ContainerStarted","Data":"179ce763ad13c0ef924ebbb187125af658b1492f2ef574ede0140ba58cc058f9"} Sep 15 21:48:31.672101 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:31.672057 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" podStartSLOduration=2.672042937 podStartE2EDuration="2.672042937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:48:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:48:31.670219312 +0000 UTC m=+1366.256816904" watchObservedRunningTime="2026-09-15 21:48:31.672042937 +0000 UTC m=+1366.258640528" Sep 15 21:48:32.083895 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:32.083837 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:48:32.084093 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:32.083944 2573 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Sep 15 21:48:32.084093 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:32.084009 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" podUID="e2d63d60-cc36-4f88-847b-6f8b67faa894" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Sep 15 21:48:32.315089 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:32.315048 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:32.320483 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:32.320457 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:32.660622 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:32.660583 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:32.661574 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:32.661551 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:32.930026 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:32.929933 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:33.083293 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:33.083253 2573 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Sep 15 21:48:33.083569 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:33.083539 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" podUID="e2d63d60-cc36-4f88-847b-6f8b67faa894" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Sep 15 21:48:33.550202 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:33.550147 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:33.650822 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:33.650784 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:33.751049 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:33.750976 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:34.084173 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:34.084129 2573 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Sep 15 21:48:34.084401 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:34.084198 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" podUID="e2d63d60-cc36-4f88-847b-6f8b67faa894" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Sep 15 21:48:34.390742 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:34.390614 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:35.056238 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:35.056209 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:35.083392 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:35.083341 2573 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Sep 15 21:48:35.083565 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:35.083418 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" podUID="e2d63d60-cc36-4f88-847b-6f8b67faa894" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Sep 15 21:48:35.815905 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:35.815869 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:36.084118 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:36.084024 2573 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Sep 15 21:48:36.084576 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:36.084107 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" podUID="e2d63d60-cc36-4f88-847b-6f8b67faa894" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Sep 15 21:48:36.439886 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:36.439765 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:37.062532 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:37.062494 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:37.083299 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:37.083261 2573 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Sep 15 21:48:37.083569 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:37.083538 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" podUID="e2d63d60-cc36-4f88-847b-6f8b67faa894" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Sep 15 21:48:37.844973 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:37.844936 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8"] Sep 15 21:48:37.855384 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:37.855350 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8" Sep 15 21:48:37.856824 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:37.856800 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8"] Sep 15 21:48:37.858007 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:37.857979 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-e7a648-serving-cert\"" Sep 15 21:48:37.873896 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:37.873872 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:37.938589 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:37.938550 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b0b120b-daa7-4a91-8291-ec10a6825cce-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8\" (UID: \"4b0b120b-daa7-4a91-8291-ec10a6825cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8" Sep 15 21:48:37.938759 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:37.938663 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmjw9\" (UniqueName: \"kubernetes.io/projected/4b0b120b-daa7-4a91-8291-ec10a6825cce-kube-api-access-lmjw9\") pod \"maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8\" (UID: \"4b0b120b-daa7-4a91-8291-ec10a6825cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8" Sep 15 21:48:37.938759 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:37.938747 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b0b120b-daa7-4a91-8291-ec10a6825cce-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8\" (UID: \"4b0b120b-daa7-4a91-8291-ec10a6825cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8" Sep 15 21:48:37.938840 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:37.938778 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0b120b-daa7-4a91-8291-ec10a6825cce-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8\" (UID: \"4b0b120b-daa7-4a91-8291-ec10a6825cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8" Sep 15 21:48:38.010620 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.010567 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:38.040125 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.040086 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b0b120b-daa7-4a91-8291-ec10a6825cce-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8\" (UID: \"4b0b120b-daa7-4a91-8291-ec10a6825cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8" Sep 15 21:48:38.040311 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.040173 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmjw9\" (UniqueName: \"kubernetes.io/projected/4b0b120b-daa7-4a91-8291-ec10a6825cce-kube-api-access-lmjw9\") pod \"maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8\" (UID: \"4b0b120b-daa7-4a91-8291-ec10a6825cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8" Sep 15 21:48:38.040311 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.040275 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b0b120b-daa7-4a91-8291-ec10a6825cce-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8\" (UID: \"4b0b120b-daa7-4a91-8291-ec10a6825cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8" Sep 15 21:48:38.040311 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.040305 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0b120b-daa7-4a91-8291-ec10a6825cce-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8\" (UID: \"4b0b120b-daa7-4a91-8291-ec10a6825cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8" Sep 15 21:48:38.041057 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.041032 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b0b120b-daa7-4a91-8291-ec10a6825cce-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8\" (UID: \"4b0b120b-daa7-4a91-8291-ec10a6825cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8" Sep 15 21:48:38.042714 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.042678 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b0b120b-daa7-4a91-8291-ec10a6825cce-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8\" (UID: \"4b0b120b-daa7-4a91-8291-ec10a6825cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8" Sep 15 21:48:38.042825 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.042746 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0b120b-daa7-4a91-8291-ec10a6825cce-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8\" (UID: \"4b0b120b-daa7-4a91-8291-ec10a6825cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8" Sep 15 21:48:38.053254 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.053225 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmjw9\" (UniqueName: \"kubernetes.io/projected/4b0b120b-daa7-4a91-8291-ec10a6825cce-kube-api-access-lmjw9\") pod \"maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8\" (UID: \"4b0b120b-daa7-4a91-8291-ec10a6825cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8" Sep 15 21:48:38.087260 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.087228 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:48:38.087631 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.087612 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:48:38.088458 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.088435 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 21:48:38.168088 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.168011 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8" Sep 15 21:48:38.333907 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.333873 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:38.435358 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.435279 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:38.449572 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.449543 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8"] Sep 15 21:48:38.451744 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:48:38.451719 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b0b120b_daa7_4a91_8291_ec10a6825cce.slice/crio-200a399d2727afa8d28ed2655a88b95798f0f0fa5dc00ca15d7db75f11ac01c7 WatchSource:0}: Error finding container 200a399d2727afa8d28ed2655a88b95798f0f0fa5dc00ca15d7db75f11ac01c7: Status 404 returned error can't find the container with id 200a399d2727afa8d28ed2655a88b95798f0f0fa5dc00ca15d7db75f11ac01c7 Sep 15 21:48:38.481823 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.481794 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4"] Sep 15 21:48:38.486837 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.486819 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4" Sep 15 21:48:38.489282 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.489263 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-e7a648-dockercfg-m5mzc\"" Sep 15 21:48:38.489394 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.489262 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-e7a648\"" Sep 15 21:48:38.495614 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.495381 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4"] Sep 15 21:48:38.551869 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.548470 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbgf4\" (UniqueName: \"kubernetes.io/projected/867d1402-c81c-48cb-94af-2adbed5b3d59-kube-api-access-kbgf4\") pod \"payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4\" (UID: \"867d1402-c81c-48cb-94af-2adbed5b3d59\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4" Sep 15 21:48:38.551869 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.548563 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/867d1402-c81c-48cb-94af-2adbed5b3d59-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4\" (UID: \"867d1402-c81c-48cb-94af-2adbed5b3d59\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4" Sep 15 21:48:38.649420 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.649382 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbgf4\" (UniqueName: \"kubernetes.io/projected/867d1402-c81c-48cb-94af-2adbed5b3d59-kube-api-access-kbgf4\") pod \"payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4\" (UID: \"867d1402-c81c-48cb-94af-2adbed5b3d59\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4" Sep 15 21:48:38.649602 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.649468 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/867d1402-c81c-48cb-94af-2adbed5b3d59-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4\" (UID: \"867d1402-c81c-48cb-94af-2adbed5b3d59\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4" Sep 15 21:48:38.650234 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.650207 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/867d1402-c81c-48cb-94af-2adbed5b3d59-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4\" (UID: \"867d1402-c81c-48cb-94af-2adbed5b3d59\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4" Sep 15 21:48:38.656974 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.656951 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbgf4\" (UniqueName: \"kubernetes.io/projected/867d1402-c81c-48cb-94af-2adbed5b3d59-kube-api-access-kbgf4\") pod \"payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4\" (UID: \"867d1402-c81c-48cb-94af-2adbed5b3d59\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4" Sep 15 21:48:38.707052 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.706964 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8" event={"ID":"4b0b120b-daa7-4a91-8291-ec10a6825cce","Type":"ContainerStarted","Data":"200a399d2727afa8d28ed2655a88b95798f0f0fa5dc00ca15d7db75f11ac01c7"} Sep 15 21:48:38.800047 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:38.800012 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4" Sep 15 21:48:39.072930 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:39.072898 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4"] Sep 15 21:48:39.073571 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:48:39.073546 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod867d1402_c81c_48cb_94af_2adbed5b3d59.slice/crio-75074f0cc1906691f9fa104bf87e792baea0379629cf624c5d40c22e75cd1ba2 WatchSource:0}: Error finding container 75074f0cc1906691f9fa104bf87e792baea0379629cf624c5d40c22e75cd1ba2: Status 404 returned error can't find the container with id 75074f0cc1906691f9fa104bf87e792baea0379629cf624c5d40c22e75cd1ba2 Sep 15 21:48:39.714647 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:39.714609 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8" event={"ID":"4b0b120b-daa7-4a91-8291-ec10a6825cce","Type":"ContainerStarted","Data":"e6eafb8ff2770c2c553bbbe864649fa4b20e0360399dd3b6ae19dfe329adfc0e"} Sep 15 21:48:39.714875 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:39.714698 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8" Sep 15 21:48:39.716355 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:39.716331 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4" event={"ID":"867d1402-c81c-48cb-94af-2adbed5b3d59","Type":"ContainerStarted","Data":"3123cbe45cabb8e844ba56ef504b325dd9fdddd7c3793f7fb27c9d4828ae6309"} Sep 15 21:48:39.716457 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:39.716384 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4" event={"ID":"867d1402-c81c-48cb-94af-2adbed5b3d59","Type":"ContainerStarted","Data":"75074f0cc1906691f9fa104bf87e792baea0379629cf624c5d40c22e75cd1ba2"} Sep 15 21:48:39.716520 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:39.716482 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4" Sep 15 21:48:39.730105 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:39.730057 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8" podStartSLOduration=2.3100670660000002 podStartE2EDuration="2.730038228s" totalImagesPullingTime="419.971162ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:48:39.729346324 +0000 UTC m=+1374.315943919" watchObservedRunningTime="2026-09-15 21:48:39.730038228 +0000 UTC m=+1374.316635833" Sep 15 21:48:39.745229 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:39.745184 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4" podStartSLOduration=1.745169357 podStartE2EDuration="1.745169357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:48:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:48:39.743761415 +0000 UTC m=+1374.330359007" watchObservedRunningTime="2026-09-15 21:48:39.745169357 +0000 UTC m=+1374.331766948" Sep 15 21:48:45.728282 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:45.728250 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8" Sep 15 21:48:50.724987 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:50.724956 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4" Sep 15 21:48:50.991518 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:50.991424 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:48:56.841532 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:56.841499 2573 generic.go:356] "Generic (PLEG): container finished" podID="73721755-fbf7-4b60-8e61-2b4fc17ba3d7" containerID="de2090b2b689d127d1168af3aaaebaed36b4fe25f521deb0680eba580402e632" exitCode=0 Sep 15 21:48:56.841969 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:56.841569 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" event={"ID":"73721755-fbf7-4b60-8e61-2b4fc17ba3d7","Type":"ContainerDied","Data":"de2090b2b689d127d1168af3aaaebaed36b4fe25f521deb0680eba580402e632"} Sep 15 21:48:56.842076 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:56.842060 2573 scope.go:117] "RemoveContainer" containerID="de2090b2b689d127d1168af3aaaebaed36b4fe25f521deb0680eba580402e632" Sep 15 21:48:56.843354 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:56.843325 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:48:56.843425 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:56.843400 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:48:56.843464 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:56.843434 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:48:57.850521 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:57.850482 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" event={"ID":"73721755-fbf7-4b60-8e61-2b4fc17ba3d7","Type":"ContainerStarted","Data":"d60d00d8d8f99f793d025b169afe8bb0b7e6286862a265eb1d09270f997860f5"} Sep 15 21:48:58.315086 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:58.315051 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:48:58.316436 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:58.316408 2573 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Sep 15 21:48:58.316567 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:58.316485 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" podUID="73721755-fbf7-4b60-8e61-2b4fc17ba3d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Sep 15 21:48:59.315653 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:59.315616 2573 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Sep 15 21:48:59.316106 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:59.315670 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" podUID="73721755-fbf7-4b60-8e61-2b4fc17ba3d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Sep 15 21:48:59.649722 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:48:59.649635 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:00.315486 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:00.315448 2573 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Sep 15 21:49:00.315686 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:00.315507 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" podUID="73721755-fbf7-4b60-8e61-2b4fc17ba3d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Sep 15 21:49:00.695954 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:00.695833 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:01.304435 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:01.304398 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:01.315453 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:01.315424 2573 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Sep 15 21:49:01.315585 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:01.315475 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" podUID="73721755-fbf7-4b60-8e61-2b4fc17ba3d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Sep 15 21:49:02.060366 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:02.060334 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:02.315715 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:02.315627 2573 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Sep 15 21:49:02.315715 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:02.315686 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" podUID="73721755-fbf7-4b60-8e61-2b4fc17ba3d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Sep 15 21:49:02.660755 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:02.660671 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:49:02.678813 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:02.678760 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:03.288123 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:03.288079 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:03.319237 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:03.319212 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:49:03.320058 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:03.320037 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 21:49:03.705291 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:03.705215 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:04.066535 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:04.066500 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:04.860236 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:04.860202 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:05.479174 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:05.479136 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:36.867945 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:36.867901 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:37.652236 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:37.652193 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:38.286814 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:38.286735 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:39.053402 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:39.053364 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:39.796722 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:39.796686 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:40.663641 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:40.663606 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:41.267867 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:41.267814 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:41.891738 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:41.891704 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:42.664697 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:42.664662 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:52.198395 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:52.198358 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:52.298811 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:52.298779 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:52.372383 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:52.372345 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:52.439629 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:52.439593 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:52.849992 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:52.849956 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:53.477518 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:53.477486 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:54.177220 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:54.177181 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:54.790496 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:54.790454 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:55.361640 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:55.361608 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:55.560887 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:55.560830 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:56.184944 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:56.184912 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:56.286046 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:56.286006 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:49:56.774450 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:49:56.774410 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:50:00.383224 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:00.383184 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:50:02.265906 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:02.265872 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:50:03.753262 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:03.753224 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:50:13.654306 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:13.654258 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:50:17.058362 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:17.058331 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:50:18.977283 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:18.977251 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:50:32.789460 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:32.789415 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:50:37.505830 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:37.505790 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:50:37.557676 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:37.557639 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:50:42.833997 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:42.833961 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:50:45.993711 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:45.993683 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/1.log" Sep 15 21:50:45.994692 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:45.994668 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/1.log" Sep 15 21:50:46.095958 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:46.095917 2573 scope.go:117] "RemoveContainer" containerID="529fef0c5d34fbea3f48b5a26f95e534bf6b6045e4fb53fc2c53fa1cf2b768d0" Sep 15 21:50:56.940342 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:56.940303 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:50:57.040555 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:57.040509 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:50:57.193652 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:57.193552 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx"] Sep 15 21:50:57.204351 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:57.204310 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" podUID="e969a826-3b76-4e67-b917-38fc467c21e8" containerName="istio-proxy" containerID="cri-o://b5def39f02c32d33c94348017369643228b844f2998f3cfffa9e334478b61ab7" gracePeriod=30 Sep 15 21:50:57.381276 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:57.381244 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:50:58.214931 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:58.214898 2573 patch_prober.go:28] interesting pod/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 15 21:50:58.215338 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:58.214963 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" podUID="e969a826-3b76-4e67-b917-38fc467c21e8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 15 21:50:58.431382 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:58.431351 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:50:58.533868 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:58.533757 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:50:58.639769 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:58.639685 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:50:59.255161 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:59.255128 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:50:59.355213 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:59.355177 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:50:59.455277 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:50:59.455246 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:00.698204 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:00.698165 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:01.639638 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:01.639603 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:02.466743 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.466719 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:51:02.576948 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.576842 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-workload-certs\") pod \"e969a826-3b76-4e67-b917-38fc467c21e8\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " Sep 15 21:51:02.576948 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.576909 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-istio-envoy\") pod \"e969a826-3b76-4e67-b917-38fc467c21e8\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " Sep 15 21:51:02.576948 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.576949 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-credential-socket\") pod \"e969a826-3b76-4e67-b917-38fc467c21e8\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " Sep 15 21:51:02.577185 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.576969 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e969a826-3b76-4e67-b917-38fc467c21e8-istio-token\") pod \"e969a826-3b76-4e67-b917-38fc467c21e8\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " Sep 15 21:51:02.577185 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.577007 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mqh9\" (UniqueName: \"kubernetes.io/projected/e969a826-3b76-4e67-b917-38fc467c21e8-kube-api-access-9mqh9\") pod \"e969a826-3b76-4e67-b917-38fc467c21e8\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " Sep 15 21:51:02.577185 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.577043 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-workload-socket\") pod \"e969a826-3b76-4e67-b917-38fc467c21e8\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " Sep 15 21:51:02.577185 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.577141 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e969a826-3b76-4e67-b917-38fc467c21e8" (UID: "e969a826-3b76-4e67-b917-38fc467c21e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:51:02.577374 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.577228 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-istio-data\") pod \"e969a826-3b76-4e67-b917-38fc467c21e8\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " Sep 15 21:51:02.577374 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.577275 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e969a826-3b76-4e67-b917-38fc467c21e8" (UID: "e969a826-3b76-4e67-b917-38fc467c21e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:51:02.577374 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.577322 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e969a826-3b76-4e67-b917-38fc467c21e8-istio-podinfo\") pod \"e969a826-3b76-4e67-b917-38fc467c21e8\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " Sep 15 21:51:02.577374 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.577354 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e969a826-3b76-4e67-b917-38fc467c21e8-istiod-ca-cert\") pod \"e969a826-3b76-4e67-b917-38fc467c21e8\" (UID: \"e969a826-3b76-4e67-b917-38fc467c21e8\") " Sep 15 21:51:02.577374 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.577353 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e969a826-3b76-4e67-b917-38fc467c21e8" (UID: "e969a826-3b76-4e67-b917-38fc467c21e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:51:02.577629 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.577496 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-istio-data" (OuterVolumeSpecName: "istio-data") pod "e969a826-3b76-4e67-b917-38fc467c21e8" (UID: "e969a826-3b76-4e67-b917-38fc467c21e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:51:02.577771 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.577744 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e969a826-3b76-4e67-b917-38fc467c21e8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e969a826-3b76-4e67-b917-38fc467c21e8" (UID: "e969a826-3b76-4e67-b917-38fc467c21e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:51:02.577771 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.577765 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-workload-certs\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:51:02.578001 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.577785 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-credential-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:51:02.578001 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.577797 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-workload-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:51:02.578001 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.577810 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-istio-data\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:51:02.579176 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.579155 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e969a826-3b76-4e67-b917-38fc467c21e8" (UID: "e969a826-3b76-4e67-b917-38fc467c21e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:51:02.579344 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.579331 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e969a826-3b76-4e67-b917-38fc467c21e8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e969a826-3b76-4e67-b917-38fc467c21e8" (UID: "e969a826-3b76-4e67-b917-38fc467c21e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 15 21:51:02.579613 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.579585 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e969a826-3b76-4e67-b917-38fc467c21e8-kube-api-access-9mqh9" (OuterVolumeSpecName: "kube-api-access-9mqh9") pod "e969a826-3b76-4e67-b917-38fc467c21e8" (UID: "e969a826-3b76-4e67-b917-38fc467c21e8"). InnerVolumeSpecName "kube-api-access-9mqh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:51:02.579721 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.579630 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e969a826-3b76-4e67-b917-38fc467c21e8-istio-token" (OuterVolumeSpecName: "istio-token") pod "e969a826-3b76-4e67-b917-38fc467c21e8" (UID: "e969a826-3b76-4e67-b917-38fc467c21e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:51:02.630736 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.630698 2573 generic.go:356] "Generic (PLEG): container finished" podID="e969a826-3b76-4e67-b917-38fc467c21e8" containerID="b5def39f02c32d33c94348017369643228b844f2998f3cfffa9e334478b61ab7" exitCode=0 Sep 15 21:51:02.630912 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.630754 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" Sep 15 21:51:02.630912 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.630778 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" event={"ID":"e969a826-3b76-4e67-b917-38fc467c21e8","Type":"ContainerDied","Data":"b5def39f02c32d33c94348017369643228b844f2998f3cfffa9e334478b61ab7"} Sep 15 21:51:02.630912 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.630825 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx" event={"ID":"e969a826-3b76-4e67-b917-38fc467c21e8","Type":"ContainerDied","Data":"cbdf85551b20d1d5f7fc76a060984ccab8dceb1db22ac996c02cfbac786bcf76"} Sep 15 21:51:02.630912 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.630877 2573 scope.go:117] "RemoveContainer" containerID="b5def39f02c32d33c94348017369643228b844f2998f3cfffa9e334478b61ab7" Sep 15 21:51:02.640949 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.640927 2573 scope.go:117] "RemoveContainer" containerID="de901add9c006dd7c909e02109d11a7e69e131614ef9757ae4e0b2fe61688e78" Sep 15 21:51:02.650111 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.650094 2573 scope.go:117] "RemoveContainer" containerID="b5def39f02c32d33c94348017369643228b844f2998f3cfffa9e334478b61ab7" Sep 15 21:51:02.650415 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:51:02.650395 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5def39f02c32d33c94348017369643228b844f2998f3cfffa9e334478b61ab7\": container with ID starting with b5def39f02c32d33c94348017369643228b844f2998f3cfffa9e334478b61ab7 not found: ID does not exist" containerID="b5def39f02c32d33c94348017369643228b844f2998f3cfffa9e334478b61ab7" Sep 15 21:51:02.650486 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.650421 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5def39f02c32d33c94348017369643228b844f2998f3cfffa9e334478b61ab7"} err="failed to get container status \"b5def39f02c32d33c94348017369643228b844f2998f3cfffa9e334478b61ab7\": rpc error: code = NotFound desc = could not find container \"b5def39f02c32d33c94348017369643228b844f2998f3cfffa9e334478b61ab7\": container with ID starting with b5def39f02c32d33c94348017369643228b844f2998f3cfffa9e334478b61ab7 not found: ID does not exist" Sep 15 21:51:02.650486 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.650439 2573 scope.go:117] "RemoveContainer" containerID="de901add9c006dd7c909e02109d11a7e69e131614ef9757ae4e0b2fe61688e78" Sep 15 21:51:02.650718 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:51:02.650696 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de901add9c006dd7c909e02109d11a7e69e131614ef9757ae4e0b2fe61688e78\": container with ID starting with de901add9c006dd7c909e02109d11a7e69e131614ef9757ae4e0b2fe61688e78 not found: ID does not exist" containerID="de901add9c006dd7c909e02109d11a7e69e131614ef9757ae4e0b2fe61688e78" Sep 15 21:51:02.650768 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.650727 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de901add9c006dd7c909e02109d11a7e69e131614ef9757ae4e0b2fe61688e78"} err="failed to get container status \"de901add9c006dd7c909e02109d11a7e69e131614ef9757ae4e0b2fe61688e78\": rpc error: code = NotFound desc = could not find container \"de901add9c006dd7c909e02109d11a7e69e131614ef9757ae4e0b2fe61688e78\": container with ID starting with de901add9c006dd7c909e02109d11a7e69e131614ef9757ae4e0b2fe61688e78 not found: ID does not exist" Sep 15 21:51:02.653158 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.653141 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx"] Sep 15 21:51:02.657715 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.657695 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx"] Sep 15 21:51:02.678932 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.678913 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e969a826-3b76-4e67-b917-38fc467c21e8-istio-podinfo\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:51:02.678932 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.678931 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e969a826-3b76-4e67-b917-38fc467c21e8-istiod-ca-cert\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:51:02.679028 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.678940 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e969a826-3b76-4e67-b917-38fc467c21e8-istio-envoy\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:51:02.679028 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.678949 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e969a826-3b76-4e67-b917-38fc467c21e8-istio-token\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:51:02.679028 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:02.678957 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mqh9\" (UniqueName: \"kubernetes.io/projected/e969a826-3b76-4e67-b917-38fc467c21e8-kube-api-access-9mqh9\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:51:03.934492 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:03.934460 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e969a826-3b76-4e67-b917-38fc467c21e8" path="/var/lib/kubelet/pods/e969a826-3b76-4e67-b917-38fc467c21e8/volumes" Sep 15 21:51:06.345065 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:06.345028 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:06.457333 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:06.457300 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:07.016831 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:07.016795 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:07.654167 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:07.654135 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:12.760874 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:12.760744 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:12.818367 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:12.818331 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:12.909078 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:12.909041 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:13.009156 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:13.009098 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:13.763748 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:13.763701 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:23.421789 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:23.421700 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:24.695867 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:24.695815 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:26.633015 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:26.632975 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:35.318275 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:35.318231 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:45.398068 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:45.398027 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:48.441689 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:48.441649 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:51.187683 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:51.187644 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:51.283917 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:51.283879 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:51.477645 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:51.477610 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:51.792129 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:51.792052 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:51.886727 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:51.886691 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:54.532700 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:54.532669 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:55.157109 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:55.157073 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:55.285460 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:55.285412 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:55.371818 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:55.371779 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:56.351390 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:56.351354 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:57.050005 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:57.049963 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:57.680089 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:57.680052 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:58.466067 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:58.466027 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:59.086422 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:59.086390 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:59.869952 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:59.869925 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:51:59.971758 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:51:59.971724 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:00.072920 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:00.072886 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:00.307379 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:00.307345 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:00.408393 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:00.408352 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:02.820897 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:02.820842 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:06.374327 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:06.374285 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:12.815266 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:12.815228 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:12.866921 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:12.866889 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:21.758528 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:21.758488 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:22.386206 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:22.386158 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:23.066159 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:23.066124 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:23.862820 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:23.862783 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:24.494687 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:24.494656 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:25.126803 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:25.126762 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:25.248311 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:25.248276 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:25.719764 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:25.719727 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:25.865880 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:25.865830 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:26.025515 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.025430 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx"] Sep 15 21:52:26.025951 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.025934 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e969a826-3b76-4e67-b917-38fc467c21e8" containerName="istio-proxy" Sep 15 21:52:26.025951 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.025951 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e969a826-3b76-4e67-b917-38fc467c21e8" containerName="istio-proxy" Sep 15 21:52:26.026077 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.025963 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e969a826-3b76-4e67-b917-38fc467c21e8" containerName="istio-proxy" Sep 15 21:52:26.026077 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.025969 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e969a826-3b76-4e67-b917-38fc467c21e8" containerName="istio-proxy" Sep 15 21:52:26.026077 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.026069 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e969a826-3b76-4e67-b917-38fc467c21e8" containerName="istio-proxy" Sep 15 21:52:26.029461 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.029441 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.032015 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.031998 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-74da27-openshift-default-dockercfg-bjplv\"" Sep 15 21:52:26.042153 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.042132 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx"] Sep 15 21:52:26.052219 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.052190 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:26.134873 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.134500 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-workload-socket\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.134873 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.134577 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-credential-socket\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.134873 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.134686 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-istio-envoy\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.134873 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.134716 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15fb724f-e820-4216-a29a-d67dc264a2ed-istiod-ca-cert\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.134873 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.134746 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtdn2\" (UniqueName: \"kubernetes.io/projected/15fb724f-e820-4216-a29a-d67dc264a2ed-kube-api-access-dtdn2\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.134873 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.134771 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-workload-certs\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.134873 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.134819 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15fb724f-e820-4216-a29a-d67dc264a2ed-istio-token\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.134873 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.134878 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-istio-data\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.135463 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.134906 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15fb724f-e820-4216-a29a-d67dc264a2ed-istio-podinfo\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.236078 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.236044 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-credential-socket\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.236266 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.236138 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-istio-envoy\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.236266 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.236163 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15fb724f-e820-4216-a29a-d67dc264a2ed-istiod-ca-cert\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.236266 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.236184 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtdn2\" (UniqueName: \"kubernetes.io/projected/15fb724f-e820-4216-a29a-d67dc264a2ed-kube-api-access-dtdn2\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.236266 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.236215 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-workload-certs\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.236266 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.236261 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15fb724f-e820-4216-a29a-d67dc264a2ed-istio-token\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.236536 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.236302 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-istio-data\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.236536 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.236328 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15fb724f-e820-4216-a29a-d67dc264a2ed-istio-podinfo\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.236536 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.236373 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-workload-socket\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.236536 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.236498 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-credential-socket\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.236780 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.236595 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-workload-certs\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.236838 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.236812 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-istio-data\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.236959 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.236936 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-workload-socket\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.237028 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.236982 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15fb724f-e820-4216-a29a-d67dc264a2ed-istiod-ca-cert\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.238545 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.238528 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-istio-envoy\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.238942 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.238920 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15fb724f-e820-4216-a29a-d67dc264a2ed-istio-podinfo\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.244373 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.244345 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15fb724f-e820-4216-a29a-d67dc264a2ed-istio-token\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.244485 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.244430 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtdn2\" (UniqueName: \"kubernetes.io/projected/15fb724f-e820-4216-a29a-d67dc264a2ed-kube-api-access-dtdn2\") pod \"e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.333956 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.333859 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:26.340317 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.340293 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:26.621477 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.621438 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx"] Sep 15 21:52:26.627219 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:52:26.627185 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15fb724f_e820_4216_a29a_d67dc264a2ed.slice/crio-cab072e2ff5de3c7c821dab119134ab1d31f03f5c6337d168015935e67be5a00 WatchSource:0}: Error finding container cab072e2ff5de3c7c821dab119134ab1d31f03f5c6337d168015935e67be5a00: Status 404 returned error can't find the container with id cab072e2ff5de3c7c821dab119134ab1d31f03f5c6337d168015935e67be5a00 Sep 15 21:52:26.629669 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.629634 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:52:26.629753 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.629700 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:52:26.629753 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.629727 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:52:26.673286 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:26.673247 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:27.160158 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:27.160110 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" event={"ID":"15fb724f-e820-4216-a29a-d67dc264a2ed","Type":"ContainerStarted","Data":"f9e60c52f0f9dfb55a8574a79413222ab85e898abb5bbda5d66f5ca5b6f39e9e"} Sep 15 21:52:27.160556 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:27.160178 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" event={"ID":"15fb724f-e820-4216-a29a-d67dc264a2ed","Type":"ContainerStarted","Data":"cab072e2ff5de3c7c821dab119134ab1d31f03f5c6337d168015935e67be5a00"} Sep 15 21:52:27.198025 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:27.197976 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" podStartSLOduration=1.197961183 podStartE2EDuration="1.197961183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:52:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:52:27.195290343 +0000 UTC m=+1601.781887936" watchObservedRunningTime="2026-09-15 21:52:27.197961183 +0000 UTC m=+1601.784558775" Sep 15 21:52:27.340664 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:27.340628 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:27.345825 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:27.345799 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:28.166148 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:28.166108 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:28.167175 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:28.167154 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:28.471696 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:28.471660 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:29.104683 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:29.104645 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:29.196919 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:29.196879 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:30.175926 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:30.175838 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:30.946639 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:30.946599 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:31.659254 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:31.659216 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:32.262020 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:32.261986 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:32.886207 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:32.886178 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:33.552032 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:33.551984 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:34.379867 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:34.379799 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:34.476969 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:34.476925 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:34.830039 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:34.830008 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:34.929281 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:34.929246 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:34.934239 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:34.934212 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j"] Sep 15 21:52:34.934707 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:34.934694 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e969a826-3b76-4e67-b917-38fc467c21e8" containerName="istio-proxy" Sep 15 21:52:34.939029 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:34.939013 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j" Sep 15 21:52:34.941504 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:34.941484 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-74da27\"" Sep 15 21:52:34.941619 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:34.941569 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-74da27-dockercfg-tzjlh\"" Sep 15 21:52:34.953908 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:34.953885 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j"] Sep 15 21:52:34.964939 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:34.964911 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9"] Sep 15 21:52:34.968577 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:34.968554 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9" Sep 15 21:52:34.978923 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:34.978899 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9"] Sep 15 21:52:34.995625 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:34.995587 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:35.050720 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:35.045999 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp2qq\" (UniqueName: \"kubernetes.io/projected/9cc0af5c-1fca-4b59-90ac-c82f07087d2f-kube-api-access-gp2qq\") pod \"payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j\" (UID: \"9cc0af5c-1fca-4b59-90ac-c82f07087d2f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j" Sep 15 21:52:35.050720 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:35.046135 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cc0af5c-1fca-4b59-90ac-c82f07087d2f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j\" (UID: \"9cc0af5c-1fca-4b59-90ac-c82f07087d2f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j" Sep 15 21:52:35.147516 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:35.147422 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp2qq\" (UniqueName: \"kubernetes.io/projected/9cc0af5c-1fca-4b59-90ac-c82f07087d2f-kube-api-access-gp2qq\") pod \"payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j\" (UID: \"9cc0af5c-1fca-4b59-90ac-c82f07087d2f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j" Sep 15 21:52:35.147516 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:35.147477 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/535b620a-0c5a-41db-b8ab-d70541fa25c5-plugins-config-volume\") pod \"payload-processing-e2e-api-b-74da27-554776985f-4qnc9\" (UID: \"535b620a-0c5a-41db-b8ab-d70541fa25c5\") " pod="openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9" Sep 15 21:52:35.147729 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:35.147519 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cc0af5c-1fca-4b59-90ac-c82f07087d2f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j\" (UID: \"9cc0af5c-1fca-4b59-90ac-c82f07087d2f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j" Sep 15 21:52:35.147729 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:35.147551 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzxmn\" (UniqueName: \"kubernetes.io/projected/535b620a-0c5a-41db-b8ab-d70541fa25c5-kube-api-access-bzxmn\") pod \"payload-processing-e2e-api-b-74da27-554776985f-4qnc9\" (UID: \"535b620a-0c5a-41db-b8ab-d70541fa25c5\") " pod="openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9" Sep 15 21:52:35.148268 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:35.148248 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cc0af5c-1fca-4b59-90ac-c82f07087d2f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j\" (UID: \"9cc0af5c-1fca-4b59-90ac-c82f07087d2f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j" Sep 15 21:52:35.155303 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:35.155278 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp2qq\" (UniqueName: \"kubernetes.io/projected/9cc0af5c-1fca-4b59-90ac-c82f07087d2f-kube-api-access-gp2qq\") pod \"payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j\" (UID: \"9cc0af5c-1fca-4b59-90ac-c82f07087d2f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j" Sep 15 21:52:35.248490 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:35.248450 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/535b620a-0c5a-41db-b8ab-d70541fa25c5-plugins-config-volume\") pod \"payload-processing-e2e-api-b-74da27-554776985f-4qnc9\" (UID: \"535b620a-0c5a-41db-b8ab-d70541fa25c5\") " pod="openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9" Sep 15 21:52:35.248706 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:35.248561 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzxmn\" (UniqueName: \"kubernetes.io/projected/535b620a-0c5a-41db-b8ab-d70541fa25c5-kube-api-access-bzxmn\") pod \"payload-processing-e2e-api-b-74da27-554776985f-4qnc9\" (UID: \"535b620a-0c5a-41db-b8ab-d70541fa25c5\") " pod="openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9" Sep 15 21:52:35.249328 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:35.249306 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/535b620a-0c5a-41db-b8ab-d70541fa25c5-plugins-config-volume\") pod \"payload-processing-e2e-api-b-74da27-554776985f-4qnc9\" (UID: \"535b620a-0c5a-41db-b8ab-d70541fa25c5\") " pod="openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9" Sep 15 21:52:35.250117 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:35.250093 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j" Sep 15 21:52:35.256204 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:35.256181 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzxmn\" (UniqueName: \"kubernetes.io/projected/535b620a-0c5a-41db-b8ab-d70541fa25c5-kube-api-access-bzxmn\") pod \"payload-processing-e2e-api-b-74da27-554776985f-4qnc9\" (UID: \"535b620a-0c5a-41db-b8ab-d70541fa25c5\") " pod="openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9" Sep 15 21:52:35.281038 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:35.281006 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9" Sep 15 21:52:35.529203 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:52:35.529173 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cc0af5c_1fca_4b59_90ac_c82f07087d2f.slice/crio-b7a9be9aede34cb23f9776ea79646ed01c2182983c7ca28629ad888374457b74 WatchSource:0}: Error finding container b7a9be9aede34cb23f9776ea79646ed01c2182983c7ca28629ad888374457b74: Status 404 returned error can't find the container with id b7a9be9aede34cb23f9776ea79646ed01c2182983c7ca28629ad888374457b74 Sep 15 21:52:35.529203 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:35.529187 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j"] Sep 15 21:52:35.568178 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:35.568149 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9"] Sep 15 21:52:35.568763 ip-10-0-133-42 kubenswrapper[2573]: W0915 21:52:35.568742 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod535b620a_0c5a_41db_b8ab_d70541fa25c5.slice/crio-fc5f15fd78c8783e9e3ef20a00f12d50e89c197d033bc0f2ad1df7b13859e525 WatchSource:0}: Error finding container fc5f15fd78c8783e9e3ef20a00f12d50e89c197d033bc0f2ad1df7b13859e525: Status 404 returned error can't find the container with id fc5f15fd78c8783e9e3ef20a00f12d50e89c197d033bc0f2ad1df7b13859e525 Sep 15 21:52:36.226075 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:36.226036 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9" event={"ID":"535b620a-0c5a-41db-b8ab-d70541fa25c5","Type":"ContainerStarted","Data":"b39087643ceb356ad0bacaccd81a76b2f7d0e9e3569c39820501afd36d3adc03"} Sep 15 21:52:36.226565 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:36.226094 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9" event={"ID":"535b620a-0c5a-41db-b8ab-d70541fa25c5","Type":"ContainerStarted","Data":"fc5f15fd78c8783e9e3ef20a00f12d50e89c197d033bc0f2ad1df7b13859e525"} Sep 15 21:52:36.226565 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:36.226258 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9" Sep 15 21:52:36.227912 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:36.227886 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j" event={"ID":"9cc0af5c-1fca-4b59-90ac-c82f07087d2f","Type":"ContainerStarted","Data":"e1ef4551d9f51fe22bfdc7572d17b8c55298d93a7b9489faadae999a74420e0e"} Sep 15 21:52:36.228026 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:36.227927 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j" event={"ID":"9cc0af5c-1fca-4b59-90ac-c82f07087d2f","Type":"ContainerStarted","Data":"b7a9be9aede34cb23f9776ea79646ed01c2182983c7ca28629ad888374457b74"} Sep 15 21:52:36.228026 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:36.227958 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j" Sep 15 21:52:36.246759 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:36.246708 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9" podStartSLOduration=2.24669104 podStartE2EDuration="2.24669104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:52:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:52:36.243763633 +0000 UTC m=+1610.830361227" watchObservedRunningTime="2026-09-15 21:52:36.24669104 +0000 UTC m=+1610.833288631" Sep 15 21:52:36.267619 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:36.267564 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j" podStartSLOduration=2.26755011 podStartE2EDuration="2.26755011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:52:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:52:36.264243371 +0000 UTC m=+1610.850840963" watchObservedRunningTime="2026-09-15 21:52:36.26755011 +0000 UTC m=+1610.854147701" Sep 15 21:52:43.619116 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:43.619034 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:47.236214 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:47.236180 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j" Sep 15 21:52:47.236664 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:47.236378 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9" Sep 15 21:52:55.359974 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:55.359938 2573 generic.go:356] "Generic (PLEG): container finished" podID="15fb724f-e820-4216-a29a-d67dc264a2ed" containerID="f9e60c52f0f9dfb55a8574a79413222ab85e898abb5bbda5d66f5ca5b6f39e9e" exitCode=0 Sep 15 21:52:55.360371 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:55.360013 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" event={"ID":"15fb724f-e820-4216-a29a-d67dc264a2ed","Type":"ContainerDied","Data":"f9e60c52f0f9dfb55a8574a79413222ab85e898abb5bbda5d66f5ca5b6f39e9e"} Sep 15 21:52:55.360531 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:55.360509 2573 scope.go:117] "RemoveContainer" containerID="f9e60c52f0f9dfb55a8574a79413222ab85e898abb5bbda5d66f5ca5b6f39e9e" Sep 15 21:52:55.361816 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:55.361785 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:52:55.361907 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:55.361871 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:52:55.361951 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:55.361905 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 21:52:56.369415 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:56.369368 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" event={"ID":"15fb724f-e820-4216-a29a-d67dc264a2ed","Type":"ContainerStarted","Data":"d1ca64216a1bb69f09bf4ac2c4df5133e68dd112f175b506c3a8c018fdcfbf37"} Sep 15 21:52:56.946094 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:56.946063 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:57.341105 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:57.341068 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:57.342276 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:57.342249 2573 patch_prober.go:28] interesting pod/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Sep 15 21:52:57.342386 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:57.342299 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" podUID="15fb724f-e820-4216-a29a-d67dc264a2ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Sep 15 21:52:57.671635 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:57.671539 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:58.166963 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:58.166933 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:52:58.332004 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:58.331972 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:58.341268 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:58.341243 2573 patch_prober.go:28] interesting pod/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Sep 15 21:52:58.341366 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:58.341292 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" podUID="15fb724f-e820-4216-a29a-d67dc264a2ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Sep 15 21:52:58.957499 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:58.957455 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:59.302735 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:59.302699 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:52:59.341632 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:59.341599 2573 patch_prober.go:28] interesting pod/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Sep 15 21:52:59.341790 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:59.341677 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" podUID="15fb724f-e820-4216-a29a-d67dc264a2ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Sep 15 21:52:59.676558 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:52:59.676469 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:00.340647 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:00.340610 2573 patch_prober.go:28] interesting pod/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Sep 15 21:53:00.341123 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:00.340671 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" podUID="15fb724f-e820-4216-a29a-d67dc264a2ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Sep 15 21:53:00.364659 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:00.364609 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:01.150352 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:01.150311 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:01.341257 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:01.341221 2573 patch_prober.go:28] interesting pod/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Sep 15 21:53:01.341665 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:01.341289 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" podUID="15fb724f-e820-4216-a29a-d67dc264a2ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Sep 15 21:53:01.786732 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:01.786689 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:02.345151 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:02.345120 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:53:02.346254 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:02.346235 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:53:02.396192 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:02.396161 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:03.169428 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:03.169383 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:03.789149 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:03.789113 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:04.423909 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:04.423869 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:05.134214 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:05.134175 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:05.745196 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:05.745155 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:06.480178 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:06.480126 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:07.099953 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:07.099912 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:07.853321 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:07.853289 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:08.464268 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:08.464233 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:12.740590 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:12.740558 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:18.372202 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:18.372166 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:18.455784 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:18.455748 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:18.511880 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:18.511817 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:18.584661 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:18.584632 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:18.944870 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:18.944802 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:19.044133 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:19.044097 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:19.852428 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:19.852385 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:20.476830 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:20.476794 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:21.083605 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:21.083559 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:21.869293 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:21.869251 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:22.497112 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:22.497074 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:23.145516 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:23.145468 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:23.830743 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:23.830697 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:24.752992 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:24.752954 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:24.928534 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:24.928498 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:25.026995 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:25.026921 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:25.199712 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:25.199681 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:25.872114 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:25.872079 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:26.769506 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:26.769470 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:27.462038 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:27.461996 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:28.162277 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:28.162244 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:28.946403 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:28.946367 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:29.751386 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:29.751345 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:30.393814 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:30.393780 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:31.031100 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:31.031063 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:31.775255 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:31.775220 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:41.006418 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.006381 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:41.035509 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.035473 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9"] Sep 15 21:53:41.035726 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.035699 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9" podUID="535b620a-0c5a-41db-b8ab-d70541fa25c5" containerName="payload-processing" containerID="cri-o://b39087643ceb356ad0bacaccd81a76b2f7d0e9e3569c39820501afd36d3adc03" gracePeriod=30 Sep 15 21:53:41.040614 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.040578 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j"] Sep 15 21:53:41.041088 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.041051 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j" podUID="9cc0af5c-1fca-4b59-90ac-c82f07087d2f" containerName="payload-pre-processing" containerID="cri-o://e1ef4551d9f51fe22bfdc7572d17b8c55298d93a7b9489faadae999a74420e0e" gracePeriod=30 Sep 15 21:53:41.106632 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.106600 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:41.185822 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.183131 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:41.241220 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.241165 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:41.350816 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.350790 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9" Sep 15 21:53:41.392636 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.392610 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j" Sep 15 21:53:41.444600 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.444564 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzxmn\" (UniqueName: \"kubernetes.io/projected/535b620a-0c5a-41db-b8ab-d70541fa25c5-kube-api-access-bzxmn\") pod \"535b620a-0c5a-41db-b8ab-d70541fa25c5\" (UID: \"535b620a-0c5a-41db-b8ab-d70541fa25c5\") " Sep 15 21:53:41.444791 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.444611 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gp2qq\" (UniqueName: \"kubernetes.io/projected/9cc0af5c-1fca-4b59-90ac-c82f07087d2f-kube-api-access-gp2qq\") pod \"9cc0af5c-1fca-4b59-90ac-c82f07087d2f\" (UID: \"9cc0af5c-1fca-4b59-90ac-c82f07087d2f\") " Sep 15 21:53:41.444791 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.444689 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cc0af5c-1fca-4b59-90ac-c82f07087d2f-plugins-config-volume\") pod \"9cc0af5c-1fca-4b59-90ac-c82f07087d2f\" (UID: \"9cc0af5c-1fca-4b59-90ac-c82f07087d2f\") " Sep 15 21:53:41.444791 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.444775 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/535b620a-0c5a-41db-b8ab-d70541fa25c5-plugins-config-volume\") pod \"535b620a-0c5a-41db-b8ab-d70541fa25c5\" (UID: \"535b620a-0c5a-41db-b8ab-d70541fa25c5\") " Sep 15 21:53:41.445168 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.445127 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cc0af5c-1fca-4b59-90ac-c82f07087d2f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9cc0af5c-1fca-4b59-90ac-c82f07087d2f" (UID: "9cc0af5c-1fca-4b59-90ac-c82f07087d2f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:53:41.445285 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.445179 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/535b620a-0c5a-41db-b8ab-d70541fa25c5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "535b620a-0c5a-41db-b8ab-d70541fa25c5" (UID: "535b620a-0c5a-41db-b8ab-d70541fa25c5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:53:41.446778 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.446754 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cc0af5c-1fca-4b59-90ac-c82f07087d2f-kube-api-access-gp2qq" (OuterVolumeSpecName: "kube-api-access-gp2qq") pod "9cc0af5c-1fca-4b59-90ac-c82f07087d2f" (UID: "9cc0af5c-1fca-4b59-90ac-c82f07087d2f"). InnerVolumeSpecName "kube-api-access-gp2qq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:53:41.446977 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.446795 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/535b620a-0c5a-41db-b8ab-d70541fa25c5-kube-api-access-bzxmn" (OuterVolumeSpecName: "kube-api-access-bzxmn") pod "535b620a-0c5a-41db-b8ab-d70541fa25c5" (UID: "535b620a-0c5a-41db-b8ab-d70541fa25c5"). InnerVolumeSpecName "kube-api-access-bzxmn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:53:41.545769 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.545682 2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/535b620a-0c5a-41db-b8ab-d70541fa25c5-plugins-config-volume\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:53:41.545769 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.545711 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzxmn\" (UniqueName: \"kubernetes.io/projected/535b620a-0c5a-41db-b8ab-d70541fa25c5-kube-api-access-bzxmn\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:53:41.545769 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.545721 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp2qq\" (UniqueName: \"kubernetes.io/projected/9cc0af5c-1fca-4b59-90ac-c82f07087d2f-kube-api-access-gp2qq\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:53:41.545769 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.545730 2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cc0af5c-1fca-4b59-90ac-c82f07087d2f-plugins-config-volume\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:53:41.564093 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.564054 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:41.619518 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.619483 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:41.670125 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.670094 2573 generic.go:356] "Generic (PLEG): container finished" podID="535b620a-0c5a-41db-b8ab-d70541fa25c5" containerID="b39087643ceb356ad0bacaccd81a76b2f7d0e9e3569c39820501afd36d3adc03" exitCode=0 Sep 15 21:53:41.670318 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.670142 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9" Sep 15 21:53:41.670318 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.670186 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9" event={"ID":"535b620a-0c5a-41db-b8ab-d70541fa25c5","Type":"ContainerDied","Data":"b39087643ceb356ad0bacaccd81a76b2f7d0e9e3569c39820501afd36d3adc03"} Sep 15 21:53:41.670318 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.670276 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9" event={"ID":"535b620a-0c5a-41db-b8ab-d70541fa25c5","Type":"ContainerDied","Data":"fc5f15fd78c8783e9e3ef20a00f12d50e89c197d033bc0f2ad1df7b13859e525"} Sep 15 21:53:41.670318 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.670306 2573 scope.go:117] "RemoveContainer" containerID="b39087643ceb356ad0bacaccd81a76b2f7d0e9e3569c39820501afd36d3adc03" Sep 15 21:53:41.671564 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.671543 2573 generic.go:356] "Generic (PLEG): container finished" podID="9cc0af5c-1fca-4b59-90ac-c82f07087d2f" containerID="e1ef4551d9f51fe22bfdc7572d17b8c55298d93a7b9489faadae999a74420e0e" exitCode=0 Sep 15 21:53:41.671661 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.671574 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j" event={"ID":"9cc0af5c-1fca-4b59-90ac-c82f07087d2f","Type":"ContainerDied","Data":"e1ef4551d9f51fe22bfdc7572d17b8c55298d93a7b9489faadae999a74420e0e"} Sep 15 21:53:41.671661 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.671593 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j" Sep 15 21:53:41.671661 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.671626 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j" event={"ID":"9cc0af5c-1fca-4b59-90ac-c82f07087d2f","Type":"ContainerDied","Data":"b7a9be9aede34cb23f9776ea79646ed01c2182983c7ca28629ad888374457b74"} Sep 15 21:53:41.680055 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.680034 2573 scope.go:117] "RemoveContainer" containerID="b39087643ceb356ad0bacaccd81a76b2f7d0e9e3569c39820501afd36d3adc03" Sep 15 21:53:41.680338 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:53:41.680320 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b39087643ceb356ad0bacaccd81a76b2f7d0e9e3569c39820501afd36d3adc03\": container with ID starting with b39087643ceb356ad0bacaccd81a76b2f7d0e9e3569c39820501afd36d3adc03 not found: ID does not exist" containerID="b39087643ceb356ad0bacaccd81a76b2f7d0e9e3569c39820501afd36d3adc03" Sep 15 21:53:41.680401 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.680345 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b39087643ceb356ad0bacaccd81a76b2f7d0e9e3569c39820501afd36d3adc03"} err="failed to get container status \"b39087643ceb356ad0bacaccd81a76b2f7d0e9e3569c39820501afd36d3adc03\": rpc error: code = NotFound desc = could not find container \"b39087643ceb356ad0bacaccd81a76b2f7d0e9e3569c39820501afd36d3adc03\": container with ID starting with b39087643ceb356ad0bacaccd81a76b2f7d0e9e3569c39820501afd36d3adc03 not found: ID does not exist" Sep 15 21:53:41.680401 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.680363 2573 scope.go:117] "RemoveContainer" containerID="e1ef4551d9f51fe22bfdc7572d17b8c55298d93a7b9489faadae999a74420e0e" Sep 15 21:53:41.689739 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.689721 2573 scope.go:117] "RemoveContainer" containerID="e1ef4551d9f51fe22bfdc7572d17b8c55298d93a7b9489faadae999a74420e0e" Sep 15 21:53:41.690065 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:53:41.690046 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1ef4551d9f51fe22bfdc7572d17b8c55298d93a7b9489faadae999a74420e0e\": container with ID starting with e1ef4551d9f51fe22bfdc7572d17b8c55298d93a7b9489faadae999a74420e0e not found: ID does not exist" containerID="e1ef4551d9f51fe22bfdc7572d17b8c55298d93a7b9489faadae999a74420e0e" Sep 15 21:53:41.690133 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.690071 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1ef4551d9f51fe22bfdc7572d17b8c55298d93a7b9489faadae999a74420e0e"} err="failed to get container status \"e1ef4551d9f51fe22bfdc7572d17b8c55298d93a7b9489faadae999a74420e0e\": rpc error: code = NotFound desc = could not find container \"e1ef4551d9f51fe22bfdc7572d17b8c55298d93a7b9489faadae999a74420e0e\": container with ID starting with e1ef4551d9f51fe22bfdc7572d17b8c55298d93a7b9489faadae999a74420e0e not found: ID does not exist" Sep 15 21:53:41.697494 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.697472 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j"] Sep 15 21:53:41.700887 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.700858 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j"] Sep 15 21:53:41.710140 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.710113 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9"] Sep 15 21:53:41.712891 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.712872 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9"] Sep 15 21:53:41.935610 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.935530 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="535b620a-0c5a-41db-b8ab-d70541fa25c5" path="/var/lib/kubelet/pods/535b620a-0c5a-41db-b8ab-d70541fa25c5/volumes" Sep 15 21:53:41.935957 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:41.935943 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cc0af5c-1fca-4b59-90ac-c82f07087d2f" path="/var/lib/kubelet/pods/9cc0af5c-1fca-4b59-90ac-c82f07087d2f/volumes" Sep 15 21:53:42.357487 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:42.357444 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:43.071037 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:43.071000 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:43.722427 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:43.722376 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:44.480391 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:44.480358 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:45.139784 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:45.139747 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:45.768887 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:45.768807 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:46.144403 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:46.144323 2573 scope.go:117] "RemoveContainer" containerID="1267ebaf0ea582a8889529996ba0672aa8bd6e8e528da0a4cb95300a48dd4afe" Sep 15 21:53:46.153303 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:46.153286 2573 scope.go:117] "RemoveContainer" containerID="e32c96b7d3411c19d5207edc4e994d7dbd8e98ae2d08b135df40a671376fb5ce" Sep 15 21:53:47.486605 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:47.486573 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:47.588450 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:47.588416 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:47.818626 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:47.818539 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx"] Sep 15 21:53:47.818800 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:47.818778 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" podUID="15fb724f-e820-4216-a29a-d67dc264a2ed" containerName="istio-proxy" containerID="cri-o://d1ca64216a1bb69f09bf4ac2c4df5133e68dd112f175b506c3a8c018fdcfbf37" gracePeriod=30 Sep 15 21:53:47.833201 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:47.833160 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:48.266145 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:48.266089 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:49.126782 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:49.126744 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:49.961080 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:49.961038 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:50.579725 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:50.579683 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:51.385128 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:51.385093 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:51.982220 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:51.982181 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:52.668902 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:52.668831 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:53.073138 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.073114 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:53:53.161287 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.161259 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtdn2\" (UniqueName: \"kubernetes.io/projected/15fb724f-e820-4216-a29a-d67dc264a2ed-kube-api-access-dtdn2\") pod \"15fb724f-e820-4216-a29a-d67dc264a2ed\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " Sep 15 21:53:53.161287 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.161290 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15fb724f-e820-4216-a29a-d67dc264a2ed-istio-token\") pod \"15fb724f-e820-4216-a29a-d67dc264a2ed\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " Sep 15 21:53:53.161545 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.161334 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-workload-certs\") pod \"15fb724f-e820-4216-a29a-d67dc264a2ed\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " Sep 15 21:53:53.161545 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.161371 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15fb724f-e820-4216-a29a-d67dc264a2ed-istiod-ca-cert\") pod \"15fb724f-e820-4216-a29a-d67dc264a2ed\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " Sep 15 21:53:53.161545 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.161431 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-credential-socket\") pod \"15fb724f-e820-4216-a29a-d67dc264a2ed\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " Sep 15 21:53:53.161545 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.161473 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-istio-data\") pod \"15fb724f-e820-4216-a29a-d67dc264a2ed\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " Sep 15 21:53:53.161545 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.161534 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-istio-envoy\") pod \"15fb724f-e820-4216-a29a-d67dc264a2ed\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " Sep 15 21:53:53.161822 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.161591 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-workload-socket\") pod \"15fb724f-e820-4216-a29a-d67dc264a2ed\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " Sep 15 21:53:53.161822 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.161620 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15fb724f-e820-4216-a29a-d67dc264a2ed-istio-podinfo\") pod \"15fb724f-e820-4216-a29a-d67dc264a2ed\" (UID: \"15fb724f-e820-4216-a29a-d67dc264a2ed\") " Sep 15 21:53:53.161822 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.161668 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "15fb724f-e820-4216-a29a-d67dc264a2ed" (UID: "15fb724f-e820-4216-a29a-d67dc264a2ed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:53:53.162006 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.161881 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-istio-data" (OuterVolumeSpecName: "istio-data") pod "15fb724f-e820-4216-a29a-d67dc264a2ed" (UID: "15fb724f-e820-4216-a29a-d67dc264a2ed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:53:53.162006 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.161904 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "15fb724f-e820-4216-a29a-d67dc264a2ed" (UID: "15fb724f-e820-4216-a29a-d67dc264a2ed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:53:53.162006 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.161904 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15fb724f-e820-4216-a29a-d67dc264a2ed-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "15fb724f-e820-4216-a29a-d67dc264a2ed" (UID: "15fb724f-e820-4216-a29a-d67dc264a2ed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:53:53.162173 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.162028 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "15fb724f-e820-4216-a29a-d67dc264a2ed" (UID: "15fb724f-e820-4216-a29a-d67dc264a2ed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:53:53.162173 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.162135 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-workload-certs\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:53:53.162173 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.162163 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15fb724f-e820-4216-a29a-d67dc264a2ed-istiod-ca-cert\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:53:53.162333 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.162177 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-credential-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:53:53.162333 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.162190 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-istio-data\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:53:53.162333 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.162204 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-workload-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:53:53.163749 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.163720 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15fb724f-e820-4216-a29a-d67dc264a2ed-kube-api-access-dtdn2" (OuterVolumeSpecName: "kube-api-access-dtdn2") pod "15fb724f-e820-4216-a29a-d67dc264a2ed" (UID: "15fb724f-e820-4216-a29a-d67dc264a2ed"). InnerVolumeSpecName "kube-api-access-dtdn2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:53:53.163749 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.163724 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "15fb724f-e820-4216-a29a-d67dc264a2ed" (UID: "15fb724f-e820-4216-a29a-d67dc264a2ed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:53:53.163960 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.163828 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15fb724f-e820-4216-a29a-d67dc264a2ed-istio-token" (OuterVolumeSpecName: "istio-token") pod "15fb724f-e820-4216-a29a-d67dc264a2ed" (UID: "15fb724f-e820-4216-a29a-d67dc264a2ed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:53:53.163960 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.163951 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/15fb724f-e820-4216-a29a-d67dc264a2ed-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "15fb724f-e820-4216-a29a-d67dc264a2ed" (UID: "15fb724f-e820-4216-a29a-d67dc264a2ed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 15 21:53:53.263368 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.263333 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15fb724f-e820-4216-a29a-d67dc264a2ed-istio-envoy\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:53:53.263368 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.263364 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15fb724f-e820-4216-a29a-d67dc264a2ed-istio-podinfo\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:53:53.263368 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.263374 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtdn2\" (UniqueName: \"kubernetes.io/projected/15fb724f-e820-4216-a29a-d67dc264a2ed-kube-api-access-dtdn2\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:53:53.263609 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.263382 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15fb724f-e820-4216-a29a-d67dc264a2ed-istio-token\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:53:53.371627 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.371510 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:53.751931 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.751892 2573 generic.go:356] "Generic (PLEG): container finished" podID="15fb724f-e820-4216-a29a-d67dc264a2ed" containerID="d1ca64216a1bb69f09bf4ac2c4df5133e68dd112f175b506c3a8c018fdcfbf37" exitCode=0 Sep 15 21:53:53.752126 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.751941 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" Sep 15 21:53:53.752126 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.751979 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" event={"ID":"15fb724f-e820-4216-a29a-d67dc264a2ed","Type":"ContainerDied","Data":"d1ca64216a1bb69f09bf4ac2c4df5133e68dd112f175b506c3a8c018fdcfbf37"} Sep 15 21:53:53.752126 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.752030 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx" event={"ID":"15fb724f-e820-4216-a29a-d67dc264a2ed","Type":"ContainerDied","Data":"cab072e2ff5de3c7c821dab119134ab1d31f03f5c6337d168015935e67be5a00"} Sep 15 21:53:53.752126 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.752053 2573 scope.go:117] "RemoveContainer" containerID="d1ca64216a1bb69f09bf4ac2c4df5133e68dd112f175b506c3a8c018fdcfbf37" Sep 15 21:53:53.762150 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.762131 2573 scope.go:117] "RemoveContainer" containerID="f9e60c52f0f9dfb55a8574a79413222ab85e898abb5bbda5d66f5ca5b6f39e9e" Sep 15 21:53:53.770811 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.770737 2573 scope.go:117] "RemoveContainer" containerID="d1ca64216a1bb69f09bf4ac2c4df5133e68dd112f175b506c3a8c018fdcfbf37" Sep 15 21:53:53.771108 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:53:53.771082 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1ca64216a1bb69f09bf4ac2c4df5133e68dd112f175b506c3a8c018fdcfbf37\": container with ID starting with d1ca64216a1bb69f09bf4ac2c4df5133e68dd112f175b506c3a8c018fdcfbf37 not found: ID does not exist" containerID="d1ca64216a1bb69f09bf4ac2c4df5133e68dd112f175b506c3a8c018fdcfbf37" Sep 15 21:53:53.771387 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.771352 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1ca64216a1bb69f09bf4ac2c4df5133e68dd112f175b506c3a8c018fdcfbf37"} err="failed to get container status \"d1ca64216a1bb69f09bf4ac2c4df5133e68dd112f175b506c3a8c018fdcfbf37\": rpc error: code = NotFound desc = could not find container \"d1ca64216a1bb69f09bf4ac2c4df5133e68dd112f175b506c3a8c018fdcfbf37\": container with ID starting with d1ca64216a1bb69f09bf4ac2c4df5133e68dd112f175b506c3a8c018fdcfbf37 not found: ID does not exist" Sep 15 21:53:53.771495 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.771389 2573 scope.go:117] "RemoveContainer" containerID="f9e60c52f0f9dfb55a8574a79413222ab85e898abb5bbda5d66f5ca5b6f39e9e" Sep 15 21:53:53.771707 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:53:53.771688 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9e60c52f0f9dfb55a8574a79413222ab85e898abb5bbda5d66f5ca5b6f39e9e\": container with ID starting with f9e60c52f0f9dfb55a8574a79413222ab85e898abb5bbda5d66f5ca5b6f39e9e not found: ID does not exist" containerID="f9e60c52f0f9dfb55a8574a79413222ab85e898abb5bbda5d66f5ca5b6f39e9e" Sep 15 21:53:53.771757 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.771715 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9e60c52f0f9dfb55a8574a79413222ab85e898abb5bbda5d66f5ca5b6f39e9e"} err="failed to get container status \"f9e60c52f0f9dfb55a8574a79413222ab85e898abb5bbda5d66f5ca5b6f39e9e\": rpc error: code = NotFound desc = could not find container \"f9e60c52f0f9dfb55a8574a79413222ab85e898abb5bbda5d66f5ca5b6f39e9e\": container with ID starting with f9e60c52f0f9dfb55a8574a79413222ab85e898abb5bbda5d66f5ca5b6f39e9e not found: ID does not exist" Sep 15 21:53:53.774581 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.774561 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx"] Sep 15 21:53:53.780025 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.780003 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx"] Sep 15 21:53:53.934804 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:53.934767 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15fb724f-e820-4216-a29a-d67dc264a2ed" path="/var/lib/kubelet/pods/15fb724f-e820-4216-a29a-d67dc264a2ed/volumes" Sep 15 21:53:58.558818 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:58.558782 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:58.617334 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:58.617290 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:58.715034 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:58.714990 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:58.815388 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:58.815291 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:59.093481 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:59.093388 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:59.194481 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:59.194442 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:53:59.826968 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:53:59.826937 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:00.662358 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:00.662324 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:01.359425 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:01.359393 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:02.050268 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:02.050226 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:02.926864 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:02.926814 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:05.001714 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:05.001678 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:05.102069 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:05.102036 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:05.293135 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:05.293048 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:05.942819 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:05.942785 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:06.578776 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:06.578730 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:07.265992 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:07.265952 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:07.981559 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:07.981465 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:08.833311 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:08.833267 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:09.456046 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:09.456008 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:10.066654 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:10.066614 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:16.163622 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:16.163584 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:16.229770 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:16.229731 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:16.289377 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:16.289343 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:16.345394 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:16.345358 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:16.712624 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:16.712585 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:16.813122 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:16.813088 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:17.482598 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:17.482569 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:18.178722 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:18.178686 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:18.879685 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:18.879653 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:19.588353 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:19.588317 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:22.501576 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:22.501538 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:22.602992 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:22.602960 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:22.753341 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:22.753253 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn"] Sep 15 21:54:22.753555 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:22.753523 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" podUID="9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" containerName="istio-proxy" containerID="cri-o://8883bd0b3ac42de7d2213376e6122ff19ff0653bb50fb8322683a73daca4ebf0" gracePeriod=30 Sep 15 21:54:22.779586 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:22.779552 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:27.520581 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:27.520545 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:27.963029 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:27.962996 2573 generic.go:356] "Generic (PLEG): container finished" podID="9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" containerID="8883bd0b3ac42de7d2213376e6122ff19ff0653bb50fb8322683a73daca4ebf0" exitCode=0 Sep 15 21:54:27.963178 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:27.963065 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" event={"ID":"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98","Type":"ContainerDied","Data":"8883bd0b3ac42de7d2213376e6122ff19ff0653bb50fb8322683a73daca4ebf0"} Sep 15 21:54:27.963178 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:27.963135 2573 scope.go:117] "RemoveContainer" containerID="dba4b169014876f84b33f79a6ec53c3a0557d8b4c2fd2080056f8f7b3713e814" Sep 15 21:54:28.017783 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.017761 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:54:28.118183 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.118097 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istio-envoy\") pod \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " Sep 15 21:54:28.118183 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.118140 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istio-data\") pod \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " Sep 15 21:54:28.118394 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.118197 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-workload-socket\") pod \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " Sep 15 21:54:28.118394 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.118258 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbbxv\" (UniqueName: \"kubernetes.io/projected/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-kube-api-access-cbbxv\") pod \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " Sep 15 21:54:28.118394 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.118295 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istiod-ca-cert\") pod \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " Sep 15 21:54:28.118394 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.118322 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-workload-certs\") pod \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " Sep 15 21:54:28.118605 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.118431 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-credential-socket\") pod \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " Sep 15 21:54:28.118605 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.118456 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istio-token\") pod \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " Sep 15 21:54:28.118605 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.118513 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istio-podinfo\") pod \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\" (UID: \"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98\") " Sep 15 21:54:28.118605 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.118490 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" (UID: "9e47794f-6b6e-4cb0-a9aa-8b37be75ff98"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:54:28.118605 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.118534 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istio-data" (OuterVolumeSpecName: "istio-data") pod "9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" (UID: "9e47794f-6b6e-4cb0-a9aa-8b37be75ff98"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:54:28.118906 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.118682 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" (UID: "9e47794f-6b6e-4cb0-a9aa-8b37be75ff98"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:54:28.118906 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.118719 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" (UID: "9e47794f-6b6e-4cb0-a9aa-8b37be75ff98"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:54:28.119028 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.118974 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-credential-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:54:28.119028 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.118996 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istio-data\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:54:28.119028 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.119011 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-workload-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:54:28.119028 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.119023 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-workload-certs\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:54:28.119218 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.119088 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" (UID: "9e47794f-6b6e-4cb0-a9aa-8b37be75ff98"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:54:28.120384 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.120351 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" (UID: "9e47794f-6b6e-4cb0-a9aa-8b37be75ff98"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:54:28.120546 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.120520 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-kube-api-access-cbbxv" (OuterVolumeSpecName: "kube-api-access-cbbxv") pod "9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" (UID: "9e47794f-6b6e-4cb0-a9aa-8b37be75ff98"). InnerVolumeSpecName "kube-api-access-cbbxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:54:28.120903 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.120882 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istio-token" (OuterVolumeSpecName: "istio-token") pod "9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" (UID: "9e47794f-6b6e-4cb0-a9aa-8b37be75ff98"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:54:28.120903 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.120890 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" (UID: "9e47794f-6b6e-4cb0-a9aa-8b37be75ff98"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 15 21:54:28.220567 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.220533 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istio-token\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:54:28.220567 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.220563 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istio-podinfo\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:54:28.220567 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.220572 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istio-envoy\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:54:28.220799 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.220580 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbbxv\" (UniqueName: \"kubernetes.io/projected/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-kube-api-access-cbbxv\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:54:28.220799 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.220590 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98-istiod-ca-cert\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:54:28.411105 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.411003 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:28.970021 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.969983 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" event={"ID":"9e47794f-6b6e-4cb0-a9aa-8b37be75ff98","Type":"ContainerDied","Data":"cef1dde28a22d192f1fdc66a4fc77ee0738b3ddc44e73903c4d118d3197bb118"} Sep 15 21:54:28.970021 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.970004 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn" Sep 15 21:54:28.970576 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.970049 2573 scope.go:117] "RemoveContainer" containerID="8883bd0b3ac42de7d2213376e6122ff19ff0653bb50fb8322683a73daca4ebf0" Sep 15 21:54:28.992612 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.992585 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn"] Sep 15 21:54:28.998296 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:28.998274 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn"] Sep 15 21:54:29.182510 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:29.182473 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:29.867356 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:29.867309 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:29.938778 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:29.938729 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" path="/var/lib/kubelet/pods/9e47794f-6b6e-4cb0-a9aa-8b37be75ff98/volumes" Sep 15 21:54:30.663395 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:30.663359 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:31.363629 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:31.363594 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:32.601194 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:32.601157 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:43.262980 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:43.262947 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-360e43-29825145-rmd74"] Sep 15 21:54:43.265577 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:43.265553 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-360e43-29825145-rmd74"] Sep 15 21:54:43.269095 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:43.269060 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:43.332968 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:43.332933 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:43.433344 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:43.433303 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:43.537006 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:43.536894 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:43.833645 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:43.833557 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:43.933991 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:43.933956 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb41fb4c-04f5-49ba-9a9d-d6c724695d31" path="/var/lib/kubelet/pods/eb41fb4c-04f5-49ba-9a9d-d6c724695d31/volumes" Sep 15 21:54:43.934564 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:43.934536 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:44.569418 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:44.569379 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:45.379883 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:45.379838 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:46.163549 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:46.163522 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:46.188552 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:46.188523 2573 scope.go:117] "RemoveContainer" containerID="9dc319e25bf5fbcfe685e95d66f6aba6d281f63604baedf835973dcd063eec49" Sep 15 21:54:49.734866 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:49.734818 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:49.803272 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:49.803235 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:50.005394 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:50.005302 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm"] Sep 15 21:54:50.005598 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:50.005574 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" podUID="bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" containerName="istio-proxy" containerID="cri-o://d9ff27db5005a2c9c82ea5878b2b586ff1ec8cf74a656f43d44f4bb09455f054" gracePeriod=30 Sep 15 21:54:50.030905 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:50.030874 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:54:55.132506 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.132466 2573 generic.go:356] "Generic (PLEG): container finished" podID="bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" containerID="d9ff27db5005a2c9c82ea5878b2b586ff1ec8cf74a656f43d44f4bb09455f054" exitCode=0 Sep 15 21:54:55.132944 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.132531 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" event={"ID":"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056","Type":"ContainerDied","Data":"d9ff27db5005a2c9c82ea5878b2b586ff1ec8cf74a656f43d44f4bb09455f054"} Sep 15 21:54:55.132944 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.132594 2573 scope.go:117] "RemoveContainer" containerID="9e495a94682e7c275b79f86687022cb141eacfd0f6c82d5eaeac3fbc9a45d955" Sep 15 21:54:55.261871 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.261820 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:54:55.291634 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.291565 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-workload-certs\") pod \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " Sep 15 21:54:55.291634 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.291600 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istio-podinfo\") pod \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " Sep 15 21:54:55.291838 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.291659 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istio-data\") pod \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " Sep 15 21:54:55.291838 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.291689 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istio-token\") pod \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " Sep 15 21:54:55.291838 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.291714 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istio-envoy\") pod \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " Sep 15 21:54:55.291838 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.291759 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9txhn\" (UniqueName: \"kubernetes.io/projected/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-kube-api-access-9txhn\") pod \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " Sep 15 21:54:55.291838 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.291816 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-workload-socket\") pod \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " Sep 15 21:54:55.292179 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.291839 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" (UID: "bd5ec189-e2d2-47c0-8f15-f9ec1c97e056"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:54:55.292179 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.291865 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-credential-socket\") pod \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " Sep 15 21:54:55.292179 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.291929 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istiod-ca-cert\") pod \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\" (UID: \"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056\") " Sep 15 21:54:55.292179 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.291987 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istio-data" (OuterVolumeSpecName: "istio-data") pod "bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" (UID: "bd5ec189-e2d2-47c0-8f15-f9ec1c97e056"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:54:55.292179 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.292067 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" (UID: "bd5ec189-e2d2-47c0-8f15-f9ec1c97e056"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:54:55.292179 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.292159 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" (UID: "bd5ec189-e2d2-47c0-8f15-f9ec1c97e056"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:54:55.292486 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.292383 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-workload-certs\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:54:55.292486 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.292402 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istio-data\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:54:55.292486 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.292416 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-workload-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:54:55.292486 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.292428 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-credential-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:54:55.292486 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.292426 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" (UID: "bd5ec189-e2d2-47c0-8f15-f9ec1c97e056"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:54:55.293945 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.293918 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" (UID: "bd5ec189-e2d2-47c0-8f15-f9ec1c97e056"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 15 21:54:55.294368 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.294341 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" (UID: "bd5ec189-e2d2-47c0-8f15-f9ec1c97e056"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:54:55.294457 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.294386 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istio-token" (OuterVolumeSpecName: "istio-token") pod "bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" (UID: "bd5ec189-e2d2-47c0-8f15-f9ec1c97e056"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:54:55.294568 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.294546 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-kube-api-access-9txhn" (OuterVolumeSpecName: "kube-api-access-9txhn") pod "bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" (UID: "bd5ec189-e2d2-47c0-8f15-f9ec1c97e056"). InnerVolumeSpecName "kube-api-access-9txhn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:54:55.393702 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.393663 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istio-token\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:54:55.393702 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.393696 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istio-envoy\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:54:55.393702 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.393705 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9txhn\" (UniqueName: \"kubernetes.io/projected/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-kube-api-access-9txhn\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:54:55.393985 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.393714 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istiod-ca-cert\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:54:55.393985 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:55.393723 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056-istio-podinfo\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:54:56.139459 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:56.139429 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" Sep 15 21:54:56.139841 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:56.139477 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm" event={"ID":"bd5ec189-e2d2-47c0-8f15-f9ec1c97e056","Type":"ContainerDied","Data":"8817ed5cc4abd23a6289f10d07b853e4cf7568dc4ae5b9c963042207a11761ee"} Sep 15 21:54:56.139841 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:56.139535 2573 scope.go:117] "RemoveContainer" containerID="d9ff27db5005a2c9c82ea5878b2b586ff1ec8cf74a656f43d44f4bb09455f054" Sep 15 21:54:56.157909 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:56.157882 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm"] Sep 15 21:54:56.161478 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:56.161454 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm"] Sep 15 21:54:57.934609 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:54:57.934574 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" path="/var/lib/kubelet/pods/bd5ec189-e2d2-47c0-8f15-f9ec1c97e056/volumes" Sep 15 21:55:08.892206 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:55:08.892162 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:55:08.991687 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:55:08.991650 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:55:10.376020 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:55:10.375984 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:55:24.658856 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:55:24.658805 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:55:44.814781 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:55:44.814734 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:55:44.883009 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:55:44.882970 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:55:45.847674 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:55:45.847639 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:55:46.036108 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:55:46.036077 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/1.log" Sep 15 21:55:46.037304 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:55:46.037283 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/1.log" Sep 15 21:55:46.138832 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:55:46.138737 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:55:46.532031 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:55:46.531986 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:55:47.287686 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:55:47.287643 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:55:47.985375 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:55:47.985341 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:55:49.906435 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:55:49.906397 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:56:00.106745 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:00.106705 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:56:00.814922 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:00.814873 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:56:00.819768 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:00.819744 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-56e305-29825145-t85md"] Sep 15 21:56:00.823436 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:00.823412 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-56e305-29825145-t85md"] Sep 15 21:56:00.853002 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:00.852971 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj"] Sep 15 21:56:00.853243 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:00.853216 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj" podUID="3a7ae857-7728-4934-b57c-8c57c687ba17" containerName="payload-processing" containerID="cri-o://4fe08582905f364f45f022f1eaacdccf0e98ad0318f4f00e90f007bf51eb6c60" gracePeriod=30 Sep 15 21:56:00.862410 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:00.862384 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c"] Sep 15 21:56:00.862633 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:00.862606 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c" podUID="47ace233-bc09-435d-b03f-dd19ed22d010" containerName="payload-pre-processing" containerID="cri-o://5330bea6dbd3c73c9625c6c7d04e353e4ea460a0943ec25a4838e9c2e17a0807" gracePeriod=30 Sep 15 21:56:00.928460 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:00.928421 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:56:01.035455 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.034825 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:56:01.131000 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.130967 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj" Sep 15 21:56:01.151190 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.151171 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c" Sep 15 21:56:01.155079 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.155062 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a7ae857-7728-4934-b57c-8c57c687ba17-plugins-config-volume\") pod \"3a7ae857-7728-4934-b57c-8c57c687ba17\" (UID: \"3a7ae857-7728-4934-b57c-8c57c687ba17\") " Sep 15 21:56:01.155154 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.155107 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7lxh\" (UniqueName: \"kubernetes.io/projected/3a7ae857-7728-4934-b57c-8c57c687ba17-kube-api-access-t7lxh\") pod \"3a7ae857-7728-4934-b57c-8c57c687ba17\" (UID: \"3a7ae857-7728-4934-b57c-8c57c687ba17\") " Sep 15 21:56:01.155400 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.155377 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a7ae857-7728-4934-b57c-8c57c687ba17-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3a7ae857-7728-4934-b57c-8c57c687ba17" (UID: "3a7ae857-7728-4934-b57c-8c57c687ba17"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:56:01.157221 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.157196 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a7ae857-7728-4934-b57c-8c57c687ba17-kube-api-access-t7lxh" (OuterVolumeSpecName: "kube-api-access-t7lxh") pod "3a7ae857-7728-4934-b57c-8c57c687ba17" (UID: "3a7ae857-7728-4934-b57c-8c57c687ba17"). InnerVolumeSpecName "kube-api-access-t7lxh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:56:01.157467 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.157440 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:56:01.256958 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.256222 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx5kk\" (UniqueName: \"kubernetes.io/projected/47ace233-bc09-435d-b03f-dd19ed22d010-kube-api-access-tx5kk\") pod \"47ace233-bc09-435d-b03f-dd19ed22d010\" (UID: \"47ace233-bc09-435d-b03f-dd19ed22d010\") " Sep 15 21:56:01.256958 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.256365 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47ace233-bc09-435d-b03f-dd19ed22d010-plugins-config-volume\") pod \"47ace233-bc09-435d-b03f-dd19ed22d010\" (UID: \"47ace233-bc09-435d-b03f-dd19ed22d010\") " Sep 15 21:56:01.256958 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.256835 2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a7ae857-7728-4934-b57c-8c57c687ba17-plugins-config-volume\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:56:01.256958 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.256888 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7lxh\" (UniqueName: \"kubernetes.io/projected/3a7ae857-7728-4934-b57c-8c57c687ba17-kube-api-access-t7lxh\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:56:01.257311 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.257113 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47ace233-bc09-435d-b03f-dd19ed22d010-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "47ace233-bc09-435d-b03f-dd19ed22d010" (UID: "47ace233-bc09-435d-b03f-dd19ed22d010"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:56:01.259436 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.259393 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47ace233-bc09-435d-b03f-dd19ed22d010-kube-api-access-tx5kk" (OuterVolumeSpecName: "kube-api-access-tx5kk") pod "47ace233-bc09-435d-b03f-dd19ed22d010" (UID: "47ace233-bc09-435d-b03f-dd19ed22d010"). InnerVolumeSpecName "kube-api-access-tx5kk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:56:01.278450 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.278384 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:56:01.358177 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.358089 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx5kk\" (UniqueName: \"kubernetes.io/projected/47ace233-bc09-435d-b03f-dd19ed22d010-kube-api-access-tx5kk\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:56:01.358177 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.358118 2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47ace233-bc09-435d-b03f-dd19ed22d010-plugins-config-volume\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:56:01.519898 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.519832 2573 generic.go:356] "Generic (PLEG): container finished" podID="3a7ae857-7728-4934-b57c-8c57c687ba17" containerID="4fe08582905f364f45f022f1eaacdccf0e98ad0318f4f00e90f007bf51eb6c60" exitCode=0 Sep 15 21:56:01.519898 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.519891 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj" Sep 15 21:56:01.520167 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.519921 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj" event={"ID":"3a7ae857-7728-4934-b57c-8c57c687ba17","Type":"ContainerDied","Data":"4fe08582905f364f45f022f1eaacdccf0e98ad0318f4f00e90f007bf51eb6c60"} Sep 15 21:56:01.520167 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.520016 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj" event={"ID":"3a7ae857-7728-4934-b57c-8c57c687ba17","Type":"ContainerDied","Data":"3721bc0eebb84bf2d258547df28a8b6efd69c914a217d5f3c817d8813c84260b"} Sep 15 21:56:01.520167 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.520048 2573 scope.go:117] "RemoveContainer" containerID="4fe08582905f364f45f022f1eaacdccf0e98ad0318f4f00e90f007bf51eb6c60" Sep 15 21:56:01.521439 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.521416 2573 generic.go:356] "Generic (PLEG): container finished" podID="47ace233-bc09-435d-b03f-dd19ed22d010" containerID="5330bea6dbd3c73c9625c6c7d04e353e4ea460a0943ec25a4838e9c2e17a0807" exitCode=0 Sep 15 21:56:01.521511 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.521447 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c" event={"ID":"47ace233-bc09-435d-b03f-dd19ed22d010","Type":"ContainerDied","Data":"5330bea6dbd3c73c9625c6c7d04e353e4ea460a0943ec25a4838e9c2e17a0807"} Sep 15 21:56:01.521511 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.521492 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c" event={"ID":"47ace233-bc09-435d-b03f-dd19ed22d010","Type":"ContainerDied","Data":"07c2e49432a0959f639680a7652f796817a7c3a6f089fa80641105379c2ed3a3"} Sep 15 21:56:01.521511 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.521455 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c" Sep 15 21:56:01.530535 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.530513 2573 scope.go:117] "RemoveContainer" containerID="4fe08582905f364f45f022f1eaacdccf0e98ad0318f4f00e90f007bf51eb6c60" Sep 15 21:56:01.530841 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:56:01.530822 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fe08582905f364f45f022f1eaacdccf0e98ad0318f4f00e90f007bf51eb6c60\": container with ID starting with 4fe08582905f364f45f022f1eaacdccf0e98ad0318f4f00e90f007bf51eb6c60 not found: ID does not exist" containerID="4fe08582905f364f45f022f1eaacdccf0e98ad0318f4f00e90f007bf51eb6c60" Sep 15 21:56:01.530949 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.530879 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fe08582905f364f45f022f1eaacdccf0e98ad0318f4f00e90f007bf51eb6c60"} err="failed to get container status \"4fe08582905f364f45f022f1eaacdccf0e98ad0318f4f00e90f007bf51eb6c60\": rpc error: code = NotFound desc = could not find container \"4fe08582905f364f45f022f1eaacdccf0e98ad0318f4f00e90f007bf51eb6c60\": container with ID starting with 4fe08582905f364f45f022f1eaacdccf0e98ad0318f4f00e90f007bf51eb6c60 not found: ID does not exist" Sep 15 21:56:01.530949 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.530898 2573 scope.go:117] "RemoveContainer" containerID="5330bea6dbd3c73c9625c6c7d04e353e4ea460a0943ec25a4838e9c2e17a0807" Sep 15 21:56:01.539163 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.539142 2573 scope.go:117] "RemoveContainer" containerID="5330bea6dbd3c73c9625c6c7d04e353e4ea460a0943ec25a4838e9c2e17a0807" Sep 15 21:56:01.539473 ip-10-0-133-42 kubenswrapper[2573]: E0915 21:56:01.539455 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5330bea6dbd3c73c9625c6c7d04e353e4ea460a0943ec25a4838e9c2e17a0807\": container with ID starting with 5330bea6dbd3c73c9625c6c7d04e353e4ea460a0943ec25a4838e9c2e17a0807 not found: ID does not exist" containerID="5330bea6dbd3c73c9625c6c7d04e353e4ea460a0943ec25a4838e9c2e17a0807" Sep 15 21:56:01.539535 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.539478 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5330bea6dbd3c73c9625c6c7d04e353e4ea460a0943ec25a4838e9c2e17a0807"} err="failed to get container status \"5330bea6dbd3c73c9625c6c7d04e353e4ea460a0943ec25a4838e9c2e17a0807\": rpc error: code = NotFound desc = could not find container \"5330bea6dbd3c73c9625c6c7d04e353e4ea460a0943ec25a4838e9c2e17a0807\": container with ID starting with 5330bea6dbd3c73c9625c6c7d04e353e4ea460a0943ec25a4838e9c2e17a0807 not found: ID does not exist" Sep 15 21:56:01.561300 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.561275 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj"] Sep 15 21:56:01.566539 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.566515 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj"] Sep 15 21:56:01.583370 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.583345 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c"] Sep 15 21:56:01.587958 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.587936 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c"] Sep 15 21:56:01.614459 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.614393 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:56:01.727842 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.727808 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:56:01.934086 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.934055 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a7ae857-7728-4934-b57c-8c57c687ba17" path="/var/lib/kubelet/pods/3a7ae857-7728-4934-b57c-8c57c687ba17/volumes" Sep 15 21:56:01.934480 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.934464 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47ace233-bc09-435d-b03f-dd19ed22d010" path="/var/lib/kubelet/pods/47ace233-bc09-435d-b03f-dd19ed22d010/volumes" Sep 15 21:56:01.934736 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:01.934724 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96e2d281-f474-4a14-af7a-0ee64ea3793d" path="/var/lib/kubelet/pods/96e2d281-f474-4a14-af7a-0ee64ea3793d/volumes" Sep 15 21:56:02.947413 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:02.947379 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:56:04.178003 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:04.177967 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:56:10.020390 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:10.020358 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:56:10.184726 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:10.184691 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:56:10.418172 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:10.418080 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt"] Sep 15 21:56:10.418322 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:10.418288 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" podUID="16094ec4-2589-412c-80bc-dd53b7a91b38" containerName="istio-proxy" containerID="cri-o://fcbdd3f0abb2e6c3ea6314a7c097a96621f2a9ba1e0211a6a557bc2510f51414" gracePeriod=30 Sep 15 21:56:10.501061 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:10.501020 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:56:15.610347 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.610314 2573 generic.go:356] "Generic (PLEG): container finished" podID="16094ec4-2589-412c-80bc-dd53b7a91b38" containerID="fcbdd3f0abb2e6c3ea6314a7c097a96621f2a9ba1e0211a6a557bc2510f51414" exitCode=0 Sep 15 21:56:15.610819 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.610384 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" event={"ID":"16094ec4-2589-412c-80bc-dd53b7a91b38","Type":"ContainerDied","Data":"fcbdd3f0abb2e6c3ea6314a7c097a96621f2a9ba1e0211a6a557bc2510f51414"} Sep 15 21:56:15.610819 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.610466 2573 scope.go:117] "RemoveContainer" containerID="c52c2135387331876ae6528c430636986a4b4499ccf394a5373c0d466a00a451" Sep 15 21:56:15.675131 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.675104 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:56:15.802361 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.802325 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-workload-certs\") pod \"16094ec4-2589-412c-80bc-dd53b7a91b38\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " Sep 15 21:56:15.802361 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.802367 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzr28\" (UniqueName: \"kubernetes.io/projected/16094ec4-2589-412c-80bc-dd53b7a91b38-kube-api-access-hzr28\") pod \"16094ec4-2589-412c-80bc-dd53b7a91b38\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " Sep 15 21:56:15.802638 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.802401 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-credential-socket\") pod \"16094ec4-2589-412c-80bc-dd53b7a91b38\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " Sep 15 21:56:15.802638 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.802421 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-istio-data\") pod \"16094ec4-2589-412c-80bc-dd53b7a91b38\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " Sep 15 21:56:15.802638 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.802448 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16094ec4-2589-412c-80bc-dd53b7a91b38-istio-podinfo\") pod \"16094ec4-2589-412c-80bc-dd53b7a91b38\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " Sep 15 21:56:15.802638 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.802486 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-workload-socket\") pod \"16094ec4-2589-412c-80bc-dd53b7a91b38\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " Sep 15 21:56:15.802638 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.802518 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16094ec4-2589-412c-80bc-dd53b7a91b38-istiod-ca-cert\") pod \"16094ec4-2589-412c-80bc-dd53b7a91b38\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " Sep 15 21:56:15.802638 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.802581 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-istio-envoy\") pod \"16094ec4-2589-412c-80bc-dd53b7a91b38\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " Sep 15 21:56:15.802983 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.802682 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "16094ec4-2589-412c-80bc-dd53b7a91b38" (UID: "16094ec4-2589-412c-80bc-dd53b7a91b38"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:56:15.802983 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.802755 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "16094ec4-2589-412c-80bc-dd53b7a91b38" (UID: "16094ec4-2589-412c-80bc-dd53b7a91b38"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:56:15.802983 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.802836 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-istio-data" (OuterVolumeSpecName: "istio-data") pod "16094ec4-2589-412c-80bc-dd53b7a91b38" (UID: "16094ec4-2589-412c-80bc-dd53b7a91b38"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:56:15.802983 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.802890 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "16094ec4-2589-412c-80bc-dd53b7a91b38" (UID: "16094ec4-2589-412c-80bc-dd53b7a91b38"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:56:15.803164 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.802979 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16094ec4-2589-412c-80bc-dd53b7a91b38-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "16094ec4-2589-412c-80bc-dd53b7a91b38" (UID: "16094ec4-2589-412c-80bc-dd53b7a91b38"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 21:56:15.803164 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.803021 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16094ec4-2589-412c-80bc-dd53b7a91b38-istio-token\") pod \"16094ec4-2589-412c-80bc-dd53b7a91b38\" (UID: \"16094ec4-2589-412c-80bc-dd53b7a91b38\") " Sep 15 21:56:15.803390 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.803372 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-workload-certs\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:56:15.803441 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.803397 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-credential-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:56:15.803441 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.803413 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-istio-data\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:56:15.803441 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.803428 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-workload-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:56:15.803552 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.803442 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16094ec4-2589-412c-80bc-dd53b7a91b38-istiod-ca-cert\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:56:15.804663 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.804632 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16094ec4-2589-412c-80bc-dd53b7a91b38-kube-api-access-hzr28" (OuterVolumeSpecName: "kube-api-access-hzr28") pod "16094ec4-2589-412c-80bc-dd53b7a91b38" (UID: "16094ec4-2589-412c-80bc-dd53b7a91b38"). InnerVolumeSpecName "kube-api-access-hzr28". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:56:15.804768 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.804730 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "16094ec4-2589-412c-80bc-dd53b7a91b38" (UID: "16094ec4-2589-412c-80bc-dd53b7a91b38"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 21:56:15.805132 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.805111 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/16094ec4-2589-412c-80bc-dd53b7a91b38-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "16094ec4-2589-412c-80bc-dd53b7a91b38" (UID: "16094ec4-2589-412c-80bc-dd53b7a91b38"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 15 21:56:15.805185 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.805151 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16094ec4-2589-412c-80bc-dd53b7a91b38-istio-token" (OuterVolumeSpecName: "istio-token") pod "16094ec4-2589-412c-80bc-dd53b7a91b38" (UID: "16094ec4-2589-412c-80bc-dd53b7a91b38"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 21:56:15.904245 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.904202 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16094ec4-2589-412c-80bc-dd53b7a91b38-istio-envoy\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:56:15.904245 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.904237 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16094ec4-2589-412c-80bc-dd53b7a91b38-istio-token\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:56:15.904245 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.904253 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzr28\" (UniqueName: \"kubernetes.io/projected/16094ec4-2589-412c-80bc-dd53b7a91b38-kube-api-access-hzr28\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:56:15.904489 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:15.904266 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16094ec4-2589-412c-80bc-dd53b7a91b38-istio-podinfo\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 21:56:16.617392 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:16.617361 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" event={"ID":"16094ec4-2589-412c-80bc-dd53b7a91b38","Type":"ContainerDied","Data":"e00e25ef6f09a66239bc7801cdfa19ed2dada22a0ad06565090b5c7a581d0489"} Sep 15 21:56:16.617812 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:16.617420 2573 scope.go:117] "RemoveContainer" containerID="fcbdd3f0abb2e6c3ea6314a7c097a96621f2a9ba1e0211a6a557bc2510f51414" Sep 15 21:56:16.617812 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:16.617368 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt" Sep 15 21:56:16.650783 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:16.650758 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt"] Sep 15 21:56:16.663729 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:16.663706 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt"] Sep 15 21:56:17.937214 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:17.937180 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16094ec4-2589-412c-80bc-dd53b7a91b38" path="/var/lib/kubelet/pods/16094ec4-2589-412c-80bc-dd53b7a91b38/volumes" Sep 15 21:56:30.100705 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:30.100658 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:56:32.176779 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:32.176741 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:56:36.127705 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:36.127667 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:56:41.631757 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:41.631713 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:56:41.732802 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:41.732764 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:56:46.238896 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:46.238860 2573 scope.go:117] "RemoveContainer" containerID="fcf7ae6b3297cad1f1e91f79c2f6f6bd8f90f255d6665ce78e3be08f60882d16" Sep 15 21:56:47.504502 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:47.504462 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:56:49.855995 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:49.855954 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:56:54.880511 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:56:54.880449 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:57:25.847148 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:57:25.847114 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:57:37.549649 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:57:37.549605 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:57:38.555562 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:57:38.555522 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:57:48.368031 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:57:48.367996 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:57:50.853098 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:57:50.853063 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:57:59.300042 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:57:59.300004 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:58:03.484543 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:58:03.484479 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:58:03.554265 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:58:03.554228 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:58:07.966482 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:58:07.966443 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:58:25.434364 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:58:25.434319 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:58:52.265113 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:58:52.265023 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:58:53.161172 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:58:53.161134 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:58:53.591063 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:58:53.591034 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:58:53.928670 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:58:53.928579 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:58:54.033607 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:58:54.033571 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:58:56.105337 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:58:56.105297 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:58:56.841913 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:58:56.841869 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:58:57.015409 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:58:57.015370 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:58:57.145128 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:58:57.145029 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:58:57.528145 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:58:57.528112 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:58:58.543359 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:58:58.543319 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:58:59.547555 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:58:59.547519 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:58:59.633700 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:58:59.633646 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:58:59.877617 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:58:59.877537 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:00.198977 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:00.198868 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:00.303968 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:00.303911 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:03.679401 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:03.679346 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:22.004830 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:22.004785 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:23.412318 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:23.412173 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:24.202521 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:24.202482 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:25.182340 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:25.182298 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:25.997260 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:25.997220 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:26.896129 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:26.896080 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:27.587568 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:27.587531 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:28.117914 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:28.117874 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:28.443578 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:28.443480 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:30.530199 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:30.530168 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:31.152335 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:31.152299 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:31.348465 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:31.348428 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:31.794694 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:31.794653 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:32.706215 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:32.706176 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:33.660889 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:33.660835 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:34.709077 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:34.709045 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:34.947159 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:34.947124 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:35.108651 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:35.108616 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:35.484248 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:35.484212 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:35.585172 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:35.585138 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:49.311302 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:49.311268 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:57.425517 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:57.425481 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:58.371372 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:58.371335 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 21:59:59.495293 ip-10-0-133-42 kubenswrapper[2573]: I0915 21:59:59.495242 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:00:00.182723 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.182676 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-0886df-29825160-xf4h9"] Sep 15 22:00:00.183327 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183300 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16094ec4-2589-412c-80bc-dd53b7a91b38" containerName="istio-proxy" Sep 15 22:00:00.183457 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183342 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="16094ec4-2589-412c-80bc-dd53b7a91b38" containerName="istio-proxy" Sep 15 22:00:00.183457 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183360 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="535b620a-0c5a-41db-b8ab-d70541fa25c5" containerName="payload-processing" Sep 15 22:00:00.183457 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183369 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="535b620a-0c5a-41db-b8ab-d70541fa25c5" containerName="payload-processing" Sep 15 22:00:00.183457 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183386 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a7ae857-7728-4934-b57c-8c57c687ba17" containerName="payload-processing" Sep 15 22:00:00.183457 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183394 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a7ae857-7728-4934-b57c-8c57c687ba17" containerName="payload-processing" Sep 15 22:00:00.183457 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183411 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" containerName="istio-proxy" Sep 15 22:00:00.183457 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183420 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" containerName="istio-proxy" Sep 15 22:00:00.183457 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183429 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" containerName="istio-proxy" Sep 15 22:00:00.183457 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183438 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" containerName="istio-proxy" Sep 15 22:00:00.183457 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183448 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15fb724f-e820-4216-a29a-d67dc264a2ed" containerName="istio-proxy" Sep 15 22:00:00.183457 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183456 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="15fb724f-e820-4216-a29a-d67dc264a2ed" containerName="istio-proxy" Sep 15 22:00:00.184033 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183474 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" containerName="istio-proxy" Sep 15 22:00:00.184033 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183482 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" containerName="istio-proxy" Sep 15 22:00:00.184033 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183493 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15fb724f-e820-4216-a29a-d67dc264a2ed" containerName="istio-proxy" Sep 15 22:00:00.184033 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183501 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="15fb724f-e820-4216-a29a-d67dc264a2ed" containerName="istio-proxy" Sep 15 22:00:00.184033 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183513 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cc0af5c-1fca-4b59-90ac-c82f07087d2f" containerName="payload-pre-processing" Sep 15 22:00:00.184033 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183521 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc0af5c-1fca-4b59-90ac-c82f07087d2f" containerName="payload-pre-processing" Sep 15 22:00:00.184033 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183538 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47ace233-bc09-435d-b03f-dd19ed22d010" containerName="payload-pre-processing" Sep 15 22:00:00.184033 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183546 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="47ace233-bc09-435d-b03f-dd19ed22d010" containerName="payload-pre-processing" Sep 15 22:00:00.184033 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183565 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" containerName="istio-proxy" Sep 15 22:00:00.184033 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183573 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" containerName="istio-proxy" Sep 15 22:00:00.184033 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183680 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="16094ec4-2589-412c-80bc-dd53b7a91b38" containerName="istio-proxy" Sep 15 22:00:00.184033 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183691 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="16094ec4-2589-412c-80bc-dd53b7a91b38" containerName="istio-proxy" Sep 15 22:00:00.184033 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183703 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" containerName="istio-proxy" Sep 15 22:00:00.184033 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183713 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" containerName="istio-proxy" Sep 15 22:00:00.184033 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183721 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="15fb724f-e820-4216-a29a-d67dc264a2ed" containerName="istio-proxy" Sep 15 22:00:00.184033 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183733 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="15fb724f-e820-4216-a29a-d67dc264a2ed" containerName="istio-proxy" Sep 15 22:00:00.184033 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183744 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="47ace233-bc09-435d-b03f-dd19ed22d010" containerName="payload-pre-processing" Sep 15 22:00:00.184033 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183751 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a7ae857-7728-4934-b57c-8c57c687ba17" containerName="payload-processing" Sep 15 22:00:00.184033 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183760 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cc0af5c-1fca-4b59-90ac-c82f07087d2f" containerName="payload-pre-processing" Sep 15 22:00:00.184033 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.183768 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="535b620a-0c5a-41db-b8ab-d70541fa25c5" containerName="payload-processing" Sep 15 22:00:00.187396 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.187375 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29825160-7fm7c"] Sep 15 22:00:00.187526 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.187509 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-0886df-29825160-xf4h9" Sep 15 22:00:00.187721 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.187699 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16094ec4-2589-412c-80bc-dd53b7a91b38" containerName="istio-proxy" Sep 15 22:00:00.187721 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.187715 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="16094ec4-2589-412c-80bc-dd53b7a91b38" containerName="istio-proxy" Sep 15 22:00:00.187935 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.187808 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd5ec189-e2d2-47c0-8f15-f9ec1c97e056" containerName="istio-proxy" Sep 15 22:00:00.187935 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.187824 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e47794f-6b6e-4cb0-a9aa-8b37be75ff98" containerName="istio-proxy" Sep 15 22:00:00.190803 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.190777 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825160-7fm7c" Sep 15 22:00:00.192245 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.192225 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p7cdh\"" Sep 15 22:00:00.198374 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.198357 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-0886df-29825160-xf4h9" Sep 15 22:00:00.207756 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.207732 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825160-7fm7c" Sep 15 22:00:00.208159 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.208141 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29825160-7fm7c"] Sep 15 22:00:00.211394 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.211374 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-0886df-29825160-xf4h9"] Sep 15 22:00:00.491589 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.491527 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-0886df-29825160-xf4h9"] Sep 15 22:00:00.494649 ip-10-0-133-42 kubenswrapper[2573]: W0915 22:00:00.494606 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34c170c7_086f_412d_bcd6_bab9f2e32d53.slice/crio-7e1661be5020247dfe0c71e6dad004f278743d6842630a9f849f0058d9c19a8a WatchSource:0}: Error finding container 7e1661be5020247dfe0c71e6dad004f278743d6842630a9f849f0058d9c19a8a: Status 404 returned error can't find the container with id 7e1661be5020247dfe0c71e6dad004f278743d6842630a9f849f0058d9c19a8a Sep 15 22:00:00.510657 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.510630 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29825160-7fm7c"] Sep 15 22:00:00.513291 ip-10-0-133-42 kubenswrapper[2573]: W0915 22:00:00.513250 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod363c5865_6272_4e27_89bd_3a9a866a2963.slice/crio-d6b949a34345e114ddccf1c1f498f8eb7ce29de1be460440d12d5974dd6f6fdf WatchSource:0}: Error finding container d6b949a34345e114ddccf1c1f498f8eb7ce29de1be460440d12d5974dd6f6fdf: Status 404 returned error can't find the container with id d6b949a34345e114ddccf1c1f498f8eb7ce29de1be460440d12d5974dd6f6fdf Sep 15 22:00:00.576038 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.576009 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:00:00.876539 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.876502 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-0886df-29825160-xf4h9" event={"ID":"34c170c7-086f-412d-bcd6-bab9f2e32d53","Type":"ContainerStarted","Data":"176a6243b9cefce35ca31e665fcbe2220e234d35e037c6bb7be9e5bc75e86a62"} Sep 15 22:00:00.876756 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.876558 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-0886df-29825160-xf4h9" event={"ID":"34c170c7-086f-412d-bcd6-bab9f2e32d53","Type":"ContainerStarted","Data":"7e1661be5020247dfe0c71e6dad004f278743d6842630a9f849f0058d9c19a8a"} Sep 15 22:00:00.878008 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.877979 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825160-7fm7c" event={"ID":"363c5865-6272-4e27-89bd-3a9a866a2963","Type":"ContainerStarted","Data":"523fbee55dd960ca72f16a514791804b093c16bc36590ea07f30f64fc6859cac"} Sep 15 22:00:00.878126 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.878021 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825160-7fm7c" event={"ID":"363c5865-6272-4e27-89bd-3a9a866a2963","Type":"ContainerStarted","Data":"d6b949a34345e114ddccf1c1f498f8eb7ce29de1be460440d12d5974dd6f6fdf"} Sep 15 22:00:00.906602 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.906544 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-0886df-29825160-xf4h9" podStartSLOduration=0.906523176 podStartE2EDuration="906.523176ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 22:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 22:00:00.903970154 +0000 UTC m=+2055.490567746" watchObservedRunningTime="2026-09-15 22:00:00.906523176 +0000 UTC m=+2055.493120769" Sep 15 22:00:00.924364 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:00.924310 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825160-7fm7c" podStartSLOduration=0.924294502 podStartE2EDuration="924.294502ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 22:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 22:00:00.923087476 +0000 UTC m=+2055.509685071" watchObservedRunningTime="2026-09-15 22:00:00.924294502 +0000 UTC m=+2055.510892094" Sep 15 22:00:01.365594 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:01.365555 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:00:01.886446 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:01.886411 2573 generic.go:356] "Generic (PLEG): container finished" podID="34c170c7-086f-412d-bcd6-bab9f2e32d53" containerID="176a6243b9cefce35ca31e665fcbe2220e234d35e037c6bb7be9e5bc75e86a62" exitCode=0 Sep 15 22:00:01.886923 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:01.886501 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-0886df-29825160-xf4h9" event={"ID":"34c170c7-086f-412d-bcd6-bab9f2e32d53","Type":"ContainerDied","Data":"176a6243b9cefce35ca31e665fcbe2220e234d35e037c6bb7be9e5bc75e86a62"} Sep 15 22:00:01.887999 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:01.887977 2573 generic.go:356] "Generic (PLEG): container finished" podID="363c5865-6272-4e27-89bd-3a9a866a2963" containerID="523fbee55dd960ca72f16a514791804b093c16bc36590ea07f30f64fc6859cac" exitCode=0 Sep 15 22:00:01.888113 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:01.888059 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825160-7fm7c" event={"ID":"363c5865-6272-4e27-89bd-3a9a866a2963","Type":"ContainerDied","Data":"523fbee55dd960ca72f16a514791804b093c16bc36590ea07f30f64fc6859cac"} Sep 15 22:00:02.036895 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:02.036829 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:00:03.037238 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:03.037213 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825160-7fm7c" Sep 15 22:00:03.055429 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:03.055403 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-0886df-29825160-xf4h9" Sep 15 22:00:03.901538 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:03.901505 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825160-7fm7c" Sep 15 22:00:03.901737 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:03.901545 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825160-7fm7c" event={"ID":"363c5865-6272-4e27-89bd-3a9a866a2963","Type":"ContainerDied","Data":"d6b949a34345e114ddccf1c1f498f8eb7ce29de1be460440d12d5974dd6f6fdf"} Sep 15 22:00:03.901737 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:03.901600 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6b949a34345e114ddccf1c1f498f8eb7ce29de1be460440d12d5974dd6f6fdf" Sep 15 22:00:03.903004 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:03.902988 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-0886df-29825160-xf4h9" Sep 15 22:00:03.903121 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:03.902984 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-0886df-29825160-xf4h9" event={"ID":"34c170c7-086f-412d-bcd6-bab9f2e32d53","Type":"ContainerDied","Data":"7e1661be5020247dfe0c71e6dad004f278743d6842630a9f849f0058d9c19a8a"} Sep 15 22:00:03.903121 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:03.903111 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e1661be5020247dfe0c71e6dad004f278743d6842630a9f849f0058d9c19a8a" Sep 15 22:00:06.270464 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:06.270433 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-7q576_4b1b10bf-d7ac-4e51-82ad-9c247a8b4365/payload-processing/0.log" Sep 15 22:00:11.013806 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:11.013716 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:00:37.459552 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:37.459509 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-7q576_4b1b10bf-d7ac-4e51-82ad-9c247a8b4365/payload-processing/0.log" Sep 15 22:00:38.085400 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.085363 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:00:38.371761 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.371690 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97"] Sep 15 22:00:38.372155 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.372142 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34c170c7-086f-412d-bcd6-bab9f2e32d53" containerName="cleanup" Sep 15 22:00:38.372202 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.372157 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="34c170c7-086f-412d-bcd6-bab9f2e32d53" containerName="cleanup" Sep 15 22:00:38.372202 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.372167 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="363c5865-6272-4e27-89bd-3a9a866a2963" containerName="cleanup" Sep 15 22:00:38.372202 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.372173 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="363c5865-6272-4e27-89bd-3a9a866a2963" containerName="cleanup" Sep 15 22:00:38.372306 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.372234 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="363c5865-6272-4e27-89bd-3a9a866a2963" containerName="cleanup" Sep 15 22:00:38.372306 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.372245 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="34c170c7-086f-412d-bcd6-bab9f2e32d53" containerName="cleanup" Sep 15 22:00:38.375534 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.375508 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.378486 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.378468 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-3596d6-openshift-default-dockercfg-vlgbv\"" Sep 15 22:00:38.411734 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.411697 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:00:38.445965 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.445928 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istio-podinfo\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.446275 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.446251 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istio-envoy\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.446468 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.446449 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istio-data\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.446644 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.446625 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istio-token\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.446812 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.446792 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-workload-certs\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.447004 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.446985 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-workload-socket\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.447090 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.447056 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.447154 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.447087 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkb68\" (UniqueName: \"kubernetes.io/projected/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-kube-api-access-dkb68\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.447154 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.447142 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-credential-socket\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.456419 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.456389 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97"] Sep 15 22:00:38.548239 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.548206 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istio-podinfo\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.548239 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.548242 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istio-envoy\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.548816 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.548270 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istio-data\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.548816 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.548310 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istio-token\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.548816 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.548333 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-workload-certs\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.548816 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.548377 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-workload-socket\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.548816 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.548403 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.548816 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.548429 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkb68\" (UniqueName: \"kubernetes.io/projected/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-kube-api-access-dkb68\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.548816 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.548480 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-credential-socket\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.549256 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.548895 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-workload-socket\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.549256 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.548969 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istio-data\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.549256 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.549002 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-workload-certs\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.549256 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.549202 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-credential-socket\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.549256 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.549230 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.550639 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.550618 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istio-envoy\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.550951 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.550935 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istio-podinfo\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.564812 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.564779 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istio-token\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.573533 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.573509 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkb68\" (UniqueName: \"kubernetes.io/projected/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-kube-api-access-dkb68\") pod \"e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.686677 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.686576 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:38.872592 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.872551 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:00:38.965531 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.965503 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97"] Sep 15 22:00:38.967063 ip-10-0-133-42 kubenswrapper[2573]: W0915 22:00:38.967036 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb20519cb_5eaf_42c3_8ef8_e3131b665c0b.slice/crio-9177f17202b013d0078055e777746a5e481d11bef7f83a68a671a5ef7ad80d52 WatchSource:0}: Error finding container 9177f17202b013d0078055e777746a5e481d11bef7f83a68a671a5ef7ad80d52: Status 404 returned error can't find the container with id 9177f17202b013d0078055e777746a5e481d11bef7f83a68a671a5ef7ad80d52 Sep 15 22:00:38.969230 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.969193 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 22:00:38.969307 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.969263 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 22:00:38.969307 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:38.969292 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 22:00:39.107688 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:39.107648 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" event={"ID":"b20519cb-5eaf-42c3-8ef8-e3131b665c0b","Type":"ContainerStarted","Data":"713488dc646ace1dc77a2fcc6e2eab657d9464bb425da1a1f78c168b72fe8416"} Sep 15 22:00:39.107912 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:39.107715 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" event={"ID":"b20519cb-5eaf-42c3-8ef8-e3131b665c0b","Type":"ContainerStarted","Data":"9177f17202b013d0078055e777746a5e481d11bef7f83a68a671a5ef7ad80d52"} Sep 15 22:00:39.133179 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:39.133120 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" podStartSLOduration=1.133102275 podStartE2EDuration="1.133102275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 22:00:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 22:00:39.130230261 +0000 UTC m=+2093.716827853" watchObservedRunningTime="2026-09-15 22:00:39.133102275 +0000 UTC m=+2093.719699866" Sep 15 22:00:39.686998 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:39.686962 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:40.503112 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:40.503080 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:00:40.692424 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:40.692394 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:41.120333 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:41.120289 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:41.121322 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:41.121299 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:00:41.170609 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:41.170569 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:00:41.331551 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:41.331511 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:00:41.780735 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:41.780702 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:00:43.429866 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:43.429820 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:00:44.534039 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:44.534002 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:00:45.735661 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:45.735624 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:00:46.074786 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:46.074708 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/1.log" Sep 15 22:00:46.078459 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:46.078435 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/1.log" Sep 15 22:00:46.509390 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:46.509339 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:00:46.612345 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:46.612313 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:00:46.990486 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:46.990448 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:00:47.089379 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:47.089335 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:00:47.186857 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:47.186808 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt"] Sep 15 22:00:47.190741 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:47.190719 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt" Sep 15 22:00:47.193450 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:47.193429 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-3596d6\"" Sep 15 22:00:47.193579 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:47.193551 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-3596d6-dockercfg-xswsx\"" Sep 15 22:00:47.202371 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:47.202343 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt"] Sep 15 22:00:47.337892 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:47.337777 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b9bd1cd-f124-40f7-bd85-5edd7c97728d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt\" (UID: \"1b9bd1cd-f124-40f7-bd85-5edd7c97728d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt" Sep 15 22:00:47.337892 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:47.337871 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt8cc\" (UniqueName: \"kubernetes.io/projected/1b9bd1cd-f124-40f7-bd85-5edd7c97728d-kube-api-access-qt8cc\") pod \"payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt\" (UID: \"1b9bd1cd-f124-40f7-bd85-5edd7c97728d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt" Sep 15 22:00:47.439190 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:47.439149 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b9bd1cd-f124-40f7-bd85-5edd7c97728d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt\" (UID: \"1b9bd1cd-f124-40f7-bd85-5edd7c97728d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt" Sep 15 22:00:47.439394 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:47.439210 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt8cc\" (UniqueName: \"kubernetes.io/projected/1b9bd1cd-f124-40f7-bd85-5edd7c97728d-kube-api-access-qt8cc\") pod \"payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt\" (UID: \"1b9bd1cd-f124-40f7-bd85-5edd7c97728d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt" Sep 15 22:00:47.439960 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:47.439935 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b9bd1cd-f124-40f7-bd85-5edd7c97728d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt\" (UID: \"1b9bd1cd-f124-40f7-bd85-5edd7c97728d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt" Sep 15 22:00:47.448573 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:47.448547 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt8cc\" (UniqueName: \"kubernetes.io/projected/1b9bd1cd-f124-40f7-bd85-5edd7c97728d-kube-api-access-qt8cc\") pod \"payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt\" (UID: \"1b9bd1cd-f124-40f7-bd85-5edd7c97728d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt" Sep 15 22:00:47.501399 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:47.501369 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt" Sep 15 22:00:47.775539 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:47.775504 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt"] Sep 15 22:00:47.775777 ip-10-0-133-42 kubenswrapper[2573]: W0915 22:00:47.775752 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b9bd1cd_f124_40f7_bd85_5edd7c97728d.slice/crio-b7e81ca93d26e1de33848dc584894ce210b7129472e9f4901d1e538cfbcb85f5 WatchSource:0}: Error finding container b7e81ca93d26e1de33848dc584894ce210b7129472e9f4901d1e538cfbcb85f5: Status 404 returned error can't find the container with id b7e81ca93d26e1de33848dc584894ce210b7129472e9f4901d1e538cfbcb85f5 Sep 15 22:00:47.819294 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:47.819262 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:00:48.164497 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:48.164412 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt" event={"ID":"1b9bd1cd-f124-40f7-bd85-5edd7c97728d","Type":"ContainerStarted","Data":"af15670476e94071ca7258b26b916b793f0bb8da15fdc56184999a0900bb43a6"} Sep 15 22:00:48.164497 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:48.164473 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt" event={"ID":"1b9bd1cd-f124-40f7-bd85-5edd7c97728d","Type":"ContainerStarted","Data":"b7e81ca93d26e1de33848dc584894ce210b7129472e9f4901d1e538cfbcb85f5"} Sep 15 22:00:48.164497 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:48.164498 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt" Sep 15 22:00:48.190455 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:48.190403 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt" podStartSLOduration=1.190382448 podStartE2EDuration="1.190382448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 22:00:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 22:00:48.188331217 +0000 UTC m=+2102.774928808" watchObservedRunningTime="2026-09-15 22:00:48.190382448 +0000 UTC m=+2102.776980043" Sep 15 22:00:59.174890 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:00:59.174832 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt" Sep 15 22:01:02.272328 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:02.272291 2573 generic.go:356] "Generic (PLEG): container finished" podID="b20519cb-5eaf-42c3-8ef8-e3131b665c0b" containerID="713488dc646ace1dc77a2fcc6e2eab657d9464bb425da1a1f78c168b72fe8416" exitCode=0 Sep 15 22:01:02.272733 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:02.272362 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" event={"ID":"b20519cb-5eaf-42c3-8ef8-e3131b665c0b","Type":"ContainerDied","Data":"713488dc646ace1dc77a2fcc6e2eab657d9464bb425da1a1f78c168b72fe8416"} Sep 15 22:01:02.272787 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:02.272773 2573 scope.go:117] "RemoveContainer" containerID="713488dc646ace1dc77a2fcc6e2eab657d9464bb425da1a1f78c168b72fe8416" Sep 15 22:01:02.273896 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:02.273834 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 22:01:02.274073 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:02.273945 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 22:01:02.274073 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:02.273995 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 22:01:03.286324 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:03.286277 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" event={"ID":"b20519cb-5eaf-42c3-8ef8-e3131b665c0b","Type":"ContainerStarted","Data":"784879de4bbf6643692587e4178082112d9b892b227df98cca895782f4460f9b"} Sep 15 22:01:03.688061 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:03.687959 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:01:03.688432 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:03.688339 2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Sep 15 22:01:03.688624 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:03.688600 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" podUID="b20519cb-5eaf-42c3-8ef8-e3131b665c0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Sep 15 22:01:04.687539 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:04.687497 2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Sep 15 22:01:04.688393 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:04.688356 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" podUID="b20519cb-5eaf-42c3-8ef8-e3131b665c0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Sep 15 22:01:05.687222 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:05.687183 2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Sep 15 22:01:05.687512 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:05.687483 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" podUID="b20519cb-5eaf-42c3-8ef8-e3131b665c0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Sep 15 22:01:06.687827 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:06.687780 2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Sep 15 22:01:06.688348 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:06.687870 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" podUID="b20519cb-5eaf-42c3-8ef8-e3131b665c0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Sep 15 22:01:07.687437 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:07.687396 2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Sep 15 22:01:07.687774 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:07.687740 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" podUID="b20519cb-5eaf-42c3-8ef8-e3131b665c0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Sep 15 22:01:08.692204 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:08.692167 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:01:08.692665 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:08.692624 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:01:08.693266 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:08.693248 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:01:09.838901 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:09.838863 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:10.787817 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:10.787773 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:11.291629 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:11.291585 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:11.739711 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:11.739677 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:11.847523 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:11.847484 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:12.871701 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:12.871670 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:13.893839 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:13.893804 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:14.806474 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:14.806433 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:15.976540 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:15.976505 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:17.117447 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:17.117412 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:18.304478 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:18.304438 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:23.276110 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:23.276055 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:24.041764 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:24.041717 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:24.124115 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:24.124081 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt"] Sep 15 22:01:24.124396 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:24.124365 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt" podUID="1b9bd1cd-f124-40f7-bd85-5edd7c97728d" containerName="payload-pre-processing" containerID="cri-o://af15670476e94071ca7258b26b916b793f0bb8da15fdc56184999a0900bb43a6" gracePeriod=30 Sep 15 22:01:24.180564 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:24.180482 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:24.302360 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:24.302304 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:24.387567 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:24.387538 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt" Sep 15 22:01:24.409580 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:24.409550 2573 generic.go:356] "Generic (PLEG): container finished" podID="1b9bd1cd-f124-40f7-bd85-5edd7c97728d" containerID="af15670476e94071ca7258b26b916b793f0bb8da15fdc56184999a0900bb43a6" exitCode=0 Sep 15 22:01:24.409771 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:24.409600 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt" Sep 15 22:01:24.409771 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:24.409628 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt" event={"ID":"1b9bd1cd-f124-40f7-bd85-5edd7c97728d","Type":"ContainerDied","Data":"af15670476e94071ca7258b26b916b793f0bb8da15fdc56184999a0900bb43a6"} Sep 15 22:01:24.409771 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:24.409697 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt" event={"ID":"1b9bd1cd-f124-40f7-bd85-5edd7c97728d","Type":"ContainerDied","Data":"b7e81ca93d26e1de33848dc584894ce210b7129472e9f4901d1e538cfbcb85f5"} Sep 15 22:01:24.409771 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:24.409727 2573 scope.go:117] "RemoveContainer" containerID="af15670476e94071ca7258b26b916b793f0bb8da15fdc56184999a0900bb43a6" Sep 15 22:01:24.421414 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:24.421362 2573 scope.go:117] "RemoveContainer" containerID="af15670476e94071ca7258b26b916b793f0bb8da15fdc56184999a0900bb43a6" Sep 15 22:01:24.421779 ip-10-0-133-42 kubenswrapper[2573]: E0915 22:01:24.421749 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af15670476e94071ca7258b26b916b793f0bb8da15fdc56184999a0900bb43a6\": container with ID starting with af15670476e94071ca7258b26b916b793f0bb8da15fdc56184999a0900bb43a6 not found: ID does not exist" containerID="af15670476e94071ca7258b26b916b793f0bb8da15fdc56184999a0900bb43a6" Sep 15 22:01:24.421908 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:24.421791 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af15670476e94071ca7258b26b916b793f0bb8da15fdc56184999a0900bb43a6"} err="failed to get container status \"af15670476e94071ca7258b26b916b793f0bb8da15fdc56184999a0900bb43a6\": rpc error: code = NotFound desc = could not find container \"af15670476e94071ca7258b26b916b793f0bb8da15fdc56184999a0900bb43a6\": container with ID starting with af15670476e94071ca7258b26b916b793f0bb8da15fdc56184999a0900bb43a6 not found: ID does not exist" Sep 15 22:01:24.490896 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:24.490828 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:24.502964 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:24.502925 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qt8cc\" (UniqueName: \"kubernetes.io/projected/1b9bd1cd-f124-40f7-bd85-5edd7c97728d-kube-api-access-qt8cc\") pod \"1b9bd1cd-f124-40f7-bd85-5edd7c97728d\" (UID: \"1b9bd1cd-f124-40f7-bd85-5edd7c97728d\") " Sep 15 22:01:24.503271 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:24.503253 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b9bd1cd-f124-40f7-bd85-5edd7c97728d-plugins-config-volume\") pod \"1b9bd1cd-f124-40f7-bd85-5edd7c97728d\" (UID: \"1b9bd1cd-f124-40f7-bd85-5edd7c97728d\") " Sep 15 22:01:24.504084 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:24.504057 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b9bd1cd-f124-40f7-bd85-5edd7c97728d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1b9bd1cd-f124-40f7-bd85-5edd7c97728d" (UID: "1b9bd1cd-f124-40f7-bd85-5edd7c97728d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 22:01:24.516549 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:24.516430 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b9bd1cd-f124-40f7-bd85-5edd7c97728d-kube-api-access-qt8cc" (OuterVolumeSpecName: "kube-api-access-qt8cc") pod "1b9bd1cd-f124-40f7-bd85-5edd7c97728d" (UID: "1b9bd1cd-f124-40f7-bd85-5edd7c97728d"). InnerVolumeSpecName "kube-api-access-qt8cc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 22:01:24.604327 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:24.604239 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qt8cc\" (UniqueName: \"kubernetes.io/projected/1b9bd1cd-f124-40f7-bd85-5edd7c97728d-kube-api-access-qt8cc\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:01:24.604327 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:24.604268 2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b9bd1cd-f124-40f7-bd85-5edd7c97728d-plugins-config-volume\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:01:24.747632 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:24.747600 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt"] Sep 15 22:01:24.757474 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:24.757443 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt"] Sep 15 22:01:24.894907 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:24.894800 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:25.074515 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:25.074468 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:25.934469 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:25.934436 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b9bd1cd-f124-40f7-bd85-5edd7c97728d" path="/var/lib/kubelet/pods/1b9bd1cd-f124-40f7-bd85-5edd7c97728d/volumes" Sep 15 22:01:26.236826 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:26.236794 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:27.609824 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:27.609783 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:28.968258 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:28.968222 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:30.112953 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:30.112915 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:33.249403 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:33.249366 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:33.538891 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:33.538775 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97"] Sep 15 22:01:33.539121 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:33.539075 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" podUID="b20519cb-5eaf-42c3-8ef8-e3131b665c0b" containerName="istio-proxy" containerID="cri-o://784879de4bbf6643692587e4178082112d9b892b227df98cca895782f4460f9b" gracePeriod=30 Sep 15 22:01:36.664232 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:36.664192 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:37.856330 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:37.856299 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:38.694109 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.694069 2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Sep 15 22:01:38.694281 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.694140 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" podUID="b20519cb-5eaf-42c3-8ef8-e3131b665c0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Sep 15 22:01:38.792878 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.792802 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:38.814921 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.814840 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:01:38.833483 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.833457 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istio-token\") pod \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " Sep 15 22:01:38.833618 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.833509 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-workload-socket\") pod \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " Sep 15 22:01:38.833697 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.833658 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istio-envoy\") pod \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " Sep 15 22:01:38.833754 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.833704 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istiod-ca-cert\") pod \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " Sep 15 22:01:38.833754 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.833733 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkb68\" (UniqueName: \"kubernetes.io/projected/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-kube-api-access-dkb68\") pod \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " Sep 15 22:01:38.833880 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.833764 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b20519cb-5eaf-42c3-8ef8-e3131b665c0b" (UID: "b20519cb-5eaf-42c3-8ef8-e3131b665c0b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 22:01:38.833880 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.833778 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-credential-socket\") pod \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " Sep 15 22:01:38.833880 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.833828 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istio-data\") pod \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " Sep 15 22:01:38.833880 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.833867 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-workload-certs\") pod \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " Sep 15 22:01:38.834097 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.833937 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istio-podinfo\") pod \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\" (UID: \"b20519cb-5eaf-42c3-8ef8-e3131b665c0b\") " Sep 15 22:01:38.834342 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.834312 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istio-data" (OuterVolumeSpecName: "istio-data") pod "b20519cb-5eaf-42c3-8ef8-e3131b665c0b" (UID: "b20519cb-5eaf-42c3-8ef8-e3131b665c0b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 22:01:38.834437 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.834361 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b20519cb-5eaf-42c3-8ef8-e3131b665c0b" (UID: "b20519cb-5eaf-42c3-8ef8-e3131b665c0b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 22:01:38.834503 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.834484 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b20519cb-5eaf-42c3-8ef8-e3131b665c0b" (UID: "b20519cb-5eaf-42c3-8ef8-e3131b665c0b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 22:01:38.834564 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.834541 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b20519cb-5eaf-42c3-8ef8-e3131b665c0b" (UID: "b20519cb-5eaf-42c3-8ef8-e3131b665c0b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 22:01:38.834823 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.834796 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-workload-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:01:38.834950 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.834826 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istiod-ca-cert\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:01:38.834950 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.834841 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-credential-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:01:38.834950 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.834881 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istio-data\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:01:38.834950 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.834894 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-workload-certs\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:01:38.835920 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.835891 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istio-token" (OuterVolumeSpecName: "istio-token") pod "b20519cb-5eaf-42c3-8ef8-e3131b665c0b" (UID: "b20519cb-5eaf-42c3-8ef8-e3131b665c0b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 22:01:38.836261 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.836230 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b20519cb-5eaf-42c3-8ef8-e3131b665c0b" (UID: "b20519cb-5eaf-42c3-8ef8-e3131b665c0b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 22:01:38.836261 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.836234 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-kube-api-access-dkb68" (OuterVolumeSpecName: "kube-api-access-dkb68") pod "b20519cb-5eaf-42c3-8ef8-e3131b665c0b" (UID: "b20519cb-5eaf-42c3-8ef8-e3131b665c0b"). InnerVolumeSpecName "kube-api-access-dkb68". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 22:01:38.836374 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.836358 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b20519cb-5eaf-42c3-8ef8-e3131b665c0b" (UID: "b20519cb-5eaf-42c3-8ef8-e3131b665c0b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 15 22:01:38.935795 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.935763 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istio-envoy\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:01:38.935795 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.935794 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkb68\" (UniqueName: \"kubernetes.io/projected/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-kube-api-access-dkb68\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:01:38.936236 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.935809 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istio-podinfo\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:01:38.936236 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:38.935822 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b20519cb-5eaf-42c3-8ef8-e3131b665c0b-istio-token\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:01:39.496183 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:39.496152 2573 generic.go:356] "Generic (PLEG): container finished" podID="b20519cb-5eaf-42c3-8ef8-e3131b665c0b" containerID="784879de4bbf6643692587e4178082112d9b892b227df98cca895782f4460f9b" exitCode=0 Sep 15 22:01:39.496364 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:39.496212 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" Sep 15 22:01:39.496364 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:39.496239 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" event={"ID":"b20519cb-5eaf-42c3-8ef8-e3131b665c0b","Type":"ContainerDied","Data":"784879de4bbf6643692587e4178082112d9b892b227df98cca895782f4460f9b"} Sep 15 22:01:39.496364 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:39.496294 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97" event={"ID":"b20519cb-5eaf-42c3-8ef8-e3131b665c0b","Type":"ContainerDied","Data":"9177f17202b013d0078055e777746a5e481d11bef7f83a68a671a5ef7ad80d52"} Sep 15 22:01:39.496364 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:39.496316 2573 scope.go:117] "RemoveContainer" containerID="784879de4bbf6643692587e4178082112d9b892b227df98cca895782f4460f9b" Sep 15 22:01:39.506732 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:39.506713 2573 scope.go:117] "RemoveContainer" containerID="713488dc646ace1dc77a2fcc6e2eab657d9464bb425da1a1f78c168b72fe8416" Sep 15 22:01:39.515158 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:39.515137 2573 scope.go:117] "RemoveContainer" containerID="784879de4bbf6643692587e4178082112d9b892b227df98cca895782f4460f9b" Sep 15 22:01:39.515451 ip-10-0-133-42 kubenswrapper[2573]: E0915 22:01:39.515431 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"784879de4bbf6643692587e4178082112d9b892b227df98cca895782f4460f9b\": container with ID starting with 784879de4bbf6643692587e4178082112d9b892b227df98cca895782f4460f9b not found: ID does not exist" containerID="784879de4bbf6643692587e4178082112d9b892b227df98cca895782f4460f9b" Sep 15 22:01:39.515588 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:39.515463 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"784879de4bbf6643692587e4178082112d9b892b227df98cca895782f4460f9b"} err="failed to get container status \"784879de4bbf6643692587e4178082112d9b892b227df98cca895782f4460f9b\": rpc error: code = NotFound desc = could not find container \"784879de4bbf6643692587e4178082112d9b892b227df98cca895782f4460f9b\": container with ID starting with 784879de4bbf6643692587e4178082112d9b892b227df98cca895782f4460f9b not found: ID does not exist" Sep 15 22:01:39.515588 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:39.515487 2573 scope.go:117] "RemoveContainer" containerID="713488dc646ace1dc77a2fcc6e2eab657d9464bb425da1a1f78c168b72fe8416" Sep 15 22:01:39.515745 ip-10-0-133-42 kubenswrapper[2573]: E0915 22:01:39.515728 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"713488dc646ace1dc77a2fcc6e2eab657d9464bb425da1a1f78c168b72fe8416\": container with ID starting with 713488dc646ace1dc77a2fcc6e2eab657d9464bb425da1a1f78c168b72fe8416 not found: ID does not exist" containerID="713488dc646ace1dc77a2fcc6e2eab657d9464bb425da1a1f78c168b72fe8416" Sep 15 22:01:39.515785 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:39.515751 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"713488dc646ace1dc77a2fcc6e2eab657d9464bb425da1a1f78c168b72fe8416"} err="failed to get container status \"713488dc646ace1dc77a2fcc6e2eab657d9464bb425da1a1f78c168b72fe8416\": rpc error: code = NotFound desc = could not find container \"713488dc646ace1dc77a2fcc6e2eab657d9464bb425da1a1f78c168b72fe8416\": container with ID starting with 713488dc646ace1dc77a2fcc6e2eab657d9464bb425da1a1f78c168b72fe8416 not found: ID does not exist" Sep 15 22:01:39.544487 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:39.544454 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97"] Sep 15 22:01:39.550931 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:39.550902 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97"] Sep 15 22:01:39.835559 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:39.835472 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:39.936009 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:39.935976 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b20519cb-5eaf-42c3-8ef8-e3131b665c0b" path="/var/lib/kubelet/pods/b20519cb-5eaf-42c3-8ef8-e3131b665c0b/volumes" Sep 15 22:01:40.816742 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:40.816703 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:42.350280 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:42.350241 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:42.777982 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:42.777946 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:47.699714 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:47.699676 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:53.435151 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:53.435113 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-0886df-29825160-xf4h9"] Sep 15 22:01:53.438232 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:53.438188 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:53.439232 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:53.439212 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-0886df-29825160-xf4h9"] Sep 15 22:01:53.609522 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:53.609480 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:53.740448 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:53.740409 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:53.849573 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:53.849536 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:53.934687 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:53.934652 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34c170c7-086f-412d-bcd6-bab9f2e32d53" path="/var/lib/kubelet/pods/34c170c7-086f-412d-bcd6-bab9f2e32d53/volumes" Sep 15 22:01:54.215723 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:54.215689 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:54.374109 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:54.374072 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:55.266090 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:55.266056 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:56.404810 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:56.404774 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:57.294156 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:57.294118 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:01:59.765323 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:01:59.765286 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:02:08.628800 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:02:08.628767 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:02:08.756156 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:02:08.756126 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:02:35.913171 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:02:35.913118 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:02:36.647298 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:02:36.647263 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:02:42.710506 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:02:42.710469 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:02:57.347927 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:02:57.347882 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:02:57.419568 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:02:57.419529 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:02:57.662403 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:02:57.662306 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:02:58.427580 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:02:58.427541 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:02:59.488062 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:02:59.488014 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:00.272710 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:00.272663 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:01.011172 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:01.011131 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:01.875452 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:01.875415 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:08.565548 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:08.565455 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:08.644774 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:08.644736 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:08.719356 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:08.719317 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:08.833019 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:08.832935 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:08.927013 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:08.926978 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:09.209266 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:09.209182 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:09.303895 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:09.303858 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:10.114906 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:10.114871 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:11.234975 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:11.234934 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:15.478499 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:15.478463 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:15.548923 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:15.548884 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:16.559540 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:16.559502 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:17.141091 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:17.141051 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:18.054089 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:18.054053 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:18.936941 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:18.936899 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:23.113093 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:23.113057 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:23.214168 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:23.214133 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:26.473720 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.473681 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb"] Sep 15 22:03:26.474225 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.473968 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb" podUID="2466ff73-beaf-48b1-91e9-6759264dd651" containerName="maas-api" containerID="cri-o://6af0a168de5cd8f44fb664f0161b5bb13b7f3c7cfb4c8ba7aeb84c02575124ef" gracePeriod=30 Sep 15 22:03:26.502018 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.501975 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:26.535392 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.535361 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd"] Sep 15 22:03:26.535608 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.535579 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd" podUID="2621b231-dfd0-49d5-9337-252efc1c9955" containerName="payload-processing" containerID="cri-o://d1e009c035c7c4e6aa22ce5d1af359fef7c2000a845e789fde52f83699ddb0d9" gracePeriod=30 Sep 15 22:03:26.548729 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.548679 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4"] Sep 15 22:03:26.549061 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.549012 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4" podUID="9a66fe33-c761-43be-a3ee-a8457e6bf2b2" containerName="payload-pre-processing" containerID="cri-o://b54284ee86b00d00089910938efab9bdf6fc8f3a72d713f477d6e01bb79196ec" gracePeriod=30 Sep 15 22:03:26.589428 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.589392 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:26.662778 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.662744 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:26.734290 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.734185 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:26.839841 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.830040 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:26.849229 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.849202 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd" Sep 15 22:03:26.861205 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.861185 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4" Sep 15 22:03:26.869741 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.869658 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb" Sep 15 22:03:26.953360 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.953327 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a66fe33-c761-43be-a3ee-a8457e6bf2b2-plugins-config-volume\") pod \"9a66fe33-c761-43be-a3ee-a8457e6bf2b2\" (UID: \"9a66fe33-c761-43be-a3ee-a8457e6bf2b2\") " Sep 15 22:03:26.953360 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.953365 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47d9r\" (UniqueName: \"kubernetes.io/projected/9a66fe33-c761-43be-a3ee-a8457e6bf2b2-kube-api-access-47d9r\") pod \"9a66fe33-c761-43be-a3ee-a8457e6bf2b2\" (UID: \"9a66fe33-c761-43be-a3ee-a8457e6bf2b2\") " Sep 15 22:03:26.953570 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.953403 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxph8\" (UniqueName: \"kubernetes.io/projected/2621b231-dfd0-49d5-9337-252efc1c9955-kube-api-access-hxph8\") pod \"2621b231-dfd0-49d5-9337-252efc1c9955\" (UID: \"2621b231-dfd0-49d5-9337-252efc1c9955\") " Sep 15 22:03:26.953570 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.953430 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2466ff73-beaf-48b1-91e9-6759264dd651-metrics-certs\") pod \"2466ff73-beaf-48b1-91e9-6759264dd651\" (UID: \"2466ff73-beaf-48b1-91e9-6759264dd651\") " Sep 15 22:03:26.953570 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.953480 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z74wc\" (UniqueName: \"kubernetes.io/projected/2466ff73-beaf-48b1-91e9-6759264dd651-kube-api-access-z74wc\") pod \"2466ff73-beaf-48b1-91e9-6759264dd651\" (UID: \"2466ff73-beaf-48b1-91e9-6759264dd651\") " Sep 15 22:03:26.953570 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.953541 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2466ff73-beaf-48b1-91e9-6759264dd651-openshift-service-ca\") pod \"2466ff73-beaf-48b1-91e9-6759264dd651\" (UID: \"2466ff73-beaf-48b1-91e9-6759264dd651\") " Sep 15 22:03:26.953570 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.953566 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2466ff73-beaf-48b1-91e9-6759264dd651-maas-api-tls\") pod \"2466ff73-beaf-48b1-91e9-6759264dd651\" (UID: \"2466ff73-beaf-48b1-91e9-6759264dd651\") " Sep 15 22:03:26.953834 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.953589 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2621b231-dfd0-49d5-9337-252efc1c9955-plugins-config-volume\") pod \"2621b231-dfd0-49d5-9337-252efc1c9955\" (UID: \"2621b231-dfd0-49d5-9337-252efc1c9955\") " Sep 15 22:03:26.953834 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.953768 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a66fe33-c761-43be-a3ee-a8457e6bf2b2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9a66fe33-c761-43be-a3ee-a8457e6bf2b2" (UID: "9a66fe33-c761-43be-a3ee-a8457e6bf2b2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 22:03:26.954214 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.954116 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2621b231-dfd0-49d5-9337-252efc1c9955-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2621b231-dfd0-49d5-9337-252efc1c9955" (UID: "2621b231-dfd0-49d5-9337-252efc1c9955"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 22:03:26.954214 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.954158 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2466ff73-beaf-48b1-91e9-6759264dd651-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2466ff73-beaf-48b1-91e9-6759264dd651" (UID: "2466ff73-beaf-48b1-91e9-6759264dd651"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 22:03:26.954214 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.954175 2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a66fe33-c761-43be-a3ee-a8457e6bf2b2-plugins-config-volume\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:26.955981 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.955954 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2466ff73-beaf-48b1-91e9-6759264dd651-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2466ff73-beaf-48b1-91e9-6759264dd651" (UID: "2466ff73-beaf-48b1-91e9-6759264dd651"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 22:03:26.956136 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.956116 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2466ff73-beaf-48b1-91e9-6759264dd651-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2466ff73-beaf-48b1-91e9-6759264dd651" (UID: "2466ff73-beaf-48b1-91e9-6759264dd651"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 22:03:26.956200 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.956152 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a66fe33-c761-43be-a3ee-a8457e6bf2b2-kube-api-access-47d9r" (OuterVolumeSpecName: "kube-api-access-47d9r") pod "9a66fe33-c761-43be-a3ee-a8457e6bf2b2" (UID: "9a66fe33-c761-43be-a3ee-a8457e6bf2b2"). InnerVolumeSpecName "kube-api-access-47d9r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 22:03:26.956200 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.956178 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2466ff73-beaf-48b1-91e9-6759264dd651-kube-api-access-z74wc" (OuterVolumeSpecName: "kube-api-access-z74wc") pod "2466ff73-beaf-48b1-91e9-6759264dd651" (UID: "2466ff73-beaf-48b1-91e9-6759264dd651"). InnerVolumeSpecName "kube-api-access-z74wc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 22:03:26.956275 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:26.956224 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2621b231-dfd0-49d5-9337-252efc1c9955-kube-api-access-hxph8" (OuterVolumeSpecName: "kube-api-access-hxph8") pod "2621b231-dfd0-49d5-9337-252efc1c9955" (UID: "2621b231-dfd0-49d5-9337-252efc1c9955"). InnerVolumeSpecName "kube-api-access-hxph8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 22:03:27.055718 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.055637 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z74wc\" (UniqueName: \"kubernetes.io/projected/2466ff73-beaf-48b1-91e9-6759264dd651-kube-api-access-z74wc\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:27.055718 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.055666 2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2466ff73-beaf-48b1-91e9-6759264dd651-openshift-service-ca\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:27.055718 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.055678 2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2466ff73-beaf-48b1-91e9-6759264dd651-maas-api-tls\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:27.055718 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.055687 2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2621b231-dfd0-49d5-9337-252efc1c9955-plugins-config-volume\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:27.055718 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.055695 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47d9r\" (UniqueName: \"kubernetes.io/projected/9a66fe33-c761-43be-a3ee-a8457e6bf2b2-kube-api-access-47d9r\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:27.055718 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.055705 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxph8\" (UniqueName: \"kubernetes.io/projected/2621b231-dfd0-49d5-9337-252efc1c9955-kube-api-access-hxph8\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:27.055718 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.055714 2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2466ff73-beaf-48b1-91e9-6759264dd651-metrics-certs\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:27.119820 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.119790 2573 generic.go:356] "Generic (PLEG): container finished" podID="2621b231-dfd0-49d5-9337-252efc1c9955" containerID="d1e009c035c7c4e6aa22ce5d1af359fef7c2000a845e789fde52f83699ddb0d9" exitCode=0 Sep 15 22:03:27.120022 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.119838 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd" Sep 15 22:03:27.120022 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.119874 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd" event={"ID":"2621b231-dfd0-49d5-9337-252efc1c9955","Type":"ContainerDied","Data":"d1e009c035c7c4e6aa22ce5d1af359fef7c2000a845e789fde52f83699ddb0d9"} Sep 15 22:03:27.120022 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.119928 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd" event={"ID":"2621b231-dfd0-49d5-9337-252efc1c9955","Type":"ContainerDied","Data":"587b66dcc23fd64e51a860e8ef431c2a5c48398e5faa6fbb31a94d6bf7294971"} Sep 15 22:03:27.120022 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.119951 2573 scope.go:117] "RemoveContainer" containerID="d1e009c035c7c4e6aa22ce5d1af359fef7c2000a845e789fde52f83699ddb0d9" Sep 15 22:03:27.121258 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.121239 2573 generic.go:356] "Generic (PLEG): container finished" podID="2466ff73-beaf-48b1-91e9-6759264dd651" containerID="6af0a168de5cd8f44fb664f0161b5bb13b7f3c7cfb4c8ba7aeb84c02575124ef" exitCode=0 Sep 15 22:03:27.121389 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.121268 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb" event={"ID":"2466ff73-beaf-48b1-91e9-6759264dd651","Type":"ContainerDied","Data":"6af0a168de5cd8f44fb664f0161b5bb13b7f3c7cfb4c8ba7aeb84c02575124ef"} Sep 15 22:03:27.121389 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.121284 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb" Sep 15 22:03:27.121389 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.121318 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb" event={"ID":"2466ff73-beaf-48b1-91e9-6759264dd651","Type":"ContainerDied","Data":"05c3573135f9f1dae7611fa91beb05698e195c2e56c40fae23d1413b5e376d48"} Sep 15 22:03:27.122755 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.122732 2573 generic.go:356] "Generic (PLEG): container finished" podID="9a66fe33-c761-43be-a3ee-a8457e6bf2b2" containerID="b54284ee86b00d00089910938efab9bdf6fc8f3a72d713f477d6e01bb79196ec" exitCode=0 Sep 15 22:03:27.122894 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.122775 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4" Sep 15 22:03:27.122894 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.122816 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4" event={"ID":"9a66fe33-c761-43be-a3ee-a8457e6bf2b2","Type":"ContainerDied","Data":"b54284ee86b00d00089910938efab9bdf6fc8f3a72d713f477d6e01bb79196ec"} Sep 15 22:03:27.122894 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.122877 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4" event={"ID":"9a66fe33-c761-43be-a3ee-a8457e6bf2b2","Type":"ContainerDied","Data":"f2eeb168c7cdfb1cf8cc266123ab771b5b901a0de50160c43338a5e9b38fabe1"} Sep 15 22:03:27.127962 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.127899 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:27.132203 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.132187 2573 scope.go:117] "RemoveContainer" containerID="d1e009c035c7c4e6aa22ce5d1af359fef7c2000a845e789fde52f83699ddb0d9" Sep 15 22:03:27.132480 ip-10-0-133-42 kubenswrapper[2573]: E0915 22:03:27.132461 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1e009c035c7c4e6aa22ce5d1af359fef7c2000a845e789fde52f83699ddb0d9\": container with ID starting with d1e009c035c7c4e6aa22ce5d1af359fef7c2000a845e789fde52f83699ddb0d9 not found: ID does not exist" containerID="d1e009c035c7c4e6aa22ce5d1af359fef7c2000a845e789fde52f83699ddb0d9" Sep 15 22:03:27.132560 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.132493 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1e009c035c7c4e6aa22ce5d1af359fef7c2000a845e789fde52f83699ddb0d9"} err="failed to get container status \"d1e009c035c7c4e6aa22ce5d1af359fef7c2000a845e789fde52f83699ddb0d9\": rpc error: code = NotFound desc = could not find container \"d1e009c035c7c4e6aa22ce5d1af359fef7c2000a845e789fde52f83699ddb0d9\": container with ID starting with d1e009c035c7c4e6aa22ce5d1af359fef7c2000a845e789fde52f83699ddb0d9 not found: ID does not exist" Sep 15 22:03:27.132560 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.132516 2573 scope.go:117] "RemoveContainer" containerID="6af0a168de5cd8f44fb664f0161b5bb13b7f3c7cfb4c8ba7aeb84c02575124ef" Sep 15 22:03:27.141777 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.141755 2573 scope.go:117] "RemoveContainer" containerID="6af0a168de5cd8f44fb664f0161b5bb13b7f3c7cfb4c8ba7aeb84c02575124ef" Sep 15 22:03:27.142052 ip-10-0-133-42 kubenswrapper[2573]: E0915 22:03:27.142031 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6af0a168de5cd8f44fb664f0161b5bb13b7f3c7cfb4c8ba7aeb84c02575124ef\": container with ID starting with 6af0a168de5cd8f44fb664f0161b5bb13b7f3c7cfb4c8ba7aeb84c02575124ef not found: ID does not exist" containerID="6af0a168de5cd8f44fb664f0161b5bb13b7f3c7cfb4c8ba7aeb84c02575124ef" Sep 15 22:03:27.142116 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.142060 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6af0a168de5cd8f44fb664f0161b5bb13b7f3c7cfb4c8ba7aeb84c02575124ef"} err="failed to get container status \"6af0a168de5cd8f44fb664f0161b5bb13b7f3c7cfb4c8ba7aeb84c02575124ef\": rpc error: code = NotFound desc = could not find container \"6af0a168de5cd8f44fb664f0161b5bb13b7f3c7cfb4c8ba7aeb84c02575124ef\": container with ID starting with 6af0a168de5cd8f44fb664f0161b5bb13b7f3c7cfb4c8ba7aeb84c02575124ef not found: ID does not exist" Sep 15 22:03:27.142116 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.142076 2573 scope.go:117] "RemoveContainer" containerID="b54284ee86b00d00089910938efab9bdf6fc8f3a72d713f477d6e01bb79196ec" Sep 15 22:03:27.149148 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.149122 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd"] Sep 15 22:03:27.150976 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.150958 2573 scope.go:117] "RemoveContainer" containerID="b54284ee86b00d00089910938efab9bdf6fc8f3a72d713f477d6e01bb79196ec" Sep 15 22:03:27.151277 ip-10-0-133-42 kubenswrapper[2573]: E0915 22:03:27.151244 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b54284ee86b00d00089910938efab9bdf6fc8f3a72d713f477d6e01bb79196ec\": container with ID starting with b54284ee86b00d00089910938efab9bdf6fc8f3a72d713f477d6e01bb79196ec not found: ID does not exist" containerID="b54284ee86b00d00089910938efab9bdf6fc8f3a72d713f477d6e01bb79196ec" Sep 15 22:03:27.151330 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.151283 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b54284ee86b00d00089910938efab9bdf6fc8f3a72d713f477d6e01bb79196ec"} err="failed to get container status \"b54284ee86b00d00089910938efab9bdf6fc8f3a72d713f477d6e01bb79196ec\": rpc error: code = NotFound desc = could not find container \"b54284ee86b00d00089910938efab9bdf6fc8f3a72d713f477d6e01bb79196ec\": container with ID starting with b54284ee86b00d00089910938efab9bdf6fc8f3a72d713f477d6e01bb79196ec not found: ID does not exist" Sep 15 22:03:27.163390 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.163369 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd"] Sep 15 22:03:27.179913 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.179883 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb"] Sep 15 22:03:27.183138 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.183114 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ce3ab0-56897b6b49-cfbwb"] Sep 15 22:03:27.194448 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.194419 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4"] Sep 15 22:03:27.199509 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.199487 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4"] Sep 15 22:03:27.231815 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.231787 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:27.934875 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.934774 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2466ff73-beaf-48b1-91e9-6759264dd651" path="/var/lib/kubelet/pods/2466ff73-beaf-48b1-91e9-6759264dd651/volumes" Sep 15 22:03:27.935290 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.935273 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2621b231-dfd0-49d5-9337-252efc1c9955" path="/var/lib/kubelet/pods/2621b231-dfd0-49d5-9337-252efc1c9955/volumes" Sep 15 22:03:27.935613 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.935601 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a66fe33-c761-43be-a3ee-a8457e6bf2b2" path="/var/lib/kubelet/pods/9a66fe33-c761-43be-a3ee-a8457e6bf2b2/volumes" Sep 15 22:03:27.998321 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:27.998290 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:33.115775 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:33.115736 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:33.215727 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:33.215690 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:33.358427 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:33.358395 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5"] Sep 15 22:03:33.358658 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:33.358627 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" podUID="e2d63d60-cc36-4f88-847b-6f8b67faa894" containerName="istio-proxy" containerID="cri-o://179ce763ad13c0ef924ebbb187125af658b1492f2ef574ede0140ba58cc058f9" gracePeriod=30 Sep 15 22:03:33.383986 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:33.383895 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:34.029639 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:34.029609 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:34.912353 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:34.912319 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:35.665567 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:35.665534 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:38.090486 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.090445 2573 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 15 22:03:38.090867 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.090513 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" podUID="e2d63d60-cc36-4f88-847b-6f8b67faa894" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 15 22:03:38.617896 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.617869 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 22:03:38.670799 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.670712 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2d63d60-cc36-4f88-847b-6f8b67faa894-istiod-ca-cert\") pod \"e2d63d60-cc36-4f88-847b-6f8b67faa894\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " Sep 15 22:03:38.670799 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.670759 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-workload-certs\") pod \"e2d63d60-cc36-4f88-847b-6f8b67faa894\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " Sep 15 22:03:38.670799 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.670777 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-istio-data\") pod \"e2d63d60-cc36-4f88-847b-6f8b67faa894\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " Sep 15 22:03:38.671107 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.670820 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-workload-socket\") pod \"e2d63d60-cc36-4f88-847b-6f8b67faa894\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " Sep 15 22:03:38.671107 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.670838 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-istio-envoy\") pod \"e2d63d60-cc36-4f88-847b-6f8b67faa894\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " Sep 15 22:03:38.671107 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.670903 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9252m\" (UniqueName: \"kubernetes.io/projected/e2d63d60-cc36-4f88-847b-6f8b67faa894-kube-api-access-9252m\") pod \"e2d63d60-cc36-4f88-847b-6f8b67faa894\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " Sep 15 22:03:38.671107 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.670946 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2d63d60-cc36-4f88-847b-6f8b67faa894-istio-podinfo\") pod \"e2d63d60-cc36-4f88-847b-6f8b67faa894\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " Sep 15 22:03:38.671107 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.670974 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2d63d60-cc36-4f88-847b-6f8b67faa894-istio-token\") pod \"e2d63d60-cc36-4f88-847b-6f8b67faa894\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " Sep 15 22:03:38.671107 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.671012 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-credential-socket\") pod \"e2d63d60-cc36-4f88-847b-6f8b67faa894\" (UID: \"e2d63d60-cc36-4f88-847b-6f8b67faa894\") " Sep 15 22:03:38.671107 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.671079 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e2d63d60-cc36-4f88-847b-6f8b67faa894" (UID: "e2d63d60-cc36-4f88-847b-6f8b67faa894"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 22:03:38.671493 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.671113 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e2d63d60-cc36-4f88-847b-6f8b67faa894" (UID: "e2d63d60-cc36-4f88-847b-6f8b67faa894"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 22:03:38.671493 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.671135 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-istio-data" (OuterVolumeSpecName: "istio-data") pod "e2d63d60-cc36-4f88-847b-6f8b67faa894" (UID: "e2d63d60-cc36-4f88-847b-6f8b67faa894"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 22:03:38.671493 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.671188 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2d63d60-cc36-4f88-847b-6f8b67faa894-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e2d63d60-cc36-4f88-847b-6f8b67faa894" (UID: "e2d63d60-cc36-4f88-847b-6f8b67faa894"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 22:03:38.671493 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.671290 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e2d63d60-cc36-4f88-847b-6f8b67faa894" (UID: "e2d63d60-cc36-4f88-847b-6f8b67faa894"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 22:03:38.671493 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.671376 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-workload-certs\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:38.671493 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.671392 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-istio-data\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:38.671493 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.671402 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-workload-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:38.671493 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.671414 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-credential-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:38.671493 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.671423 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2d63d60-cc36-4f88-847b-6f8b67faa894-istiod-ca-cert\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:38.673236 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.673201 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e2d63d60-cc36-4f88-847b-6f8b67faa894-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e2d63d60-cc36-4f88-847b-6f8b67faa894" (UID: "e2d63d60-cc36-4f88-847b-6f8b67faa894"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 15 22:03:38.673350 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.673312 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e2d63d60-cc36-4f88-847b-6f8b67faa894" (UID: "e2d63d60-cc36-4f88-847b-6f8b67faa894"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 22:03:38.673581 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.673563 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2d63d60-cc36-4f88-847b-6f8b67faa894-istio-token" (OuterVolumeSpecName: "istio-token") pod "e2d63d60-cc36-4f88-847b-6f8b67faa894" (UID: "e2d63d60-cc36-4f88-847b-6f8b67faa894"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 22:03:38.673642 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.673593 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2d63d60-cc36-4f88-847b-6f8b67faa894-kube-api-access-9252m" (OuterVolumeSpecName: "kube-api-access-9252m") pod "e2d63d60-cc36-4f88-847b-6f8b67faa894" (UID: "e2d63d60-cc36-4f88-847b-6f8b67faa894"). InnerVolumeSpecName "kube-api-access-9252m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 22:03:38.772554 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.772517 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9252m\" (UniqueName: \"kubernetes.io/projected/e2d63d60-cc36-4f88-847b-6f8b67faa894-kube-api-access-9252m\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:38.772554 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.772549 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2d63d60-cc36-4f88-847b-6f8b67faa894-istio-podinfo\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:38.772554 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.772560 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2d63d60-cc36-4f88-847b-6f8b67faa894-istio-token\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:38.772810 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:38.772568 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2d63d60-cc36-4f88-847b-6f8b67faa894-istio-envoy\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:39.196811 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:39.196780 2573 generic.go:356] "Generic (PLEG): container finished" podID="e2d63d60-cc36-4f88-847b-6f8b67faa894" containerID="179ce763ad13c0ef924ebbb187125af658b1492f2ef574ede0140ba58cc058f9" exitCode=0 Sep 15 22:03:39.197213 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:39.196826 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" event={"ID":"e2d63d60-cc36-4f88-847b-6f8b67faa894","Type":"ContainerDied","Data":"179ce763ad13c0ef924ebbb187125af658b1492f2ef574ede0140ba58cc058f9"} Sep 15 22:03:39.197213 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:39.196837 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" Sep 15 22:03:39.197213 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:39.196888 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5" event={"ID":"e2d63d60-cc36-4f88-847b-6f8b67faa894","Type":"ContainerDied","Data":"36612756add4a0fb3edd7d360f00dfa4e6a058cd32fed1b9a21230d81fe5a337"} Sep 15 22:03:39.197213 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:39.196910 2573 scope.go:117] "RemoveContainer" containerID="179ce763ad13c0ef924ebbb187125af658b1492f2ef574ede0140ba58cc058f9" Sep 15 22:03:39.207259 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:39.207242 2573 scope.go:117] "RemoveContainer" containerID="57d18321c2ffbb24a7bfbef34fe37871b31ad4ad474d6520fc811a1ca8c1891c" Sep 15 22:03:39.215925 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:39.215903 2573 scope.go:117] "RemoveContainer" containerID="179ce763ad13c0ef924ebbb187125af658b1492f2ef574ede0140ba58cc058f9" Sep 15 22:03:39.216187 ip-10-0-133-42 kubenswrapper[2573]: E0915 22:03:39.216167 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"179ce763ad13c0ef924ebbb187125af658b1492f2ef574ede0140ba58cc058f9\": container with ID starting with 179ce763ad13c0ef924ebbb187125af658b1492f2ef574ede0140ba58cc058f9 not found: ID does not exist" containerID="179ce763ad13c0ef924ebbb187125af658b1492f2ef574ede0140ba58cc058f9" Sep 15 22:03:39.216267 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:39.216193 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"179ce763ad13c0ef924ebbb187125af658b1492f2ef574ede0140ba58cc058f9"} err="failed to get container status \"179ce763ad13c0ef924ebbb187125af658b1492f2ef574ede0140ba58cc058f9\": rpc error: code = NotFound desc = could not find container \"179ce763ad13c0ef924ebbb187125af658b1492f2ef574ede0140ba58cc058f9\": container with ID starting with 179ce763ad13c0ef924ebbb187125af658b1492f2ef574ede0140ba58cc058f9 not found: ID does not exist" Sep 15 22:03:39.216267 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:39.216211 2573 scope.go:117] "RemoveContainer" containerID="57d18321c2ffbb24a7bfbef34fe37871b31ad4ad474d6520fc811a1ca8c1891c" Sep 15 22:03:39.216481 ip-10-0-133-42 kubenswrapper[2573]: E0915 22:03:39.216461 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57d18321c2ffbb24a7bfbef34fe37871b31ad4ad474d6520fc811a1ca8c1891c\": container with ID starting with 57d18321c2ffbb24a7bfbef34fe37871b31ad4ad474d6520fc811a1ca8c1891c not found: ID does not exist" containerID="57d18321c2ffbb24a7bfbef34fe37871b31ad4ad474d6520fc811a1ca8c1891c" Sep 15 22:03:39.216523 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:39.216487 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57d18321c2ffbb24a7bfbef34fe37871b31ad4ad474d6520fc811a1ca8c1891c"} err="failed to get container status \"57d18321c2ffbb24a7bfbef34fe37871b31ad4ad474d6520fc811a1ca8c1891c\": rpc error: code = NotFound desc = could not find container \"57d18321c2ffbb24a7bfbef34fe37871b31ad4ad474d6520fc811a1ca8c1891c\": container with ID starting with 57d18321c2ffbb24a7bfbef34fe37871b31ad4ad474d6520fc811a1ca8c1891c not found: ID does not exist" Sep 15 22:03:39.221249 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:39.221227 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5"] Sep 15 22:03:39.227734 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:39.227709 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5"] Sep 15 22:03:39.934649 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:39.934615 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2d63d60-cc36-4f88-847b-6f8b67faa894" path="/var/lib/kubelet/pods/e2d63d60-cc36-4f88-847b-6f8b67faa894/volumes" Sep 15 22:03:42.700757 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:42.700718 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:44.343172 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.343137 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8"] Sep 15 22:03:44.343581 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.343368 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8" podUID="4b0b120b-daa7-4a91-8291-ec10a6825cce" containerName="maas-api" containerID="cri-o://e6eafb8ff2770c2c553bbbe864649fa4b20e0360399dd3b6ae19dfe329adfc0e" gracePeriod=30 Sep 15 22:03:44.375743 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.375709 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:44.400629 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.400596 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4"] Sep 15 22:03:44.400853 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.400820 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4" podUID="867d1402-c81c-48cb-94af-2adbed5b3d59" containerName="payload-processing" containerID="cri-o://3123cbe45cabb8e844ba56ef504b325dd9fdddd7c3793f7fb27c9d4828ae6309" gracePeriod=30 Sep 15 22:03:44.450050 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.450001 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:44.555555 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.555514 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:44.650175 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.650137 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:44.654355 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.654331 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8" Sep 15 22:03:44.691014 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.690981 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4" Sep 15 22:03:44.725708 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.725673 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmjw9\" (UniqueName: \"kubernetes.io/projected/4b0b120b-daa7-4a91-8291-ec10a6825cce-kube-api-access-lmjw9\") pod \"4b0b120b-daa7-4a91-8291-ec10a6825cce\" (UID: \"4b0b120b-daa7-4a91-8291-ec10a6825cce\") " Sep 15 22:03:44.725901 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.725715 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b0b120b-daa7-4a91-8291-ec10a6825cce-maas-api-tls\") pod \"4b0b120b-daa7-4a91-8291-ec10a6825cce\" (UID: \"4b0b120b-daa7-4a91-8291-ec10a6825cce\") " Sep 15 22:03:44.725901 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.725745 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b0b120b-daa7-4a91-8291-ec10a6825cce-openshift-service-ca\") pod \"4b0b120b-daa7-4a91-8291-ec10a6825cce\" (UID: \"4b0b120b-daa7-4a91-8291-ec10a6825cce\") " Sep 15 22:03:44.725901 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.725760 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbgf4\" (UniqueName: \"kubernetes.io/projected/867d1402-c81c-48cb-94af-2adbed5b3d59-kube-api-access-kbgf4\") pod \"867d1402-c81c-48cb-94af-2adbed5b3d59\" (UID: \"867d1402-c81c-48cb-94af-2adbed5b3d59\") " Sep 15 22:03:44.725901 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.725778 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0b120b-daa7-4a91-8291-ec10a6825cce-metrics-certs\") pod \"4b0b120b-daa7-4a91-8291-ec10a6825cce\" (UID: \"4b0b120b-daa7-4a91-8291-ec10a6825cce\") " Sep 15 22:03:44.725901 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.725822 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/867d1402-c81c-48cb-94af-2adbed5b3d59-plugins-config-volume\") pod \"867d1402-c81c-48cb-94af-2adbed5b3d59\" (UID: \"867d1402-c81c-48cb-94af-2adbed5b3d59\") " Sep 15 22:03:44.726211 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.726140 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b0b120b-daa7-4a91-8291-ec10a6825cce-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4b0b120b-daa7-4a91-8291-ec10a6825cce" (UID: "4b0b120b-daa7-4a91-8291-ec10a6825cce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 22:03:44.726571 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.726532 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/867d1402-c81c-48cb-94af-2adbed5b3d59-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "867d1402-c81c-48cb-94af-2adbed5b3d59" (UID: "867d1402-c81c-48cb-94af-2adbed5b3d59"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 22:03:44.727988 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.727954 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b0b120b-daa7-4a91-8291-ec10a6825cce-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4b0b120b-daa7-4a91-8291-ec10a6825cce" (UID: "4b0b120b-daa7-4a91-8291-ec10a6825cce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 22:03:44.727988 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.727977 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b0b120b-daa7-4a91-8291-ec10a6825cce-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4b0b120b-daa7-4a91-8291-ec10a6825cce" (UID: "4b0b120b-daa7-4a91-8291-ec10a6825cce"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 22:03:44.728136 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.728005 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b0b120b-daa7-4a91-8291-ec10a6825cce-kube-api-access-lmjw9" (OuterVolumeSpecName: "kube-api-access-lmjw9") pod "4b0b120b-daa7-4a91-8291-ec10a6825cce" (UID: "4b0b120b-daa7-4a91-8291-ec10a6825cce"). InnerVolumeSpecName "kube-api-access-lmjw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 22:03:44.728334 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.728319 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/867d1402-c81c-48cb-94af-2adbed5b3d59-kube-api-access-kbgf4" (OuterVolumeSpecName: "kube-api-access-kbgf4") pod "867d1402-c81c-48cb-94af-2adbed5b3d59" (UID: "867d1402-c81c-48cb-94af-2adbed5b3d59"). InnerVolumeSpecName "kube-api-access-kbgf4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 22:03:44.827448 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.827415 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmjw9\" (UniqueName: \"kubernetes.io/projected/4b0b120b-daa7-4a91-8291-ec10a6825cce-kube-api-access-lmjw9\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:44.827448 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.827445 2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b0b120b-daa7-4a91-8291-ec10a6825cce-maas-api-tls\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:44.827448 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.827455 2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b0b120b-daa7-4a91-8291-ec10a6825cce-openshift-service-ca\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:44.827448 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.827463 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbgf4\" (UniqueName: \"kubernetes.io/projected/867d1402-c81c-48cb-94af-2adbed5b3d59-kube-api-access-kbgf4\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:44.827732 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.827472 2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0b120b-daa7-4a91-8291-ec10a6825cce-metrics-certs\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:44.827732 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:44.827482 2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/867d1402-c81c-48cb-94af-2adbed5b3d59-plugins-config-volume\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:45.030749 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:45.030705 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:45.141643 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:45.141602 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:45.233112 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:45.233080 2573 generic.go:356] "Generic (PLEG): container finished" podID="867d1402-c81c-48cb-94af-2adbed5b3d59" containerID="3123cbe45cabb8e844ba56ef504b325dd9fdddd7c3793f7fb27c9d4828ae6309" exitCode=0 Sep 15 22:03:45.233259 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:45.233123 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4" Sep 15 22:03:45.233259 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:45.233164 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4" event={"ID":"867d1402-c81c-48cb-94af-2adbed5b3d59","Type":"ContainerDied","Data":"3123cbe45cabb8e844ba56ef504b325dd9fdddd7c3793f7fb27c9d4828ae6309"} Sep 15 22:03:45.233259 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:45.233219 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4" event={"ID":"867d1402-c81c-48cb-94af-2adbed5b3d59","Type":"ContainerDied","Data":"75074f0cc1906691f9fa104bf87e792baea0379629cf624c5d40c22e75cd1ba2"} Sep 15 22:03:45.233259 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:45.233247 2573 scope.go:117] "RemoveContainer" containerID="3123cbe45cabb8e844ba56ef504b325dd9fdddd7c3793f7fb27c9d4828ae6309" Sep 15 22:03:45.234601 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:45.234575 2573 generic.go:356] "Generic (PLEG): container finished" podID="4b0b120b-daa7-4a91-8291-ec10a6825cce" containerID="e6eafb8ff2770c2c553bbbe864649fa4b20e0360399dd3b6ae19dfe329adfc0e" exitCode=0 Sep 15 22:03:45.234720 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:45.234620 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8" Sep 15 22:03:45.234720 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:45.234639 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8" event={"ID":"4b0b120b-daa7-4a91-8291-ec10a6825cce","Type":"ContainerDied","Data":"e6eafb8ff2770c2c553bbbe864649fa4b20e0360399dd3b6ae19dfe329adfc0e"} Sep 15 22:03:45.234720 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:45.234676 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8" event={"ID":"4b0b120b-daa7-4a91-8291-ec10a6825cce","Type":"ContainerDied","Data":"200a399d2727afa8d28ed2655a88b95798f0f0fa5dc00ca15d7db75f11ac01c7"} Sep 15 22:03:45.243973 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:45.243954 2573 scope.go:117] "RemoveContainer" containerID="3123cbe45cabb8e844ba56ef504b325dd9fdddd7c3793f7fb27c9d4828ae6309" Sep 15 22:03:45.244273 ip-10-0-133-42 kubenswrapper[2573]: E0915 22:03:45.244255 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3123cbe45cabb8e844ba56ef504b325dd9fdddd7c3793f7fb27c9d4828ae6309\": container with ID starting with 3123cbe45cabb8e844ba56ef504b325dd9fdddd7c3793f7fb27c9d4828ae6309 not found: ID does not exist" containerID="3123cbe45cabb8e844ba56ef504b325dd9fdddd7c3793f7fb27c9d4828ae6309" Sep 15 22:03:45.244343 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:45.244279 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3123cbe45cabb8e844ba56ef504b325dd9fdddd7c3793f7fb27c9d4828ae6309"} err="failed to get container status \"3123cbe45cabb8e844ba56ef504b325dd9fdddd7c3793f7fb27c9d4828ae6309\": rpc error: code = NotFound desc = could not find container \"3123cbe45cabb8e844ba56ef504b325dd9fdddd7c3793f7fb27c9d4828ae6309\": container with ID starting with 3123cbe45cabb8e844ba56ef504b325dd9fdddd7c3793f7fb27c9d4828ae6309 not found: ID does not exist" Sep 15 22:03:45.244343 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:45.244294 2573 scope.go:117] "RemoveContainer" containerID="e6eafb8ff2770c2c553bbbe864649fa4b20e0360399dd3b6ae19dfe329adfc0e" Sep 15 22:03:45.253191 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:45.253174 2573 scope.go:117] "RemoveContainer" containerID="e6eafb8ff2770c2c553bbbe864649fa4b20e0360399dd3b6ae19dfe329adfc0e" Sep 15 22:03:45.253499 ip-10-0-133-42 kubenswrapper[2573]: E0915 22:03:45.253479 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6eafb8ff2770c2c553bbbe864649fa4b20e0360399dd3b6ae19dfe329adfc0e\": container with ID starting with e6eafb8ff2770c2c553bbbe864649fa4b20e0360399dd3b6ae19dfe329adfc0e not found: ID does not exist" containerID="e6eafb8ff2770c2c553bbbe864649fa4b20e0360399dd3b6ae19dfe329adfc0e" Sep 15 22:03:45.253566 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:45.253504 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6eafb8ff2770c2c553bbbe864649fa4b20e0360399dd3b6ae19dfe329adfc0e"} err="failed to get container status \"e6eafb8ff2770c2c553bbbe864649fa4b20e0360399dd3b6ae19dfe329adfc0e\": rpc error: code = NotFound desc = could not find container \"e6eafb8ff2770c2c553bbbe864649fa4b20e0360399dd3b6ae19dfe329adfc0e\": container with ID starting with e6eafb8ff2770c2c553bbbe864649fa4b20e0360399dd3b6ae19dfe329adfc0e not found: ID does not exist" Sep 15 22:03:45.263452 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:45.263424 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4"] Sep 15 22:03:45.268704 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:45.268679 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4"] Sep 15 22:03:45.290871 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:45.290776 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8"] Sep 15 22:03:45.299368 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:45.299340 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e7a648-5d9788f5fc-vrzd8"] Sep 15 22:03:45.934939 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:45.934908 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b0b120b-daa7-4a91-8291-ec10a6825cce" path="/var/lib/kubelet/pods/4b0b120b-daa7-4a91-8291-ec10a6825cce/volumes" Sep 15 22:03:45.935425 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:45.935409 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="867d1402-c81c-48cb-94af-2adbed5b3d59" path="/var/lib/kubelet/pods/867d1402-c81c-48cb-94af-2adbed5b3d59/volumes" Sep 15 22:03:50.961296 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:50.961262 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:51.061169 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:51.061134 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:51.200057 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:51.200027 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb"] Sep 15 22:03:51.200257 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:51.200235 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" podUID="73721755-fbf7-4b60-8e61-2b4fc17ba3d7" containerName="istio-proxy" containerID="cri-o://d60d00d8d8f99f793d025b169afe8bb0b7e6286862a265eb1d09270f997860f5" gracePeriod=30 Sep 15 22:03:51.222681 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:51.222653 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:03:56.465928 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.465840 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 22:03:56.537198 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.537163 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istio-podinfo\") pod \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " Sep 15 22:03:56.537388 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.537212 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istio-data\") pod \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " Sep 15 22:03:56.537388 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.537238 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istio-token\") pod \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " Sep 15 22:03:56.537388 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.537283 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7p5z7\" (UniqueName: \"kubernetes.io/projected/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-kube-api-access-7p5z7\") pod \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " Sep 15 22:03:56.537388 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.537308 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istiod-ca-cert\") pod \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " Sep 15 22:03:56.537388 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.537350 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istio-envoy\") pod \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " Sep 15 22:03:56.537657 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.537397 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-workload-socket\") pod \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " Sep 15 22:03:56.537657 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.537469 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-workload-certs\") pod \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " Sep 15 22:03:56.537657 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.537517 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-credential-socket\") pod \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\" (UID: \"73721755-fbf7-4b60-8e61-2b4fc17ba3d7\") " Sep 15 22:03:56.537826 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.537765 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "73721755-fbf7-4b60-8e61-2b4fc17ba3d7" (UID: "73721755-fbf7-4b60-8e61-2b4fc17ba3d7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 22:03:56.537826 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.537794 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "73721755-fbf7-4b60-8e61-2b4fc17ba3d7" (UID: "73721755-fbf7-4b60-8e61-2b4fc17ba3d7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 22:03:56.538052 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.538022 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "73721755-fbf7-4b60-8e61-2b4fc17ba3d7" (UID: "73721755-fbf7-4b60-8e61-2b4fc17ba3d7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 22:03:56.538052 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.538043 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istio-data" (OuterVolumeSpecName: "istio-data") pod "73721755-fbf7-4b60-8e61-2b4fc17ba3d7" (UID: "73721755-fbf7-4b60-8e61-2b4fc17ba3d7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 22:03:56.538266 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.538115 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "73721755-fbf7-4b60-8e61-2b4fc17ba3d7" (UID: "73721755-fbf7-4b60-8e61-2b4fc17ba3d7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 22:03:56.539593 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.539565 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "73721755-fbf7-4b60-8e61-2b4fc17ba3d7" (UID: "73721755-fbf7-4b60-8e61-2b4fc17ba3d7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 15 22:03:56.539680 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.539607 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-kube-api-access-7p5z7" (OuterVolumeSpecName: "kube-api-access-7p5z7") pod "73721755-fbf7-4b60-8e61-2b4fc17ba3d7" (UID: "73721755-fbf7-4b60-8e61-2b4fc17ba3d7"). InnerVolumeSpecName "kube-api-access-7p5z7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 22:03:56.539770 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.539755 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "73721755-fbf7-4b60-8e61-2b4fc17ba3d7" (UID: "73721755-fbf7-4b60-8e61-2b4fc17ba3d7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 22:03:56.539905 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.539890 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istio-token" (OuterVolumeSpecName: "istio-token") pod "73721755-fbf7-4b60-8e61-2b4fc17ba3d7" (UID: "73721755-fbf7-4b60-8e61-2b4fc17ba3d7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 22:03:56.638285 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.638249 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istio-token\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:56.638285 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.638277 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7p5z7\" (UniqueName: \"kubernetes.io/projected/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-kube-api-access-7p5z7\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:56.638285 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.638287 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istiod-ca-cert\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:56.638513 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.638296 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istio-envoy\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:56.638513 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.638304 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-workload-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:56.638513 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.638311 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-workload-certs\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:56.638513 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.638320 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-credential-socket\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:56.638513 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.638327 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istio-podinfo\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:56.638513 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:56.638335 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73721755-fbf7-4b60-8e61-2b4fc17ba3d7-istio-data\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:03:57.308772 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:57.308740 2573 generic.go:356] "Generic (PLEG): container finished" podID="73721755-fbf7-4b60-8e61-2b4fc17ba3d7" containerID="d60d00d8d8f99f793d025b169afe8bb0b7e6286862a265eb1d09270f997860f5" exitCode=0 Sep 15 22:03:57.308958 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:57.308793 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" Sep 15 22:03:57.308958 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:57.308802 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" event={"ID":"73721755-fbf7-4b60-8e61-2b4fc17ba3d7","Type":"ContainerDied","Data":"d60d00d8d8f99f793d025b169afe8bb0b7e6286862a265eb1d09270f997860f5"} Sep 15 22:03:57.308958 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:57.308906 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb" event={"ID":"73721755-fbf7-4b60-8e61-2b4fc17ba3d7","Type":"ContainerDied","Data":"5ade9fd2955f45e3cf0d7f1b3d8829c8ced1dd73a8c29ea31b1f9105ee4678cf"} Sep 15 22:03:57.308958 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:57.308927 2573 scope.go:117] "RemoveContainer" containerID="d60d00d8d8f99f793d025b169afe8bb0b7e6286862a265eb1d09270f997860f5" Sep 15 22:03:57.319347 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:57.319204 2573 scope.go:117] "RemoveContainer" containerID="de2090b2b689d127d1168af3aaaebaed36b4fe25f521deb0680eba580402e632" Sep 15 22:03:57.327236 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:57.327220 2573 scope.go:117] "RemoveContainer" containerID="d60d00d8d8f99f793d025b169afe8bb0b7e6286862a265eb1d09270f997860f5" Sep 15 22:03:57.327489 ip-10-0-133-42 kubenswrapper[2573]: E0915 22:03:57.327468 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d60d00d8d8f99f793d025b169afe8bb0b7e6286862a265eb1d09270f997860f5\": container with ID starting with d60d00d8d8f99f793d025b169afe8bb0b7e6286862a265eb1d09270f997860f5 not found: ID does not exist" containerID="d60d00d8d8f99f793d025b169afe8bb0b7e6286862a265eb1d09270f997860f5" Sep 15 22:03:57.327554 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:57.327496 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d60d00d8d8f99f793d025b169afe8bb0b7e6286862a265eb1d09270f997860f5"} err="failed to get container status \"d60d00d8d8f99f793d025b169afe8bb0b7e6286862a265eb1d09270f997860f5\": rpc error: code = NotFound desc = could not find container \"d60d00d8d8f99f793d025b169afe8bb0b7e6286862a265eb1d09270f997860f5\": container with ID starting with d60d00d8d8f99f793d025b169afe8bb0b7e6286862a265eb1d09270f997860f5 not found: ID does not exist" Sep 15 22:03:57.327554 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:57.327511 2573 scope.go:117] "RemoveContainer" containerID="de2090b2b689d127d1168af3aaaebaed36b4fe25f521deb0680eba580402e632" Sep 15 22:03:57.327739 ip-10-0-133-42 kubenswrapper[2573]: E0915 22:03:57.327722 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de2090b2b689d127d1168af3aaaebaed36b4fe25f521deb0680eba580402e632\": container with ID starting with de2090b2b689d127d1168af3aaaebaed36b4fe25f521deb0680eba580402e632 not found: ID does not exist" containerID="de2090b2b689d127d1168af3aaaebaed36b4fe25f521deb0680eba580402e632" Sep 15 22:03:57.327782 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:57.327743 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de2090b2b689d127d1168af3aaaebaed36b4fe25f521deb0680eba580402e632"} err="failed to get container status \"de2090b2b689d127d1168af3aaaebaed36b4fe25f521deb0680eba580402e632\": rpc error: code = NotFound desc = could not find container \"de2090b2b689d127d1168af3aaaebaed36b4fe25f521deb0680eba580402e632\": container with ID starting with de2090b2b689d127d1168af3aaaebaed36b4fe25f521deb0680eba580402e632 not found: ID does not exist" Sep 15 22:03:57.334602 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:57.334568 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb"] Sep 15 22:03:57.337959 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:57.337935 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb"] Sep 15 22:03:57.934343 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:03:57.934310 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73721755-fbf7-4b60-8e61-2b4fc17ba3d7" path="/var/lib/kubelet/pods/73721755-fbf7-4b60-8e61-2b4fc17ba3d7/volumes" Sep 15 22:04:17.932593 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:04:17.932530 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:04:18.990283 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:04:18.990245 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:04:19.092164 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:04:19.092123 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:05:15.821770 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:05:15.821726 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:05:17.643995 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:05:17.643960 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:05:46.111427 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:05:46.111395 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/1.log" Sep 15 22:05:46.116897 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:05:46.116872 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/1.log" Sep 15 22:06:01.389016 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:06:01.388978 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:06:01.489137 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:06:01.489101 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:06:46.391707 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:06:46.391670 2573 scope.go:117] "RemoveContainer" containerID="176a6243b9cefce35ca31e665fcbe2220e234d35e037c6bb7be9e5bc75e86a62" Sep 15 22:06:54.131081 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:06:54.131041 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:06:55.943507 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:06:55.943474 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:08:13.290567 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:08:13.290481 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:08:39.073178 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:08:39.073135 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:08:54.235038 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:08:54.235002 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:09:09.359399 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:09.359316 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:09:11.079626 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:11.079592 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:09:33.994834 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:33.994803 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:09:34.093784 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.093747 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:09:34.736952 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.736915 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k"] Sep 15 22:09:34.737420 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737403 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2d63d60-cc36-4f88-847b-6f8b67faa894" containerName="istio-proxy" Sep 15 22:09:34.737466 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737424 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2d63d60-cc36-4f88-847b-6f8b67faa894" containerName="istio-proxy" Sep 15 22:09:34.737466 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737441 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b9bd1cd-f124-40f7-bd85-5edd7c97728d" containerName="payload-pre-processing" Sep 15 22:09:34.737466 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737450 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b9bd1cd-f124-40f7-bd85-5edd7c97728d" containerName="payload-pre-processing" Sep 15 22:09:34.737466 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737464 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2466ff73-beaf-48b1-91e9-6759264dd651" containerName="maas-api" Sep 15 22:09:34.737595 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737472 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2466ff73-beaf-48b1-91e9-6759264dd651" containerName="maas-api" Sep 15 22:09:34.737595 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737481 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b0b120b-daa7-4a91-8291-ec10a6825cce" containerName="maas-api" Sep 15 22:09:34.737595 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737489 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b0b120b-daa7-4a91-8291-ec10a6825cce" containerName="maas-api" Sep 15 22:09:34.737595 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737498 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b20519cb-5eaf-42c3-8ef8-e3131b665c0b" containerName="istio-proxy" Sep 15 22:09:34.737595 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737506 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b20519cb-5eaf-42c3-8ef8-e3131b665c0b" containerName="istio-proxy" Sep 15 22:09:34.737595 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737518 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b20519cb-5eaf-42c3-8ef8-e3131b665c0b" containerName="istio-proxy" Sep 15 22:09:34.737595 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737526 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b20519cb-5eaf-42c3-8ef8-e3131b665c0b" containerName="istio-proxy" Sep 15 22:09:34.737595 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737538 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73721755-fbf7-4b60-8e61-2b4fc17ba3d7" containerName="istio-proxy" Sep 15 22:09:34.737595 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737546 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="73721755-fbf7-4b60-8e61-2b4fc17ba3d7" containerName="istio-proxy" Sep 15 22:09:34.737595 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737557 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="867d1402-c81c-48cb-94af-2adbed5b3d59" containerName="payload-processing" Sep 15 22:09:34.737595 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737564 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="867d1402-c81c-48cb-94af-2adbed5b3d59" containerName="payload-processing" Sep 15 22:09:34.737595 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737580 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73721755-fbf7-4b60-8e61-2b4fc17ba3d7" containerName="istio-proxy" Sep 15 22:09:34.737595 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737588 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="73721755-fbf7-4b60-8e61-2b4fc17ba3d7" containerName="istio-proxy" Sep 15 22:09:34.738014 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737619 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2621b231-dfd0-49d5-9337-252efc1c9955" containerName="payload-processing" Sep 15 22:09:34.738014 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737628 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2621b231-dfd0-49d5-9337-252efc1c9955" containerName="payload-processing" Sep 15 22:09:34.738014 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737639 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a66fe33-c761-43be-a3ee-a8457e6bf2b2" containerName="payload-pre-processing" Sep 15 22:09:34.738014 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737648 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a66fe33-c761-43be-a3ee-a8457e6bf2b2" containerName="payload-pre-processing" Sep 15 22:09:34.738014 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737722 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b20519cb-5eaf-42c3-8ef8-e3131b665c0b" containerName="istio-proxy" Sep 15 22:09:34.738014 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737732 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b20519cb-5eaf-42c3-8ef8-e3131b665c0b" containerName="istio-proxy" Sep 15 22:09:34.738014 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737743 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b9bd1cd-f124-40f7-bd85-5edd7c97728d" containerName="payload-pre-processing" Sep 15 22:09:34.738014 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737752 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="73721755-fbf7-4b60-8e61-2b4fc17ba3d7" containerName="istio-proxy" Sep 15 22:09:34.738014 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737760 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2d63d60-cc36-4f88-847b-6f8b67faa894" containerName="istio-proxy" Sep 15 22:09:34.738014 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737770 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2621b231-dfd0-49d5-9337-252efc1c9955" containerName="payload-processing" Sep 15 22:09:34.738014 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737777 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b0b120b-daa7-4a91-8291-ec10a6825cce" containerName="maas-api" Sep 15 22:09:34.738014 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737788 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2466ff73-beaf-48b1-91e9-6759264dd651" containerName="maas-api" Sep 15 22:09:34.738014 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737798 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="867d1402-c81c-48cb-94af-2adbed5b3d59" containerName="payload-processing" Sep 15 22:09:34.738014 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.737810 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a66fe33-c761-43be-a3ee-a8457e6bf2b2" containerName="payload-pre-processing" Sep 15 22:09:34.741213 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.741196 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" Sep 15 22:09:34.750606 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.750572 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 15 22:09:34.750758 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.750635 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 15 22:09:34.750758 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.750573 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 15 22:09:34.750920 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.750792 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 15 22:09:34.751324 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.751303 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5bmlq\"" Sep 15 22:09:34.752583 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.752559 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k"] Sep 15 22:09:34.830993 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.830964 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9cks\" (UniqueName: \"kubernetes.io/projected/7957d9f4-0f28-44ec-85b2-7fbe5d161257-kube-api-access-b9cks\") pod \"maas-api-5557cbddd4-psd9k\" (UID: \"7957d9f4-0f28-44ec-85b2-7fbe5d161257\") " pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" Sep 15 22:09:34.831178 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.831003 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7957d9f4-0f28-44ec-85b2-7fbe5d161257-metrics-certs\") pod \"maas-api-5557cbddd4-psd9k\" (UID: \"7957d9f4-0f28-44ec-85b2-7fbe5d161257\") " pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" Sep 15 22:09:34.831178 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.831039 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7957d9f4-0f28-44ec-85b2-7fbe5d161257-openshift-service-ca\") pod \"maas-api-5557cbddd4-psd9k\" (UID: \"7957d9f4-0f28-44ec-85b2-7fbe5d161257\") " pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" Sep 15 22:09:34.831178 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.831161 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7957d9f4-0f28-44ec-85b2-7fbe5d161257-maas-api-tls\") pod \"maas-api-5557cbddd4-psd9k\" (UID: \"7957d9f4-0f28-44ec-85b2-7fbe5d161257\") " pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" Sep 15 22:09:34.932022 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.931986 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7957d9f4-0f28-44ec-85b2-7fbe5d161257-maas-api-tls\") pod \"maas-api-5557cbddd4-psd9k\" (UID: \"7957d9f4-0f28-44ec-85b2-7fbe5d161257\") " pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" Sep 15 22:09:34.932227 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.932031 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9cks\" (UniqueName: \"kubernetes.io/projected/7957d9f4-0f28-44ec-85b2-7fbe5d161257-kube-api-access-b9cks\") pod \"maas-api-5557cbddd4-psd9k\" (UID: \"7957d9f4-0f28-44ec-85b2-7fbe5d161257\") " pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" Sep 15 22:09:34.932227 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.932051 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7957d9f4-0f28-44ec-85b2-7fbe5d161257-metrics-certs\") pod \"maas-api-5557cbddd4-psd9k\" (UID: \"7957d9f4-0f28-44ec-85b2-7fbe5d161257\") " pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" Sep 15 22:09:34.932227 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.932076 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7957d9f4-0f28-44ec-85b2-7fbe5d161257-openshift-service-ca\") pod \"maas-api-5557cbddd4-psd9k\" (UID: \"7957d9f4-0f28-44ec-85b2-7fbe5d161257\") " pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" Sep 15 22:09:34.932675 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.932656 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7957d9f4-0f28-44ec-85b2-7fbe5d161257-openshift-service-ca\") pod \"maas-api-5557cbddd4-psd9k\" (UID: \"7957d9f4-0f28-44ec-85b2-7fbe5d161257\") " pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" Sep 15 22:09:34.934453 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.934434 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7957d9f4-0f28-44ec-85b2-7fbe5d161257-metrics-certs\") pod \"maas-api-5557cbddd4-psd9k\" (UID: \"7957d9f4-0f28-44ec-85b2-7fbe5d161257\") " pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" Sep 15 22:09:34.934560 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.934489 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7957d9f4-0f28-44ec-85b2-7fbe5d161257-maas-api-tls\") pod \"maas-api-5557cbddd4-psd9k\" (UID: \"7957d9f4-0f28-44ec-85b2-7fbe5d161257\") " pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" Sep 15 22:09:34.941039 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:34.941012 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9cks\" (UniqueName: \"kubernetes.io/projected/7957d9f4-0f28-44ec-85b2-7fbe5d161257-kube-api-access-b9cks\") pod \"maas-api-5557cbddd4-psd9k\" (UID: \"7957d9f4-0f28-44ec-85b2-7fbe5d161257\") " pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" Sep 15 22:09:35.052288 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:35.052195 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" Sep 15 22:09:35.329886 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:35.329840 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k"] Sep 15 22:09:35.331458 ip-10-0-133-42 kubenswrapper[2573]: W0915 22:09:35.331425 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7957d9f4_0f28_44ec_85b2_7fbe5d161257.slice/crio-9e14fc4ce3c1c3f156ece4c3a9a9362dd4a0ca0564d3ad3ceb5841e2aca72e5b WatchSource:0}: Error finding container 9e14fc4ce3c1c3f156ece4c3a9a9362dd4a0ca0564d3ad3ceb5841e2aca72e5b: Status 404 returned error can't find the container with id 9e14fc4ce3c1c3f156ece4c3a9a9362dd4a0ca0564d3ad3ceb5841e2aca72e5b Sep 15 22:09:35.332742 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:35.332723 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 22:09:36.096828 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:36.096792 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" event={"ID":"7957d9f4-0f28-44ec-85b2-7fbe5d161257","Type":"ContainerStarted","Data":"18b336a91642479111f5a84cc2671be57ad8d08ba0bd4964075977883c0f566a"} Sep 15 22:09:36.097287 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:36.096867 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" event={"ID":"7957d9f4-0f28-44ec-85b2-7fbe5d161257","Type":"ContainerStarted","Data":"9e14fc4ce3c1c3f156ece4c3a9a9362dd4a0ca0564d3ad3ceb5841e2aca72e5b"} Sep 15 22:09:36.097287 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:36.096905 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" Sep 15 22:09:36.122557 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:36.122509 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" podStartSLOduration=1.5529424459999999 podStartE2EDuration="2.122491902s" totalImagesPullingTime="569.549456ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 22:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 22:09:36.121329046 +0000 UTC m=+2630.707926641" watchObservedRunningTime="2026-09-15 22:09:36.122491902 +0000 UTC m=+2630.709089494" Sep 15 22:09:42.107911 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:42.107882 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" Sep 15 22:09:43.162911 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:43.162880 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5bbfc7d884-j2q5b"] Sep 15 22:09:43.163280 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:43.163254 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2d63d60-cc36-4f88-847b-6f8b67faa894" containerName="istio-proxy" Sep 15 22:09:43.163280 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:43.163265 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2d63d60-cc36-4f88-847b-6f8b67faa894" containerName="istio-proxy" Sep 15 22:09:43.163363 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:43.163326 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="73721755-fbf7-4b60-8e61-2b4fc17ba3d7" containerName="istio-proxy" Sep 15 22:09:43.163363 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:43.163334 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2d63d60-cc36-4f88-847b-6f8b67faa894" containerName="istio-proxy" Sep 15 22:09:43.166473 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:43.166453 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5bbfc7d884-j2q5b" Sep 15 22:09:43.182531 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:43.182499 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5bbfc7d884-j2q5b"] Sep 15 22:09:43.202267 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:43.202240 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dda36b8f-2399-4764-b349-69d56ad82ad2-maas-api-tls\") pod \"maas-api-5bbfc7d884-j2q5b\" (UID: \"dda36b8f-2399-4764-b349-69d56ad82ad2\") " pod="odh-ai-gateway-infra/maas-api-5bbfc7d884-j2q5b" Sep 15 22:09:43.202429 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:43.202296 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ffmc\" (UniqueName: \"kubernetes.io/projected/dda36b8f-2399-4764-b349-69d56ad82ad2-kube-api-access-6ffmc\") pod \"maas-api-5bbfc7d884-j2q5b\" (UID: \"dda36b8f-2399-4764-b349-69d56ad82ad2\") " pod="odh-ai-gateway-infra/maas-api-5bbfc7d884-j2q5b" Sep 15 22:09:43.202489 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:43.202444 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dda36b8f-2399-4764-b349-69d56ad82ad2-openshift-service-ca\") pod \"maas-api-5bbfc7d884-j2q5b\" (UID: \"dda36b8f-2399-4764-b349-69d56ad82ad2\") " pod="odh-ai-gateway-infra/maas-api-5bbfc7d884-j2q5b" Sep 15 22:09:43.202542 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:43.202489 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dda36b8f-2399-4764-b349-69d56ad82ad2-metrics-certs\") pod \"maas-api-5bbfc7d884-j2q5b\" (UID: \"dda36b8f-2399-4764-b349-69d56ad82ad2\") " pod="odh-ai-gateway-infra/maas-api-5bbfc7d884-j2q5b" Sep 15 22:09:43.303344 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:43.303297 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dda36b8f-2399-4764-b349-69d56ad82ad2-openshift-service-ca\") pod \"maas-api-5bbfc7d884-j2q5b\" (UID: \"dda36b8f-2399-4764-b349-69d56ad82ad2\") " pod="odh-ai-gateway-infra/maas-api-5bbfc7d884-j2q5b" Sep 15 22:09:43.303546 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:43.303358 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dda36b8f-2399-4764-b349-69d56ad82ad2-metrics-certs\") pod \"maas-api-5bbfc7d884-j2q5b\" (UID: \"dda36b8f-2399-4764-b349-69d56ad82ad2\") " pod="odh-ai-gateway-infra/maas-api-5bbfc7d884-j2q5b" Sep 15 22:09:43.303546 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:43.303433 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dda36b8f-2399-4764-b349-69d56ad82ad2-maas-api-tls\") pod \"maas-api-5bbfc7d884-j2q5b\" (UID: \"dda36b8f-2399-4764-b349-69d56ad82ad2\") " pod="odh-ai-gateway-infra/maas-api-5bbfc7d884-j2q5b" Sep 15 22:09:43.303546 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:43.303482 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ffmc\" (UniqueName: \"kubernetes.io/projected/dda36b8f-2399-4764-b349-69d56ad82ad2-kube-api-access-6ffmc\") pod \"maas-api-5bbfc7d884-j2q5b\" (UID: \"dda36b8f-2399-4764-b349-69d56ad82ad2\") " pod="odh-ai-gateway-infra/maas-api-5bbfc7d884-j2q5b" Sep 15 22:09:43.304266 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:43.304231 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dda36b8f-2399-4764-b349-69d56ad82ad2-openshift-service-ca\") pod \"maas-api-5bbfc7d884-j2q5b\" (UID: \"dda36b8f-2399-4764-b349-69d56ad82ad2\") " pod="odh-ai-gateway-infra/maas-api-5bbfc7d884-j2q5b" Sep 15 22:09:43.306278 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:43.306242 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dda36b8f-2399-4764-b349-69d56ad82ad2-metrics-certs\") pod \"maas-api-5bbfc7d884-j2q5b\" (UID: \"dda36b8f-2399-4764-b349-69d56ad82ad2\") " pod="odh-ai-gateway-infra/maas-api-5bbfc7d884-j2q5b" Sep 15 22:09:43.306613 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:43.306590 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dda36b8f-2399-4764-b349-69d56ad82ad2-maas-api-tls\") pod \"maas-api-5bbfc7d884-j2q5b\" (UID: \"dda36b8f-2399-4764-b349-69d56ad82ad2\") " pod="odh-ai-gateway-infra/maas-api-5bbfc7d884-j2q5b" Sep 15 22:09:43.313188 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:43.313155 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ffmc\" (UniqueName: \"kubernetes.io/projected/dda36b8f-2399-4764-b349-69d56ad82ad2-kube-api-access-6ffmc\") pod \"maas-api-5bbfc7d884-j2q5b\" (UID: \"dda36b8f-2399-4764-b349-69d56ad82ad2\") " pod="odh-ai-gateway-infra/maas-api-5bbfc7d884-j2q5b" Sep 15 22:09:43.477996 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:43.477959 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5bbfc7d884-j2q5b" Sep 15 22:09:43.763330 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:43.763298 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5bbfc7d884-j2q5b"] Sep 15 22:09:43.764774 ip-10-0-133-42 kubenswrapper[2573]: W0915 22:09:43.764751 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddda36b8f_2399_4764_b349_69d56ad82ad2.slice/crio-f190e15cbc71849b02922c0fec13c8c31b3d7bdf9d7b0061a79de84d24660c70 WatchSource:0}: Error finding container f190e15cbc71849b02922c0fec13c8c31b3d7bdf9d7b0061a79de84d24660c70: Status 404 returned error can't find the container with id f190e15cbc71849b02922c0fec13c8c31b3d7bdf9d7b0061a79de84d24660c70 Sep 15 22:09:44.141561 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:44.141533 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5bbfc7d884-j2q5b" event={"ID":"dda36b8f-2399-4764-b349-69d56ad82ad2","Type":"ContainerStarted","Data":"f190e15cbc71849b02922c0fec13c8c31b3d7bdf9d7b0061a79de84d24660c70"} Sep 15 22:09:45.148716 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:45.148676 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5bbfc7d884-j2q5b" event={"ID":"dda36b8f-2399-4764-b349-69d56ad82ad2","Type":"ContainerStarted","Data":"e752aba66e1d73d0a5913a6001f9d71e81bdeca3b916f25ea956900e1f04d7e5"} Sep 15 22:09:45.149174 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:45.148813 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5bbfc7d884-j2q5b" Sep 15 22:09:45.172812 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:45.172759 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5bbfc7d884-j2q5b" podStartSLOduration=1.821750134 podStartE2EDuration="2.172744911s" totalImagesPullingTime="350.994777ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 22:09:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 22:09:45.171111063 +0000 UTC m=+2639.757708652" watchObservedRunningTime="2026-09-15 22:09:45.172744911 +0000 UTC m=+2639.759342560" Sep 15 22:09:51.160200 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:51.160170 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5bbfc7d884-j2q5b" Sep 15 22:09:51.221699 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:51.221661 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k"] Sep 15 22:09:51.221941 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:51.221911 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" podUID="7957d9f4-0f28-44ec-85b2-7fbe5d161257" containerName="maas-api" containerID="cri-o://18b336a91642479111f5a84cc2671be57ad8d08ba0bd4964075977883c0f566a" gracePeriod=30 Sep 15 22:09:52.103711 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:52.103667 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" podUID="7957d9f4-0f28-44ec-85b2-7fbe5d161257" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.77:8443/health\": dial tcp 10.132.0.77:8443: connect: connection refused" Sep 15 22:09:52.466810 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:52.466778 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" Sep 15 22:09:52.587871 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:52.587822 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7957d9f4-0f28-44ec-85b2-7fbe5d161257-openshift-service-ca\") pod \"7957d9f4-0f28-44ec-85b2-7fbe5d161257\" (UID: \"7957d9f4-0f28-44ec-85b2-7fbe5d161257\") " Sep 15 22:09:52.588072 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:52.587921 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7957d9f4-0f28-44ec-85b2-7fbe5d161257-metrics-certs\") pod \"7957d9f4-0f28-44ec-85b2-7fbe5d161257\" (UID: \"7957d9f4-0f28-44ec-85b2-7fbe5d161257\") " Sep 15 22:09:52.588072 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:52.587949 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7957d9f4-0f28-44ec-85b2-7fbe5d161257-maas-api-tls\") pod \"7957d9f4-0f28-44ec-85b2-7fbe5d161257\" (UID: \"7957d9f4-0f28-44ec-85b2-7fbe5d161257\") " Sep 15 22:09:52.588072 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:52.587970 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9cks\" (UniqueName: \"kubernetes.io/projected/7957d9f4-0f28-44ec-85b2-7fbe5d161257-kube-api-access-b9cks\") pod \"7957d9f4-0f28-44ec-85b2-7fbe5d161257\" (UID: \"7957d9f4-0f28-44ec-85b2-7fbe5d161257\") " Sep 15 22:09:52.588275 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:52.588246 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7957d9f4-0f28-44ec-85b2-7fbe5d161257-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7957d9f4-0f28-44ec-85b2-7fbe5d161257" (UID: "7957d9f4-0f28-44ec-85b2-7fbe5d161257"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 22:09:52.590247 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:52.590219 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7957d9f4-0f28-44ec-85b2-7fbe5d161257-kube-api-access-b9cks" (OuterVolumeSpecName: "kube-api-access-b9cks") pod "7957d9f4-0f28-44ec-85b2-7fbe5d161257" (UID: "7957d9f4-0f28-44ec-85b2-7fbe5d161257"). InnerVolumeSpecName "kube-api-access-b9cks". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 22:09:52.590365 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:52.590259 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7957d9f4-0f28-44ec-85b2-7fbe5d161257-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7957d9f4-0f28-44ec-85b2-7fbe5d161257" (UID: "7957d9f4-0f28-44ec-85b2-7fbe5d161257"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 22:09:52.590365 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:52.590281 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7957d9f4-0f28-44ec-85b2-7fbe5d161257-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7957d9f4-0f28-44ec-85b2-7fbe5d161257" (UID: "7957d9f4-0f28-44ec-85b2-7fbe5d161257"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 22:09:52.689032 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:52.688935 2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7957d9f4-0f28-44ec-85b2-7fbe5d161257-openshift-service-ca\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:09:52.689032 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:52.688970 2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7957d9f4-0f28-44ec-85b2-7fbe5d161257-metrics-certs\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:09:52.689032 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:52.688984 2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7957d9f4-0f28-44ec-85b2-7fbe5d161257-maas-api-tls\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:09:52.689032 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:52.688995 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9cks\" (UniqueName: \"kubernetes.io/projected/7957d9f4-0f28-44ec-85b2-7fbe5d161257-kube-api-access-b9cks\") on node \"ip-10-0-133-42.ec2.internal\" DevicePath \"\"" Sep 15 22:09:53.192081 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:53.192043 2573 generic.go:356] "Generic (PLEG): container finished" podID="7957d9f4-0f28-44ec-85b2-7fbe5d161257" containerID="18b336a91642479111f5a84cc2671be57ad8d08ba0bd4964075977883c0f566a" exitCode=0 Sep 15 22:09:53.192283 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:53.192096 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" Sep 15 22:09:53.192283 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:53.192131 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" event={"ID":"7957d9f4-0f28-44ec-85b2-7fbe5d161257","Type":"ContainerDied","Data":"18b336a91642479111f5a84cc2671be57ad8d08ba0bd4964075977883c0f566a"} Sep 15 22:09:53.192283 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:53.192189 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k" event={"ID":"7957d9f4-0f28-44ec-85b2-7fbe5d161257","Type":"ContainerDied","Data":"9e14fc4ce3c1c3f156ece4c3a9a9362dd4a0ca0564d3ad3ceb5841e2aca72e5b"} Sep 15 22:09:53.192283 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:53.192212 2573 scope.go:117] "RemoveContainer" containerID="18b336a91642479111f5a84cc2671be57ad8d08ba0bd4964075977883c0f566a" Sep 15 22:09:53.201465 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:53.201449 2573 scope.go:117] "RemoveContainer" containerID="18b336a91642479111f5a84cc2671be57ad8d08ba0bd4964075977883c0f566a" Sep 15 22:09:53.201745 ip-10-0-133-42 kubenswrapper[2573]: E0915 22:09:53.201723 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18b336a91642479111f5a84cc2671be57ad8d08ba0bd4964075977883c0f566a\": container with ID starting with 18b336a91642479111f5a84cc2671be57ad8d08ba0bd4964075977883c0f566a not found: ID does not exist" containerID="18b336a91642479111f5a84cc2671be57ad8d08ba0bd4964075977883c0f566a" Sep 15 22:09:53.201795 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:53.201754 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18b336a91642479111f5a84cc2671be57ad8d08ba0bd4964075977883c0f566a"} err="failed to get container status \"18b336a91642479111f5a84cc2671be57ad8d08ba0bd4964075977883c0f566a\": rpc error: code = NotFound desc = could not find container \"18b336a91642479111f5a84cc2671be57ad8d08ba0bd4964075977883c0f566a\": container with ID starting with 18b336a91642479111f5a84cc2671be57ad8d08ba0bd4964075977883c0f566a not found: ID does not exist" Sep 15 22:09:53.215078 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:53.215055 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k"] Sep 15 22:09:53.223590 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:53.223568 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5557cbddd4-psd9k"] Sep 15 22:09:53.934053 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:09:53.934017 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7957d9f4-0f28-44ec-85b2-7fbe5d161257" path="/var/lib/kubelet/pods/7957d9f4-0f28-44ec-85b2-7fbe5d161257/volumes" Sep 15 22:10:11.765963 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:11.765928 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77fddcc9c6-898vx_1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4/copy-manifests/0.log" Sep 15 22:10:11.784474 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:11.784449 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77fddcc9c6-898vx_1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4/manager/0.log" Sep 15 22:10:12.313212 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:12.313174 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5bbfc7d884-j2q5b_dda36b8f-2399-4764-b349-69d56ad82ad2/maas-api/0.log" Sep 15 22:10:12.673858 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:12.673774 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29825160-7fm7c_363c5865-6272-4e27-89bd-3a9a866a2963/cleanup/0.log" Sep 15 22:10:14.843183 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:14.843152 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw_608b1fef-5905-4280-bda4-0b887898e46a/istio-proxy/0.log" Sep 15 22:10:14.975211 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:14.975182 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-4jdr6_e394ccb2-1aeb-49ec-8183-40ced527fea1/discovery/0.log" Sep 15 22:10:15.339125 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:15.339092 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-qvvww_bc8cd5e0-f1c1-4f75-9282-e5ad2386268f/istio-proxy/1.log" Sep 15 22:10:15.601342 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:15.601252 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-7q576_4b1b10bf-d7ac-4e51-82ad-9c247a8b4365/payload-processing/0.log" Sep 15 22:10:15.732858 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:15.732828 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65c7764bf8-c5p5m_7e761257-cdb3-4046-a183-152c58a95cf3/router/0.log" Sep 15 22:10:16.484682 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:16.484655 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-5tdnw_8cdb5194-77c3-4d9e-8c50-44763dca0ca3/main/0.log" Sep 15 22:10:22.305373 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:22.305340 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:10:22.404936 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:22.404877 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" limit=1024 Sep 15 22:10:25.402052 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:25.402015 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-z22rp_ef06c19b-a992-4624-948e-2d0db582f824/global-pull-secret-syncer/0.log" Sep 15 22:10:25.459049 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:25.459019 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cc5cc_9adb4f33-9fb6-4e7d-99cc-d6d31ad11a5d/konnectivity-agent/0.log" Sep 15 22:10:25.591130 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:25.591095 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-42.ec2.internal_fc2afcdcc5cf9fb90dbda3c38c71226a/haproxy/0.log" Sep 15 22:10:32.070248 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:32.070213 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-kc9ll_4eee406f-4302-4f6d-b025-0ffeb454b0c1/cluster-monitoring-operator/0.log" Sep 15 22:10:32.564318 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:32.564289 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vrfsx_e8dd38e7-7dfb-459d-8caa-9650760c6fbe/node-exporter/0.log" Sep 15 22:10:32.618142 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:32.618107 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vrfsx_e8dd38e7-7dfb-459d-8caa-9650760c6fbe/kube-rbac-proxy/0.log" Sep 15 22:10:32.667438 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:32.667412 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vrfsx_e8dd38e7-7dfb-459d-8caa-9650760c6fbe/init-textfile/0.log" Sep 15 22:10:33.067033 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:33.067004 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-n2btb_26f1bc64-064a-4cf4-a92e-81cd000b1126/prometheus-operator-admission-webhook/0.log" Sep 15 22:10:34.682349 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:34.682315 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-r2j9t_c63672d5-4ee5-4a51-98e2-b430944567b8/networking-console-plugin/0.log" Sep 15 22:10:35.298386 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.298340 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/1.log" Sep 15 22:10:35.306364 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.306333 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/2.log" Sep 15 22:10:35.578780 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.578687 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv"] Sep 15 22:10:35.579249 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.579219 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7957d9f4-0f28-44ec-85b2-7fbe5d161257" containerName="maas-api" Sep 15 22:10:35.579249 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.579246 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7957d9f4-0f28-44ec-85b2-7fbe5d161257" containerName="maas-api" Sep 15 22:10:35.579412 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.579344 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7957d9f4-0f28-44ec-85b2-7fbe5d161257" containerName="maas-api" Sep 15 22:10:35.582481 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.582466 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv" Sep 15 22:10:35.585165 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.585136 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lgf4x\"/\"default-dockercfg-5glwm\"" Sep 15 22:10:35.586256 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.586239 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lgf4x\"/\"kube-root-ca.crt\"" Sep 15 22:10:35.586367 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.586274 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lgf4x\"/\"openshift-service-ca.crt\"" Sep 15 22:10:35.591638 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.591618 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv"] Sep 15 22:10:35.674747 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.674707 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/75566cc8-b8ad-4d59-8435-8e18883946d8-lib-modules\") pod \"perf-node-gather-daemonset-jqqlv\" (UID: \"75566cc8-b8ad-4d59-8435-8e18883946d8\") " pod="openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv" Sep 15 22:10:35.674955 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.674765 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/75566cc8-b8ad-4d59-8435-8e18883946d8-proc\") pod \"perf-node-gather-daemonset-jqqlv\" (UID: \"75566cc8-b8ad-4d59-8435-8e18883946d8\") " pod="openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv" Sep 15 22:10:35.674955 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.674836 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/75566cc8-b8ad-4d59-8435-8e18883946d8-podres\") pod \"perf-node-gather-daemonset-jqqlv\" (UID: \"75566cc8-b8ad-4d59-8435-8e18883946d8\") " pod="openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv" Sep 15 22:10:35.674955 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.674887 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x45wj\" (UniqueName: \"kubernetes.io/projected/75566cc8-b8ad-4d59-8435-8e18883946d8-kube-api-access-x45wj\") pod \"perf-node-gather-daemonset-jqqlv\" (UID: \"75566cc8-b8ad-4d59-8435-8e18883946d8\") " pod="openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv" Sep 15 22:10:35.674955 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.674910 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75566cc8-b8ad-4d59-8435-8e18883946d8-sys\") pod \"perf-node-gather-daemonset-jqqlv\" (UID: \"75566cc8-b8ad-4d59-8435-8e18883946d8\") " pod="openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv" Sep 15 22:10:35.775562 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.775524 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/75566cc8-b8ad-4d59-8435-8e18883946d8-podres\") pod \"perf-node-gather-daemonset-jqqlv\" (UID: \"75566cc8-b8ad-4d59-8435-8e18883946d8\") " pod="openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv" Sep 15 22:10:35.775562 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.775564 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x45wj\" (UniqueName: \"kubernetes.io/projected/75566cc8-b8ad-4d59-8435-8e18883946d8-kube-api-access-x45wj\") pod \"perf-node-gather-daemonset-jqqlv\" (UID: \"75566cc8-b8ad-4d59-8435-8e18883946d8\") " pod="openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv" Sep 15 22:10:35.776012 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.775589 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75566cc8-b8ad-4d59-8435-8e18883946d8-sys\") pod \"perf-node-gather-daemonset-jqqlv\" (UID: \"75566cc8-b8ad-4d59-8435-8e18883946d8\") " pod="openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv" Sep 15 22:10:35.776012 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.775642 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/75566cc8-b8ad-4d59-8435-8e18883946d8-lib-modules\") pod \"perf-node-gather-daemonset-jqqlv\" (UID: \"75566cc8-b8ad-4d59-8435-8e18883946d8\") " pod="openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv" Sep 15 22:10:35.776012 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.775706 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/75566cc8-b8ad-4d59-8435-8e18883946d8-proc\") pod \"perf-node-gather-daemonset-jqqlv\" (UID: \"75566cc8-b8ad-4d59-8435-8e18883946d8\") " pod="openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv" Sep 15 22:10:35.776012 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.775712 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/75566cc8-b8ad-4d59-8435-8e18883946d8-podres\") pod \"perf-node-gather-daemonset-jqqlv\" (UID: \"75566cc8-b8ad-4d59-8435-8e18883946d8\") " pod="openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv" Sep 15 22:10:35.776012 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.775738 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75566cc8-b8ad-4d59-8435-8e18883946d8-sys\") pod \"perf-node-gather-daemonset-jqqlv\" (UID: \"75566cc8-b8ad-4d59-8435-8e18883946d8\") " pod="openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv" Sep 15 22:10:35.776012 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.775800 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/75566cc8-b8ad-4d59-8435-8e18883946d8-proc\") pod \"perf-node-gather-daemonset-jqqlv\" (UID: \"75566cc8-b8ad-4d59-8435-8e18883946d8\") " pod="openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv" Sep 15 22:10:35.776012 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.775834 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/75566cc8-b8ad-4d59-8435-8e18883946d8-lib-modules\") pod \"perf-node-gather-daemonset-jqqlv\" (UID: \"75566cc8-b8ad-4d59-8435-8e18883946d8\") " pod="openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv" Sep 15 22:10:35.783841 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.783823 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x45wj\" (UniqueName: \"kubernetes.io/projected/75566cc8-b8ad-4d59-8435-8e18883946d8-kube-api-access-x45wj\") pod \"perf-node-gather-daemonset-jqqlv\" (UID: \"75566cc8-b8ad-4d59-8435-8e18883946d8\") " pod="openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv" Sep 15 22:10:35.877394 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.877284 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-745648c7f7-pbrhs_df81a705-f14b-4d90-8219-20ec079dc744/console/0.log" Sep 15 22:10:35.892372 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.892340 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv" Sep 15 22:10:35.921020 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:35.920990 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-qhrj9_88955b0e-a1aa-467f-b0a4-257aa77e1f89/download-server/0.log" Sep 15 22:10:36.171340 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:36.171312 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv"] Sep 15 22:10:36.173640 ip-10-0-133-42 kubenswrapper[2573]: W0915 22:10:36.173617 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod75566cc8_b8ad_4d59_8435_8e18883946d8.slice/crio-0e78afde6dfc892ef7ade0ae51f689a782ceed8a7e3cde777a507c6e82273dcb WatchSource:0}: Error finding container 0e78afde6dfc892ef7ade0ae51f689a782ceed8a7e3cde777a507c6e82273dcb: Status 404 returned error can't find the container with id 0e78afde6dfc892ef7ade0ae51f689a782ceed8a7e3cde777a507c6e82273dcb Sep 15 22:10:36.419561 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:36.419529 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv" event={"ID":"75566cc8-b8ad-4d59-8435-8e18883946d8","Type":"ContainerStarted","Data":"beecf609647bd6d527c79626331ff66935896ba3c811a39a60313001727f5284"} Sep 15 22:10:36.419749 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:36.419583 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv" event={"ID":"75566cc8-b8ad-4d59-8435-8e18883946d8","Type":"ContainerStarted","Data":"0e78afde6dfc892ef7ade0ae51f689a782ceed8a7e3cde777a507c6e82273dcb"} Sep 15 22:10:36.419749 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:36.419709 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv" Sep 15 22:10:36.441889 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:36.441787 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv" podStartSLOduration=1.441771953 podStartE2EDuration="1.441771953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 22:10:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 22:10:36.440385505 +0000 UTC m=+2691.026983097" watchObservedRunningTime="2026-09-15 22:10:36.441771953 +0000 UTC m=+2691.028369544" Sep 15 22:10:36.646353 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:36.646322 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-tzq4z_a0d9e799-32d3-4a7b-8b28-a0c9f806e1af/volume-data-source-validator/0.log" Sep 15 22:10:37.709467 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:37.709431 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d88qc_2006e792-d99b-4fe3-a377-80a44d71bed4/dns/0.log" Sep 15 22:10:37.736344 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:37.736318 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d88qc_2006e792-d99b-4fe3-a377-80a44d71bed4/kube-rbac-proxy/0.log" Sep 15 22:10:37.879058 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:37.879027 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6pvrb_e3df5fab-3b41-4274-ba5f-dff5143b9192/dns-node-resolver/0.log" Sep 15 22:10:38.544792 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:38.544711 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8qm2x_2da7d8f4-3fa7-4d76-86b9-1f22852adcef/node-ca/0.log" Sep 15 22:10:39.570699 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:39.570668 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw_608b1fef-5905-4280-bda4-0b887898e46a/istio-proxy/0.log" Sep 15 22:10:40.412938 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:40.412901 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-4jdr6_e394ccb2-1aeb-49ec-8183-40ced527fea1/discovery/0.log" Sep 15 22:10:40.498117 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:40.498083 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-qvvww_bc8cd5e0-f1c1-4f75-9282-e5ad2386268f/istio-proxy/0.log" Sep 15 22:10:40.503206 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:40.503181 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-qvvww_bc8cd5e0-f1c1-4f75-9282-e5ad2386268f/istio-proxy/1.log" Sep 15 22:10:40.580396 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:40.580369 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-7q576_4b1b10bf-d7ac-4e51-82ad-9c247a8b4365/payload-processing/0.log" Sep 15 22:10:40.604987 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:40.604960 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65c7764bf8-c5p5m_7e761257-cdb3-4046-a183-152c58a95cf3/router/0.log" Sep 15 22:10:41.562978 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:41.562952 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hs9tw_fe233237-a6a8-4b91-9457-25bf748485fa/serve-healthcheck-canary/0.log" Sep 15 22:10:42.093576 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:42.093547 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-4d7d5_0d4711a1-1b97-4fe8-b382-8a810c3a1a5d/insights-operator/0.log" Sep 15 22:10:42.095065 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:42.095044 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-4d7d5_0d4711a1-1b97-4fe8-b382-8a810c3a1a5d/insights-operator/1.log" Sep 15 22:10:42.351734 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:42.351606 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-db6kb_d1354b88-afbc-439f-ad1d-297368efa425/kube-rbac-proxy/0.log" Sep 15 22:10:42.377300 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:42.377270 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-db6kb_d1354b88-afbc-439f-ad1d-297368efa425/exporter/0.log" Sep 15 22:10:42.408968 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:42.408931 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-db6kb_d1354b88-afbc-439f-ad1d-297368efa425/extractor/0.log" Sep 15 22:10:42.433914 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:42.433890 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lgf4x/perf-node-gather-daemonset-jqqlv" Sep 15 22:10:45.619919 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:45.619819 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw_608b1fef-5905-4280-bda4-0b887898e46a/istio-proxy/0.log" Sep 15 22:10:45.726076 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:45.726040 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77fddcc9c6-898vx_1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4/manager/0.log" Sep 15 22:10:45.760088 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:45.760055 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77fddcc9c6-898vx_1402330d-59f1-4b2e-a7e3-ca7d6f6ec6e4/copy-manifests/0.log" Sep 15 22:10:46.160611 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:46.160583 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/1.log" Sep 15 22:10:46.167958 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:46.167932 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nq4tk_fe5b8a05-c75a-48ae-9a1e-9b5d91630b89/console-operator/1.log" Sep 15 22:10:46.502653 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:46.502622 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-4jdr6_e394ccb2-1aeb-49ec-8183-40ced527fea1/discovery/0.log" Sep 15 22:10:46.575013 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:46.574980 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-qvvww_bc8cd5e0-f1c1-4f75-9282-e5ad2386268f/istio-proxy/0.log" Sep 15 22:10:46.580036 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:46.580005 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-qvvww_bc8cd5e0-f1c1-4f75-9282-e5ad2386268f/istio-proxy/1.log" Sep 15 22:10:46.646010 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:46.645978 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-7q576_4b1b10bf-d7ac-4e51-82ad-9c247a8b4365/payload-processing/0.log" Sep 15 22:10:46.671103 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:46.671076 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65c7764bf8-c5p5m_7e761257-cdb3-4046-a183-152c58a95cf3/router/0.log" Sep 15 22:10:47.071523 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:47.071484 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5d697dcf85-s4rp5_457976fb-99da-4be7-b19c-24eea9444974/manager/0.log" Sep 15 22:10:48.282249 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:48.282203 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw_608b1fef-5905-4280-bda4-0b887898e46a/istio-proxy/0.log" Sep 15 22:10:49.090864 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:49.090816 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-4jdr6_e394ccb2-1aeb-49ec-8183-40ced527fea1/discovery/0.log" Sep 15 22:10:49.180585 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:49.180553 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-qvvww_bc8cd5e0-f1c1-4f75-9282-e5ad2386268f/istio-proxy/0.log" Sep 15 22:10:49.184916 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:49.184889 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-qvvww_bc8cd5e0-f1c1-4f75-9282-e5ad2386268f/istio-proxy/1.log" Sep 15 22:10:49.244234 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:49.244203 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-7q576_4b1b10bf-d7ac-4e51-82ad-9c247a8b4365/payload-processing/0.log" Sep 15 22:10:49.279896 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:49.279832 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65c7764bf8-c5p5m_7e761257-cdb3-4046-a183-152c58a95cf3/router/0.log" Sep 15 22:10:52.596654 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:52.596617 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-4mqs2_335e21be-9627-4187-939e-a6680c2b6733/kube-storage-version-migrator-operator/1.log" Sep 15 22:10:52.597967 ip-10-0-133-42 kubenswrapper[2573]: I0915 22:10:52.597942 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-4mqs2_335e21be-9627-4187-939e-a6680c2b6733/kube-storage-version-migrator-operator/0.log"