Jul 15 22:31:19.360711 ip-10-0-132-45 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 15 22:31:19.360722 ip-10-0-132-45 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 15 22:31:19.360736 ip-10-0-132-45 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 15 22:31:19.360946 ip-10-0-132-45 systemd[1]: Failed to start Kubernetes Kubelet. Jul 15 22:31:29.503780 ip-10-0-132-45 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 15 22:31:29.503795 ip-10-0-132-45 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ca63bf6600cc4605ad5760a5943b59b3 -- Jul 15 22:33:10.171151 ip-10-0-132-45 systemd[1]: Starting Kubernetes Kubelet... Jul 15 22:33:10.609992 ip-10-0-132-45 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 22:33:10.609992 ip-10-0-132-45 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 22:33:10.609992 ip-10-0-132-45 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 22:33:10.609992 ip-10-0-132-45 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 22:33:10.609992 ip-10-0-132-45 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 22:33:10.610954 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.610869 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 22:33:10.616482 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616468 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 22:33:10.616482 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616483 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 22:33:10.616546 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616487 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 22:33:10.616546 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616492 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 22:33:10.616546 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616495 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 22:33:10.616546 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616498 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 22:33:10.616546 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616501 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 22:33:10.616546 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616503 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 15 22:33:10.616546 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616506 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 22:33:10.616546 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616508 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 22:33:10.616546 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616514 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 22:33:10.616546 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616518 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 22:33:10.616546 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616523 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 22:33:10.616546 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616526 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 22:33:10.616546 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616531 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 22:33:10.616546 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616534 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 22:33:10.616546 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616536 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 22:33:10.616546 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616540 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 22:33:10.616546 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616542 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 22:33:10.616546 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616545 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 22:33:10.616546 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616549 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 22:33:10.617019 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616552 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 22:33:10.617019 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616555 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 22:33:10.617019 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616558 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 22:33:10.617019 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616561 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 22:33:10.617019 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616563 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 22:33:10.617019 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616566 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 22:33:10.617019 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616570 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 22:33:10.617019 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616573 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 22:33:10.617019 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616575 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 22:33:10.617019 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616578 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 22:33:10.617019 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616581 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 22:33:10.617019 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616583 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 22:33:10.617019 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616586 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 22:33:10.617019 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616588 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 22:33:10.617019 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616591 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 22:33:10.617019 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616593 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 22:33:10.617019 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616596 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 22:33:10.617019 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616598 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 22:33:10.617019 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616601 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 22:33:10.617497 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616603 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 22:33:10.617497 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616606 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 22:33:10.617497 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616609 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 22:33:10.617497 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616611 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 22:33:10.617497 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616613 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 22:33:10.617497 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616617 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 22:33:10.617497 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616619 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 22:33:10.617497 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616622 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 22:33:10.617497 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616624 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 22:33:10.617497 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616626 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 22:33:10.617497 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616629 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 22:33:10.617497 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616631 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 22:33:10.617497 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616633 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 22:33:10.617497 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616636 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 22:33:10.617497 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616639 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 22:33:10.617497 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616642 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 22:33:10.617497 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616645 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 22:33:10.617497 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616647 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 22:33:10.617497 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616650 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 22:33:10.617497 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616652 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 22:33:10.617995 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616654 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 22:33:10.617995 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616657 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 22:33:10.617995 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616660 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 22:33:10.617995 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616662 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 22:33:10.617995 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616665 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 22:33:10.617995 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616667 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 22:33:10.617995 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616670 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 22:33:10.617995 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616672 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 22:33:10.617995 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616675 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 22:33:10.617995 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616677 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 22:33:10.617995 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616679 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 22:33:10.617995 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616682 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 22:33:10.617995 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616684 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 22:33:10.617995 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616687 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 22:33:10.617995 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616689 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 22:33:10.617995 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616691 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 22:33:10.617995 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616694 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 22:33:10.617995 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616696 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 22:33:10.617995 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616699 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 22:33:10.617995 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616701 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 22:33:10.618553 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616703 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 22:33:10.618553 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616706 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 22:33:10.618553 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616708 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 22:33:10.618553 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616710 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 22:33:10.618553 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616713 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 22:33:10.618553 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616715 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 22:33:10.618553 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616718 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 22:33:10.618553 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616721 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 22:33:10.618553 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616724 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 22:33:10.618553 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616726 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 22:33:10.618553 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616729 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 22:33:10.618553 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616731 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 22:33:10.618553 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616734 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 22:33:10.618553 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616736 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 22:33:10.618553 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616738 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 22:33:10.618553 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616741 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 22:33:10.618553 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616743 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 22:33:10.618553 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616745 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 22:33:10.618553 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.616748 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 22:33:10.618553 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617487 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 22:33:10.619045 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617494 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 22:33:10.619045 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617496 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 22:33:10.619045 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617499 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 22:33:10.619045 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617502 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 22:33:10.619045 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617508 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 22:33:10.619045 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617512 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 22:33:10.619045 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617514 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 22:33:10.619045 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617517 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 22:33:10.619045 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617519 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 22:33:10.619045 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617522 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 22:33:10.619045 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617524 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 22:33:10.619045 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617527 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 22:33:10.619045 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617529 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 22:33:10.619045 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617532 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 22:33:10.619045 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617534 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 22:33:10.619045 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617536 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 22:33:10.619045 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617539 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 22:33:10.619045 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617541 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 22:33:10.619045 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617545 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 22:33:10.619045 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617548 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 22:33:10.619539 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617550 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 22:33:10.619539 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617553 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 22:33:10.619539 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617556 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 22:33:10.619539 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617558 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 22:33:10.619539 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617563 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 22:33:10.619539 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617567 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 22:33:10.619539 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617570 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 22:33:10.619539 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617572 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 22:33:10.619539 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617575 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 22:33:10.619539 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617578 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 22:33:10.619539 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617580 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 22:33:10.619539 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617583 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 22:33:10.619539 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617586 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 22:33:10.619539 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617589 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 22:33:10.619539 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617591 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 22:33:10.619539 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617594 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 22:33:10.619539 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617596 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 22:33:10.619539 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617599 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 22:33:10.619539 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617601 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 22:33:10.619539 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617605 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 22:33:10.620046 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617607 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 22:33:10.620046 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617610 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 22:33:10.620046 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617612 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 22:33:10.620046 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617615 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 22:33:10.620046 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617618 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 22:33:10.620046 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617621 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 22:33:10.620046 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617623 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 22:33:10.620046 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617625 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 22:33:10.620046 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617628 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 22:33:10.620046 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617631 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 22:33:10.620046 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617633 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 22:33:10.620046 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617636 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 22:33:10.620046 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617638 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 22:33:10.620046 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617641 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 22:33:10.620046 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617643 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 22:33:10.620046 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617646 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 22:33:10.620046 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617649 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 22:33:10.620046 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617652 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 22:33:10.620046 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617654 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 22:33:10.620046 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617656 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 22:33:10.620533 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617659 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 22:33:10.620533 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617662 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 22:33:10.620533 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617664 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 22:33:10.620533 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617668 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 22:33:10.620533 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617671 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 22:33:10.620533 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617674 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 22:33:10.620533 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617677 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 22:33:10.620533 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617680 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 22:33:10.620533 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617682 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 22:33:10.620533 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617685 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 22:33:10.620533 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617688 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 22:33:10.620533 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617692 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 15 22:33:10.620533 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617696 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 22:33:10.620533 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617698 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 22:33:10.620533 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617701 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 22:33:10.620533 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617703 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 22:33:10.620533 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617706 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 22:33:10.620533 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617708 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 22:33:10.620533 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617711 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 22:33:10.621020 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617713 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 22:33:10.621020 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617715 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 22:33:10.621020 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617718 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 22:33:10.621020 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617720 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 22:33:10.621020 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617723 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 22:33:10.621020 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617726 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 22:33:10.621020 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617729 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 22:33:10.621020 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617731 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 22:33:10.621020 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617734 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 22:33:10.621020 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617736 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 22:33:10.621020 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617739 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 22:33:10.621020 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617741 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 22:33:10.621020 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617743 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 22:33:10.621020 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617746 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 22:33:10.621020 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617748 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 22:33:10.621020 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617751 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 22:33:10.621020 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617753 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 22:33:10.621020 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617756 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 22:33:10.621020 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.617758 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 22:33:10.621020 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618147 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 22:33:10.621515 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618152 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 22:33:10.621515 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618155 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 22:33:10.621515 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618158 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 22:33:10.621515 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618162 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 22:33:10.621515 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618166 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 22:33:10.621515 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618168 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 22:33:10.621515 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618171 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 22:33:10.621515 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618174 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 22:33:10.621515 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618177 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 22:33:10.621515 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618179 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 22:33:10.621515 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618182 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 22:33:10.621515 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618184 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 22:33:10.621515 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618187 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 22:33:10.621515 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618189 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 22:33:10.621515 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618192 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 22:33:10.621515 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618195 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 22:33:10.621515 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618197 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 22:33:10.621515 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618200 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 22:33:10.621515 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618202 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 22:33:10.621515 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618205 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 15 22:33:10.621515 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618207 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 22:33:10.622022 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618210 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 22:33:10.622022 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618212 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 22:33:10.622022 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618215 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 22:33:10.622022 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618217 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 22:33:10.622022 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618220 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 22:33:10.622022 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618222 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 22:33:10.622022 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618225 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 22:33:10.622022 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618227 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 22:33:10.622022 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618229 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 22:33:10.622022 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618232 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 22:33:10.622022 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618234 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 22:33:10.622022 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618236 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 22:33:10.622022 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618239 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 22:33:10.622022 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618241 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 22:33:10.622022 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618244 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 22:33:10.622022 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618248 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 22:33:10.622022 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618250 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 22:33:10.622022 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618253 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 22:33:10.622022 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618255 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 22:33:10.622022 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618258 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 22:33:10.622512 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618262 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 22:33:10.622512 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618266 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 22:33:10.622512 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618269 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 22:33:10.622512 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618272 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 22:33:10.622512 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618275 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 22:33:10.622512 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618277 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 22:33:10.622512 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618281 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 22:33:10.622512 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618284 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 22:33:10.622512 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618287 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 22:33:10.622512 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618290 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 22:33:10.622512 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618292 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 22:33:10.622512 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618295 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 22:33:10.622512 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618297 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 22:33:10.622512 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618299 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 22:33:10.622512 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618302 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 22:33:10.622512 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618305 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 22:33:10.622512 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618307 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 22:33:10.622512 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618309 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 22:33:10.622512 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618312 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 22:33:10.622512 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618314 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 22:33:10.623035 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618317 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 22:33:10.623035 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618319 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 22:33:10.623035 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618322 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 22:33:10.623035 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618324 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 22:33:10.623035 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618326 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 22:33:10.623035 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618329 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 22:33:10.623035 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618332 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 22:33:10.623035 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618335 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 22:33:10.623035 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618338 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 22:33:10.623035 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618341 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 22:33:10.623035 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618344 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 22:33:10.623035 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618346 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 22:33:10.623035 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618349 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 22:33:10.623035 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618351 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 22:33:10.623035 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618354 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 22:33:10.623035 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618356 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 22:33:10.623035 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618359 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 22:33:10.623035 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618361 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 22:33:10.623035 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618365 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 22:33:10.623493 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618367 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 22:33:10.623493 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618370 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 22:33:10.623493 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618372 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 22:33:10.623493 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618376 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 22:33:10.623493 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618380 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 22:33:10.623493 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618383 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 22:33:10.623493 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618385 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 22:33:10.623493 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618388 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 22:33:10.623493 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618391 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 22:33:10.623493 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618394 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 22:33:10.623493 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618397 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 22:33:10.623493 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618401 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 22:33:10.623493 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618403 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 22:33:10.623493 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618406 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 22:33:10.623493 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618408 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 22:33:10.623493 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618410 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 22:33:10.623493 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618413 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 22:33:10.623493 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.618415 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 22:33:10.623493 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618496 2560 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 22:33:10.623991 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618507 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 22:33:10.623991 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618517 2560 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 22:33:10.623991 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618524 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 22:33:10.623991 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618532 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 22:33:10.623991 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618535 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 22:33:10.623991 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618539 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 22:33:10.623991 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618543 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 22:33:10.623991 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618546 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 22:33:10.623991 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618549 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 22:33:10.623991 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618552 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 22:33:10.623991 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618555 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 22:33:10.623991 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618558 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 22:33:10.623991 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618562 2560 flags.go:64] FLAG: --cgroup-root="" Jul 15 22:33:10.623991 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618565 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 22:33:10.623991 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618568 2560 flags.go:64] FLAG: --client-ca-file="" Jul 15 22:33:10.623991 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618571 2560 flags.go:64] FLAG: --cloud-provider="external" Jul 15 22:33:10.623991 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618573 2560 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 22:33:10.623991 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618578 2560 flags.go:64] FLAG: --cluster-domain="" Jul 15 22:33:10.623991 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618582 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 22:33:10.623991 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618585 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 22:33:10.623991 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618588 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 22:33:10.623991 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618591 2560 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 22:33:10.623991 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618595 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 22:33:10.623991 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618598 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618601 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618604 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618607 2560 flags.go:64] FLAG: --contention-profiling="false" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618610 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618612 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618615 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618618 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618622 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618624 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618628 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618630 2560 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618633 2560 flags.go:64] FLAG: --enable-server="true" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618636 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618641 2560 flags.go:64] FLAG: --event-burst="100" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618643 2560 flags.go:64] FLAG: --event-qps="50" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618646 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618649 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618651 2560 flags.go:64] FLAG: --eviction-hard="" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618655 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618658 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618661 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618664 2560 flags.go:64] FLAG: --eviction-soft="" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618667 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618669 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 22:33:10.624615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618672 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 22:33:10.625246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618689 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 22:33:10.625246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618692 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 22:33:10.625246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618696 2560 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 22:33:10.625246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618698 2560 flags.go:64] FLAG: --feature-gates="" Jul 15 22:33:10.625246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618702 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 22:33:10.625246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618705 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 22:33:10.625246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618708 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 22:33:10.625246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618711 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 22:33:10.625246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618714 2560 flags.go:64] FLAG: --healthz-port="10248" Jul 15 22:33:10.625246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618716 2560 flags.go:64] FLAG: --help="false" Jul 15 22:33:10.625246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618719 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-132-45.ec2.internal" Jul 15 22:33:10.625246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618722 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 22:33:10.625246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618725 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 22:33:10.625246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618727 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 22:33:10.625246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618731 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 22:33:10.625246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618734 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 22:33:10.625246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618737 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 22:33:10.625246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618741 2560 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 22:33:10.625246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618744 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 22:33:10.625246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618747 2560 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 22:33:10.625246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618750 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 22:33:10.625246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618753 2560 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 22:33:10.625246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618756 2560 flags.go:64] FLAG: --kube-reserved="" Jul 15 22:33:10.625246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618759 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618762 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618765 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618767 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618770 2560 flags.go:64] FLAG: --lock-file="" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618773 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618776 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618779 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618784 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618786 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618789 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618792 2560 flags.go:64] FLAG: --logging-format="text" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618794 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618797 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618800 2560 flags.go:64] FLAG: --manifest-url="" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618803 2560 flags.go:64] FLAG: --manifest-url-header="" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618807 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618810 2560 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618814 2560 flags.go:64] FLAG: --max-pods="110" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618816 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618819 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618822 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618825 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618828 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618830 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 22:33:10.625840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618833 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618840 2560 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618843 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618846 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618862 2560 flags.go:64] FLAG: --pod-cidr="" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618865 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618870 2560 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618873 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618876 2560 flags.go:64] FLAG: --pods-per-core="0" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618879 2560 flags.go:64] FLAG: --port="10250" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618882 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618885 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09cb8c5c2a97cad44" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618888 2560 flags.go:64] FLAG: --qos-reserved="" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618891 2560 flags.go:64] FLAG: --read-only-port="10255" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618893 2560 flags.go:64] FLAG: --register-node="true" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618896 2560 flags.go:64] FLAG: --register-with-taints="" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618902 2560 flags.go:64] FLAG: --registry-burst="10" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618905 2560 flags.go:64] FLAG: --registry-qps="5" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618908 2560 flags.go:64] FLAG: --reserved-cpus="" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618910 2560 flags.go:64] FLAG: --reserved-memory="" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618914 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618916 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618919 2560 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618922 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618925 2560 flags.go:64] FLAG: --runonce="false" Jul 15 22:33:10.626468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618927 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618930 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618933 2560 flags.go:64] FLAG: --seccomp-default="false" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618936 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618938 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618941 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618944 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618947 2560 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618949 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618952 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618956 2560 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618959 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618962 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618965 2560 flags.go:64] FLAG: --system-cgroups="" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618968 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618973 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618976 2560 flags.go:64] FLAG: --tls-cert-file="" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618979 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618983 2560 flags.go:64] FLAG: --tls-min-version="" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618986 2560 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618989 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618992 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618994 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.618997 2560 flags.go:64] FLAG: --v="2" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.619001 2560 flags.go:64] FLAG: --version="false" Jul 15 22:33:10.627080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.619005 2560 flags.go:64] FLAG: --vmodule="" Jul 15 22:33:10.627709 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.619008 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 22:33:10.627709 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.619012 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 22:33:10.627709 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619125 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 22:33:10.627709 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619129 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 22:33:10.627709 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619132 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 22:33:10.627709 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619134 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 22:33:10.627709 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619137 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 22:33:10.627709 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619139 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 22:33:10.627709 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619142 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 22:33:10.627709 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619145 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 22:33:10.627709 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619149 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 22:33:10.627709 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619151 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 22:33:10.627709 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619154 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 22:33:10.627709 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619157 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 22:33:10.627709 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619159 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 22:33:10.627709 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619162 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 22:33:10.627709 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619167 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 22:33:10.627709 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619170 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 22:33:10.627709 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619173 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 22:33:10.627709 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619176 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 22:33:10.628222 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619178 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 22:33:10.628222 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619181 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 22:33:10.628222 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619184 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 22:33:10.628222 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619186 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 22:33:10.628222 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619189 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 22:33:10.628222 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619191 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 22:33:10.628222 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619193 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 22:33:10.628222 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619196 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 22:33:10.628222 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619198 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 22:33:10.628222 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619201 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 22:33:10.628222 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619203 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 22:33:10.628222 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619206 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 22:33:10.628222 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619208 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 22:33:10.628222 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619211 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 22:33:10.628222 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619213 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 22:33:10.628222 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619216 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 22:33:10.628222 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619218 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 22:33:10.628222 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619221 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 22:33:10.628222 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619223 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 22:33:10.628222 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619225 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 22:33:10.628691 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619227 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 22:33:10.628691 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619230 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 22:33:10.628691 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619233 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 22:33:10.628691 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619236 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 15 22:33:10.628691 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619238 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 22:33:10.628691 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619241 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 22:33:10.628691 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619243 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 22:33:10.628691 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619245 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 22:33:10.628691 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619249 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 22:33:10.628691 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619252 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 22:33:10.628691 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619255 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 22:33:10.628691 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619257 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 22:33:10.628691 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619259 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 22:33:10.628691 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619262 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 22:33:10.628691 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619265 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 22:33:10.628691 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619267 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 22:33:10.628691 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619270 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 22:33:10.628691 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619272 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 22:33:10.628691 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619274 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 22:33:10.628691 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619277 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 22:33:10.629182 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619279 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 22:33:10.629182 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619283 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 22:33:10.629182 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619286 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 22:33:10.629182 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619288 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 22:33:10.629182 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619291 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 22:33:10.629182 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619294 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 22:33:10.629182 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619296 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 22:33:10.629182 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619298 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 22:33:10.629182 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619302 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 22:33:10.629182 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619305 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 22:33:10.629182 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619308 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 22:33:10.629182 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619311 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 22:33:10.629182 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619314 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 22:33:10.629182 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619317 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 22:33:10.629182 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619321 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 22:33:10.629182 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619324 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 22:33:10.629182 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619326 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 22:33:10.629182 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619329 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 22:33:10.629182 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619331 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 22:33:10.629638 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619334 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 22:33:10.629638 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619337 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 22:33:10.629638 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619340 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 22:33:10.629638 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619342 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 22:33:10.629638 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619345 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 22:33:10.629638 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619347 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 22:33:10.629638 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619350 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 22:33:10.629638 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619352 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 22:33:10.629638 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619355 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 22:33:10.629638 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619358 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 22:33:10.629638 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619360 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 22:33:10.629638 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619362 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 22:33:10.629638 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619365 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 22:33:10.629638 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619367 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 22:33:10.629638 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619370 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 22:33:10.629638 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619373 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 22:33:10.629638 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619375 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 22:33:10.629638 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619377 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 22:33:10.629638 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619380 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 22:33:10.629638 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619382 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 22:33:10.630141 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619384 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 22:33:10.630141 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.619387 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 22:33:10.630141 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.620143 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 22:33:10.630141 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.627133 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 22:33:10.630141 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.627147 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 22:33:10.630141 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.627976 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 22:33:10.630141 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.627983 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 22:33:10.630141 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628053 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 22:33:10.630141 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628059 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 22:33:10.630141 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628062 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 22:33:10.630141 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628065 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 22:33:10.630141 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628068 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 22:33:10.630141 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628071 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 22:33:10.630141 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628074 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 22:33:10.630141 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628077 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 22:33:10.630517 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628080 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 22:33:10.630517 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628082 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 22:33:10.630517 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628085 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 22:33:10.630517 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628088 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 22:33:10.630517 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628091 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 22:33:10.630517 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628094 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 22:33:10.630517 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628096 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 22:33:10.630517 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628101 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 22:33:10.630517 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628104 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 22:33:10.630517 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628108 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 22:33:10.630517 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628111 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 22:33:10.630517 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628114 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 22:33:10.630517 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628117 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 22:33:10.630517 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628119 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 22:33:10.630517 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628122 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 22:33:10.630517 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628125 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 22:33:10.630517 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628128 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 22:33:10.630517 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628130 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 22:33:10.630517 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628133 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 22:33:10.630517 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628135 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 22:33:10.631024 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628138 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 22:33:10.631024 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628141 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 22:33:10.631024 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628144 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 22:33:10.631024 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628147 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 22:33:10.631024 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628149 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 22:33:10.631024 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628152 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 22:33:10.631024 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628155 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 22:33:10.631024 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628157 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 22:33:10.631024 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628160 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 22:33:10.631024 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628162 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 22:33:10.631024 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628165 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 22:33:10.631024 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628167 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 22:33:10.631024 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628170 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 22:33:10.631024 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628172 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 22:33:10.631024 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628175 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 22:33:10.631024 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628177 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 22:33:10.631024 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628179 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 22:33:10.631024 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628182 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 22:33:10.631024 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628185 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 22:33:10.631024 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628187 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 22:33:10.631499 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628190 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 22:33:10.631499 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628192 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 22:33:10.631499 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628195 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 22:33:10.631499 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628198 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 22:33:10.631499 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628200 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 22:33:10.631499 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628203 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 22:33:10.631499 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628205 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 22:33:10.631499 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628208 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 22:33:10.631499 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628210 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 22:33:10.631499 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628213 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 22:33:10.631499 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628215 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 22:33:10.631499 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628218 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 22:33:10.631499 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628220 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 22:33:10.631499 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628224 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 22:33:10.631499 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628227 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 22:33:10.631499 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628230 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 22:33:10.631499 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628233 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 22:33:10.631499 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628235 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 22:33:10.631499 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628238 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 22:33:10.631976 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628241 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 22:33:10.631976 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628243 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 22:33:10.631976 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628246 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 22:33:10.631976 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628248 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 22:33:10.631976 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628251 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 22:33:10.631976 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628254 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 22:33:10.631976 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628256 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 22:33:10.631976 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628259 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 22:33:10.631976 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628261 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 22:33:10.631976 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628263 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 22:33:10.631976 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628266 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 22:33:10.631976 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628269 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 22:33:10.631976 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628271 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 22:33:10.631976 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628274 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 22:33:10.631976 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628276 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 22:33:10.631976 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628278 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 22:33:10.631976 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628282 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 22:33:10.631976 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628285 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 22:33:10.631976 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628288 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 22:33:10.632446 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628291 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 22:33:10.632446 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628295 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 22:33:10.632446 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628299 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 22:33:10.632446 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628301 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 22:33:10.632446 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628304 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 22:33:10.632446 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628307 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 22:33:10.632446 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628309 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 22:33:10.632446 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628312 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 22:33:10.632446 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628315 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 15 22:33:10.632446 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628318 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 22:33:10.632446 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628320 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 22:33:10.632446 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628323 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 22:33:10.632446 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628325 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 22:33:10.632446 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.628330 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 22:33:10.632446 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628437 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 22:33:10.632796 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628442 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 22:33:10.632796 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628445 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 22:33:10.632796 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628449 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 22:33:10.632796 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628452 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 22:33:10.632796 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628455 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 22:33:10.632796 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628458 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 22:33:10.632796 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628460 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 22:33:10.632796 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628463 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 22:33:10.632796 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628465 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 22:33:10.632796 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628468 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 22:33:10.632796 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628471 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 22:33:10.632796 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628473 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 22:33:10.632796 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628476 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 22:33:10.632796 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628478 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 22:33:10.632796 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628481 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 22:33:10.632796 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628484 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 15 22:33:10.632796 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628486 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 22:33:10.632796 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628489 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 22:33:10.632796 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628491 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 22:33:10.633257 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628494 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 22:33:10.633257 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628496 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 22:33:10.633257 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628498 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 22:33:10.633257 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628501 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 22:33:10.633257 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628503 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 22:33:10.633257 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628505 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 22:33:10.633257 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628508 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 22:33:10.633257 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628511 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 22:33:10.633257 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628513 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 22:33:10.633257 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628517 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 22:33:10.633257 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628520 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 22:33:10.633257 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628523 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 22:33:10.633257 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628525 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 22:33:10.633257 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628528 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 22:33:10.633257 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628530 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 22:33:10.633257 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628533 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 22:33:10.633257 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628535 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 22:33:10.633257 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628537 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 22:33:10.633257 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628540 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 22:33:10.633257 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628542 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 22:33:10.633743 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628545 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 22:33:10.633743 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628547 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 22:33:10.633743 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628550 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 22:33:10.633743 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628553 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 22:33:10.633743 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628557 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 22:33:10.633743 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628559 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 22:33:10.633743 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628562 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 22:33:10.633743 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628565 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 22:33:10.633743 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628567 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 22:33:10.633743 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628570 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 22:33:10.633743 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628572 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 22:33:10.633743 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628575 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 22:33:10.633743 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628577 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 22:33:10.633743 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628580 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 22:33:10.633743 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628582 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 22:33:10.633743 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628585 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 22:33:10.633743 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628587 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 22:33:10.633743 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628589 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 22:33:10.633743 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628592 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 22:33:10.634211 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628594 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 22:33:10.634211 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628596 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 22:33:10.634211 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628599 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 22:33:10.634211 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628601 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 22:33:10.634211 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628603 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 22:33:10.634211 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628606 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 22:33:10.634211 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628608 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 22:33:10.634211 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628611 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 22:33:10.634211 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628613 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 22:33:10.634211 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628615 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 22:33:10.634211 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628618 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 22:33:10.634211 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628620 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 22:33:10.634211 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628622 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 22:33:10.634211 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628625 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 22:33:10.634211 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628627 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 22:33:10.634211 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628629 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 22:33:10.634211 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628632 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 22:33:10.634211 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628634 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 22:33:10.634211 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628637 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 22:33:10.634211 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628639 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 22:33:10.634685 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628642 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 22:33:10.634685 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628644 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 22:33:10.634685 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628646 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 22:33:10.634685 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628649 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 22:33:10.634685 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628651 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 22:33:10.634685 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628653 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 22:33:10.634685 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628656 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 22:33:10.634685 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628658 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 22:33:10.634685 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628660 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 22:33:10.634685 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628663 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 22:33:10.634685 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628665 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 22:33:10.634685 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628668 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 22:33:10.634685 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628670 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 22:33:10.634685 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628672 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 22:33:10.634685 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628674 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 22:33:10.634685 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628677 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 22:33:10.634685 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628679 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 22:33:10.634685 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628682 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 22:33:10.634685 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628684 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 22:33:10.634685 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:10.628686 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 22:33:10.635354 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.628691 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 22:33:10.635354 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.628782 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 22:33:10.635354 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.631041 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 22:33:10.635354 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.632537 2560 server.go:1019] "Starting client certificate rotation" Jul 15 22:33:10.635354 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.632639 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 22:33:10.635354 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.633453 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 22:33:10.635354 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.635268 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 22:33:10.639665 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.639633 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 22:33:10.653465 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.653447 2560 log.go:25] "Validated CRI v1 runtime API" Jul 15 22:33:10.655800 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.655783 2560 log.go:25] "Validated CRI v1 image API" Jul 15 22:33:10.656694 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.656681 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 22:33:10.659131 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.659114 2560 fs.go:135] Filesystem UUIDs: map[5b4e1fec-f454-4880-8e17-ebe7fd21d7bc:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 faa6614f-cc89-4b1c-ac90-f6bdbbda596e:/dev/nvme0n1p3] Jul 15 22:33:10.659178 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.659132 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 22:33:10.664239 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.664107 2560 manager.go:216] Machine: {Timestamp:2026-07-15 22:33:10.662756474 +0000 UTC m=+0.370554075 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101889 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec248e8827b90a3a1db1f464281e88b3 SystemUUID:ec248e88-27b9-0a3a-1db1-f464281e88b3 BootID:ca63bf66-00cc-4605-ad57-60a5943b59b3 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1e:a8:18:20:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1e:a8:18:20:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:b1:ed:1f:5c:18 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 22:33:10.664239 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.664235 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 22:33:10.664372 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.664339 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 22:33:10.667641 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.667609 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 22:33:10.667779 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.667644 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-45.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 22:33:10.668388 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.668376 2560 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 22:33:10.668422 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.668392 2560 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 22:33:10.668422 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.668403 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 22:33:10.668422 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.668417 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 22:33:10.669517 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.669507 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 22:33:10.670639 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.670622 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 22:33:10.673027 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.673015 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 15 22:33:10.673141 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.673132 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 22:33:10.673177 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.673163 2560 kubelet.go:486] "Attempting to sync node with API server" Jul 15 22:33:10.673177 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.673176 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 22:33:10.673227 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.673187 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 22:33:10.673227 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.673196 2560 kubelet.go:398] "Adding apiserver pod source" Jul 15 22:33:10.673227 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.673205 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 22:33:10.673595 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.673571 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 22:33:10.673595 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.673590 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 22:33:10.676827 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.676811 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 22:33:10.678985 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.678969 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 22:33:10.679061 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.679008 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 22:33:10.679841 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.679827 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 22:33:10.679920 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.679866 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 22:33:10.679920 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.679876 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 22:33:10.679920 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.679884 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 22:33:10.679920 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.679898 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 22:33:10.679920 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.679907 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 22:33:10.679920 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.679918 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 22:33:10.680137 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.679926 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 22:33:10.680137 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.679936 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 22:33:10.680137 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.679950 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 22:33:10.680137 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.679969 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 22:33:10.680137 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.679978 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 22:33:10.680881 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.680870 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 22:33:10.680938 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.680885 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 22:33:10.684053 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.684037 2560 server.go:1268] "Started kubelet" Jul 15 22:33:10.684135 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.684098 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 22:33:10.684135 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.684111 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 22:33:10.688606 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.688405 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 22:33:10.688729 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.688711 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-45.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 22:33:10.688896 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:10.688874 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-45.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 22:33:10.689158 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:10.689113 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 22:33:10.689206 ip-10-0-132-45 systemd[1]: Started Kubernetes Kubelet. Jul 15 22:33:10.691426 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.690788 2560 server.go:310] "Adding debug handlers to kubelet server" Jul 15 22:33:10.693668 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.693649 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 22:33:10.694364 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:10.693268 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-45.ec2.internal.18c297544b08119b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-45.ec2.internal,UID:ip-10-0-132-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-45.ec2.internal,},FirstTimestamp:2026-07-15 22:33:10.684004763 +0000 UTC m=+0.391802346,LastTimestamp:2026-07-15 22:33:10.684004763 +0000 UTC m=+0.391802346,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-45.ec2.internal,}" Jul 15 22:33:10.695269 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:10.695248 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 22:33:10.700899 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.700882 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 22:33:10.700899 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.700896 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 22:33:10.701100 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:10.701082 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found" Jul 15 22:33:10.701754 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.701738 2560 factory.go:55] Registering systemd factory Jul 15 22:33:10.701877 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.701865 2560 factory.go:223] Registration of the systemd container factory successfully Jul 15 22:33:10.701995 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.701712 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 22:33:10.701995 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.701996 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 22:33:10.702171 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.701899 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 22:33:10.702171 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.702065 2560 reconstruct.go:97] "Volume reconstruction finished" Jul 15 22:33:10.702171 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.702075 2560 reconciler.go:29] "Reconciler: start to sync state" Jul 15 22:33:10.702380 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.702325 2560 factory.go:153] Registering CRI-O factory Jul 15 22:33:10.702380 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.702343 2560 factory.go:223] Registration of the crio container factory successfully Jul 15 22:33:10.702508 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.702386 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 22:33:10.702508 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.702405 2560 factory.go:103] Registering Raw factory Jul 15 22:33:10.702508 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.702417 2560 manager.go:1196] Started watching for new ooms in manager Jul 15 22:33:10.703751 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.703735 2560 manager.go:349] Starting recovery of all containers Jul 15 22:33:10.711581 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.711421 2560 manager.go:354] Recovery completed Jul 15 22:33:10.712218 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:10.711537 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 22:33:10.712218 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:10.711582 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-45.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 22:33:10.713446 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:10.713426 2560 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 15 22:33:10.717278 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.717264 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 22:33:10.719093 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.719061 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientMemory" Jul 15 22:33:10.719168 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.719112 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 22:33:10.719168 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.719128 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientPID" Jul 15 22:33:10.719676 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.719663 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 22:33:10.719746 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.719674 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 22:33:10.719746 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.719676 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 22:33:10.719746 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.719735 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 15 22:33:10.720358 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.720344 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientMemory" Jul 15 22:33:10.720408 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.720371 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 22:33:10.720408 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.720388 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientPID" Jul 15 22:33:10.721016 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.721004 2560 policy_none.go:49] "None policy: Start" Jul 15 22:33:10.721058 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.721026 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 22:33:10.721058 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.721036 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 22:33:10.722102 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.722091 2560 policy_none.go:47] "Start" Jul 15 22:33:10.729369 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:10.729300 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-45.ec2.internal.18c297544d1f79df default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-45.ec2.internal,UID:ip-10-0-132-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-45.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-45.ec2.internal,},FirstTimestamp:2026-07-15 22:33:10.719093215 +0000 UTC m=+0.426890807,LastTimestamp:2026-07-15 22:33:10.719093215 +0000 UTC m=+0.426890807,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-45.ec2.internal,}" Jul 15 22:33:10.740990 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:10.740927 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-45.ec2.internal.18c297544d1fd93e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-45.ec2.internal,UID:ip-10-0-132-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-45.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-45.ec2.internal,},FirstTimestamp:2026-07-15 22:33:10.71911763 +0000 UTC m=+0.426915213,LastTimestamp:2026-07-15 22:33:10.71911763 +0000 UTC m=+0.426915213,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-45.ec2.internal,}" Jul 15 22:33:10.753432 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:10.753368 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-45.ec2.internal.18c297544d2013be default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-45.ec2.internal,UID:ip-10-0-132-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-45.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-45.ec2.internal,},FirstTimestamp:2026-07-15 22:33:10.719132606 +0000 UTC m=+0.426930188,LastTimestamp:2026-07-15 22:33:10.719132606 +0000 UTC m=+0.426930188,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-45.ec2.internal,}" Jul 15 22:33:10.760428 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.760413 2560 manager.go:337] "Starting Device Plugin manager" Jul 15 22:33:10.774529 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:10.760443 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 22:33:10.774529 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.760453 2560 server.go:87] "Starting device plugin registration server" Jul 15 22:33:10.774529 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.760754 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 22:33:10.774529 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.760764 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 22:33:10.774529 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.760824 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 22:33:10.774529 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.760914 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 22:33:10.774529 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.760923 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 22:33:10.774529 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:10.761466 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 22:33:10.774529 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:10.761506 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-45.ec2.internal\" not found" Jul 15 22:33:10.774529 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:10.767180 2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-45.ec2.internal.18c297544d1f79df\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-45.ec2.internal.18c297544d1f79df default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-45.ec2.internal,UID:ip-10-0-132-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-45.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-45.ec2.internal,},FirstTimestamp:2026-07-15 22:33:10.719093215 +0000 UTC m=+0.426890807,LastTimestamp:2026-07-15 22:33:10.720358277 +0000 UTC m=+0.428155860,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-45.ec2.internal,}" Jul 15 22:33:10.777296 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:10.777238 2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-45.ec2.internal.18c297544d1fd93e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-45.ec2.internal.18c297544d1fd93e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-45.ec2.internal,UID:ip-10-0-132-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-45.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-45.ec2.internal,},FirstTimestamp:2026-07-15 22:33:10.71911763 +0000 UTC m=+0.426915213,LastTimestamp:2026-07-15 22:33:10.720378167 +0000 UTC m=+0.428175750,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-45.ec2.internal,}" Jul 15 22:33:10.782048 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.782033 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dzhjx" Jul 15 22:33:10.788043 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:10.787966 2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-45.ec2.internal.18c297544d2013be\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-45.ec2.internal.18c297544d2013be default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-45.ec2.internal,UID:ip-10-0-132-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-45.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-45.ec2.internal,},FirstTimestamp:2026-07-15 22:33:10.719132606 +0000 UTC m=+0.426930188,LastTimestamp:2026-07-15 22:33:10.720392623 +0000 UTC m=+0.428190206,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-45.ec2.internal,}" Jul 15 22:33:10.790671 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.790655 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dzhjx" Jul 15 22:33:10.795916 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:10.795840 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-45.ec2.internal.18c297544fc1b6c2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-45.ec2.internal,UID:ip-10-0-132-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-132-45.ec2.internal,},FirstTimestamp:2026-07-15 22:33:10.763280066 +0000 UTC m=+0.471077639,LastTimestamp:2026-07-15 22:33:10.763280066 +0000 UTC m=+0.471077639,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-45.ec2.internal,}" Jul 15 22:33:10.832979 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.832942 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 22:33:10.834302 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.834284 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 22:33:10.834355 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.834333 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 22:33:10.834403 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.834362 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 22:33:10.834453 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:10.834404 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 22:33:10.843920 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.843894 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 22:33:10.860999 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.860947 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 22:33:10.862011 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.861996 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientMemory" Jul 15 22:33:10.862090 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.862027 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 22:33:10.862090 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.862037 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientPID" Jul 15 22:33:10.862090 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.862059 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-45.ec2.internal" Jul 15 22:33:10.873779 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.873755 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-45.ec2.internal" Jul 15 22:33:10.873892 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:10.873782 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-45.ec2.internal\": node \"ip-10-0-132-45.ec2.internal\" not found" Jul 15 22:33:10.896541 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:10.896516 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found" Jul 15 22:33:10.934933 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.934906 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal"] Jul 15 22:33:10.935044 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.934968 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 22:33:10.936557 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.936539 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientMemory" Jul 15 22:33:10.936650 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.936573 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 22:33:10.936650 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.936587 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientPID" Jul 15 22:33:10.938001 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.937986 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 22:33:10.938115 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.938100 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" Jul 15 22:33:10.938165 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.938129 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 22:33:10.938726 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.938711 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientMemory" Jul 15 22:33:10.938812 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.938713 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientMemory" Jul 15 22:33:10.938812 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.938741 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 22:33:10.938812 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.938754 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 22:33:10.938812 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.938759 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientPID" Jul 15 22:33:10.938812 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.938766 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientPID" Jul 15 22:33:10.940188 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.940165 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal" Jul 15 22:33:10.940288 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.940195 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 22:33:10.940825 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.940811 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientMemory" Jul 15 22:33:10.940924 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.940841 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 22:33:10.940924 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:10.940870 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientPID" Jul 15 22:33:10.960750 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:10.960722 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-45.ec2.internal\" not found" node="ip-10-0-132-45.ec2.internal" Jul 15 22:33:10.965072 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:10.965051 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-45.ec2.internal\" not found" node="ip-10-0-132-45.ec2.internal" Jul 15 22:33:10.996728 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:10.996703 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found" Jul 15 22:33:11.003992 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.003970 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc502a8ea47d4d8f1c1a1b6b929db20a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal\" (UID: \"fc502a8ea47d4d8f1c1a1b6b929db20a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" Jul 15 22:33:11.004096 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.004000 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc502a8ea47d4d8f1c1a1b6b929db20a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal\" (UID: \"fc502a8ea47d4d8f1c1a1b6b929db20a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" Jul 15 22:33:11.004096 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.004019 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d92af667d32b12b1c5e1720a5f8568a2-config\") pod \"kube-apiserver-proxy-ip-10-0-132-45.ec2.internal\" (UID: \"d92af667d32b12b1c5e1720a5f8568a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal" Jul 15 22:33:11.097231 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:11.097199 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found" Jul 15 22:33:11.104648 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.104621 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc502a8ea47d4d8f1c1a1b6b929db20a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal\" (UID: \"fc502a8ea47d4d8f1c1a1b6b929db20a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" Jul 15 22:33:11.104728 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.104675 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d92af667d32b12b1c5e1720a5f8568a2-config\") pod \"kube-apiserver-proxy-ip-10-0-132-45.ec2.internal\" (UID: \"d92af667d32b12b1c5e1720a5f8568a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal" Jul 15 22:33:11.104728 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.104693 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc502a8ea47d4d8f1c1a1b6b929db20a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal\" (UID: \"fc502a8ea47d4d8f1c1a1b6b929db20a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" Jul 15 22:33:11.104728 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.104703 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc502a8ea47d4d8f1c1a1b6b929db20a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal\" (UID: \"fc502a8ea47d4d8f1c1a1b6b929db20a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" Jul 15 22:33:11.104847 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.104750 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d92af667d32b12b1c5e1720a5f8568a2-config\") pod \"kube-apiserver-proxy-ip-10-0-132-45.ec2.internal\" (UID: \"d92af667d32b12b1c5e1720a5f8568a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal" Jul 15 22:33:11.104847 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.104759 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc502a8ea47d4d8f1c1a1b6b929db20a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal\" (UID: \"fc502a8ea47d4d8f1c1a1b6b929db20a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" Jul 15 22:33:11.198023 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:11.197960 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found" Jul 15 22:33:11.262468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.262443 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" Jul 15 22:33:11.267752 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.267735 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal" Jul 15 22:33:11.298701 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:11.298675 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found" Jul 15 22:33:11.399276 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:11.399227 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found" Jul 15 22:33:11.499824 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:11.499756 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found" Jul 15 22:33:11.595699 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.595669 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 22:33:11.600790 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:11.600771 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found" Jul 15 22:33:11.632320 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.632289 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 22:33:11.632950 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.632439 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 22:33:11.632950 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.632463 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 22:33:11.666379 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.666354 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 22:33:11.674320 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.674304 2560 apiserver.go:52] "Watching apiserver" Jul 15 22:33:11.682525 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.682501 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 22:33:11.684277 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.684255 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-km6gb","openshift-network-diagnostics/network-check-target-x64tv","openshift-network-operator/iptables-alerter-xk42n","openshift-ovn-kubernetes/ovnkube-node-f7fk4","kube-system/global-pull-secret-syncer-dvf88","kube-system/konnectivity-agent-xgqq7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5","openshift-cluster-node-tuning-operator/tuned-rgnf2","openshift-dns/node-resolver-vnktr","openshift-multus/network-metrics-daemon-qmvbm","openshift-image-registry/node-ca-jgsqh","openshift-multus/multus-additional-cni-plugins-h6wpj"] Jul 15 22:33:11.685810 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.685791 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.687012 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.686992 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:11.687088 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:11.687068 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x64tv" podUID="6fe341c4-845e-4412-a026-ea8463d7191c" Jul 15 22:33:11.688259 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.688243 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xk42n" Jul 15 22:33:11.688501 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.688370 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 22:33:11.688501 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.688387 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 22:33:11.688614 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.688508 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 22:33:11.688656 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.688628 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 22:33:11.688871 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.688840 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f2xcr\"" Jul 15 22:33:11.689802 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.689785 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.690639 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.690620 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 22:33:11.690995 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.690971 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 22:33:11.691118 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.691025 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sm94g\"" Jul 15 22:33:11.691118 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.691091 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:11.691235 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:11.691148 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvf88" podUID="23a965f4-47c0-432e-9676-53861bba6186" Jul 15 22:33:11.691316 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.691301 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 22:33:11.691616 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.691596 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 22:33:11.691710 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.691651 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k8fgx\"" Jul 15 22:33:11.692000 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.691935 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 22:33:11.692250 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.692223 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 22:33:11.692250 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.692239 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 22:33:11.692374 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.692313 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xgqq7" Jul 15 22:33:11.692459 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.692443 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 22:33:11.692516 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.692480 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 22:33:11.693656 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.693634 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" Jul 15 22:33:11.694141 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.694121 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p4dcz\"" Jul 15 22:33:11.694409 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.694392 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 22:33:11.694530 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.694514 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 22:33:11.695224 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.695158 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.695785 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.695765 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 22:33:11.696180 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.696160 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 22:33:11.696180 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.696172 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 22:33:11.696320 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.696162 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pqf7d\"" Jul 15 22:33:11.697194 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.696926 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vnktr" Jul 15 22:33:11.699299 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.697749 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dm6xr\"" Jul 15 22:33:11.699299 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.697753 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 22:33:11.699299 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.698155 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 22:33:11.699299 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.698633 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:11.699299 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:11.698714 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmvbm" podUID="ff68c09e-7343-4947-8750-7fa6e793287c" Jul 15 22:33:11.699299 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.698867 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 22:33:11.699299 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.699174 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5hwx8\"" Jul 15 22:33:11.699299 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.699249 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 22:33:11.699921 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.699680 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jgsqh" Jul 15 22:33:11.702519 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.701119 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 22:33:11.702519 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.701984 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal" Jul 15 22:33:11.702519 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.702384 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 22:33:11.702712 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.702577 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 22:33:11.702712 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.702596 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7jv2n\"" Jul 15 22:33:11.702814 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.702796 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 22:33:11.703776 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.703380 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.705649 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.705633 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x2cfq\"" Jul 15 22:33:11.705727 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.705677 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 22:33:11.705910 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.705895 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 22:33:11.708780 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.708763 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-run-systemd\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.708887 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.708793 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-host-run-netns\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.708887 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.708818 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fceccc65-d0e0-463d-a160-7224b2798647-socket-dir\") pod \"aws-ebs-csi-driver-node-kpqx5\" (UID: \"fceccc65-d0e0-463d-a160-7224b2798647\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" Jul 15 22:33:11.708887 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.708842 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnskv\" (UniqueName: \"kubernetes.io/projected/292fa64f-5495-4b75-8ac8-8d4893320cc1-kube-api-access-lnskv\") pod \"iptables-alerter-xk42n\" (UID: \"292fa64f-5495-4b75-8ac8-8d4893320cc1\") " pod="openshift-network-operator/iptables-alerter-xk42n" Jul 15 22:33:11.709046 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.708885 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/162185e2-da05-43cd-9b88-f2fa765a4a55-env-overrides\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.709046 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.708908 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/163d94d1-6930-4f2d-9fdf-3414a8d0071e-os-release\") pod \"multus-additional-cni-plugins-h6wpj\" (UID: \"163d94d1-6930-4f2d-9fdf-3414a8d0071e\") " pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.709046 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.708929 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-sys\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.709046 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.708951 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-multus-cni-dir\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.709046 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.708973 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-os-release\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.709046 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.708996 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-multus-socket-dir-parent\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.709046 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709019 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fceccc65-d0e0-463d-a160-7224b2798647-device-dir\") pod \"aws-ebs-csi-driver-node-kpqx5\" (UID: \"fceccc65-d0e0-463d-a160-7224b2798647\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" Jul 15 22:33:11.709288 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709058 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fceccc65-d0e0-463d-a160-7224b2798647-etc-selinux\") pod \"aws-ebs-csi-driver-node-kpqx5\" (UID: \"fceccc65-d0e0-463d-a160-7224b2798647\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" Jul 15 22:33:11.709288 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709082 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j84jn\" (UniqueName: \"kubernetes.io/projected/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-kube-api-access-j84jn\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.709288 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709102 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff68c09e-7343-4947-8750-7fa6e793287c-metrics-certs\") pod \"network-metrics-daemon-qmvbm\" (UID: \"ff68c09e-7343-4947-8750-7fa6e793287c\") " pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:11.709288 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709127 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/163d94d1-6930-4f2d-9fdf-3414a8d0071e-cnibin\") pod \"multus-additional-cni-plugins-h6wpj\" (UID: \"163d94d1-6930-4f2d-9fdf-3414a8d0071e\") " pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.709288 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709149 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-host-run-k8s-cni-cncf-io\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.709288 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709163 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-host-var-lib-cni-bin\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.709288 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709177 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ad4d4e81-c00a-4d74-b409-2c7ec97c3002-serviceca\") pod \"node-ca-jgsqh\" (UID: \"ad4d4e81-c00a-4d74-b409-2c7ec97c3002\") " pod="openshift-image-registry/node-ca-jgsqh" Jul 15 22:33:11.709288 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709268 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz4bx\" (UniqueName: \"kubernetes.io/projected/2909cc24-d826-42da-9d30-14a4ec63267d-kube-api-access-nz4bx\") pod \"node-resolver-vnktr\" (UID: \"2909cc24-d826-42da-9d30-14a4ec63267d\") " pod="openshift-dns/node-resolver-vnktr" Jul 15 22:33:11.709638 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709302 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/162185e2-da05-43cd-9b88-f2fa765a4a55-ovn-node-metrics-cert\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.709638 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709330 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/23a965f4-47c0-432e-9676-53861bba6186-kubelet-config\") pod \"global-pull-secret-syncer-dvf88\" (UID: \"23a965f4-47c0-432e-9676-53861bba6186\") " pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:11.709638 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709353 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c60b5390-688d-46bb-a3f8-70b746073689-agent-certs\") pod \"konnectivity-agent-xgqq7\" (UID: \"c60b5390-688d-46bb-a3f8-70b746073689\") " pod="kube-system/konnectivity-agent-xgqq7" Jul 15 22:33:11.709638 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709376 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-lib-modules\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.709638 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709396 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-hostroot\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.709638 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709418 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fceccc65-d0e0-463d-a160-7224b2798647-sys-fs\") pod \"aws-ebs-csi-driver-node-kpqx5\" (UID: \"fceccc65-d0e0-463d-a160-7224b2798647\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" Jul 15 22:33:11.709638 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709441 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad4d4e81-c00a-4d74-b409-2c7ec97c3002-host\") pod \"node-ca-jgsqh\" (UID: \"ad4d4e81-c00a-4d74-b409-2c7ec97c3002\") " pod="openshift-image-registry/node-ca-jgsqh" Jul 15 22:33:11.709638 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709470 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-host-slash\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.709638 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709489 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-host-cni-bin\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.709638 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709509 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23a965f4-47c0-432e-9676-53861bba6186-original-pull-secret\") pod \"global-pull-secret-syncer-dvf88\" (UID: \"23a965f4-47c0-432e-9676-53861bba6186\") " pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:11.709638 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709527 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-etc-systemd\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.709638 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709552 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/163d94d1-6930-4f2d-9fdf-3414a8d0071e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h6wpj\" (UID: \"163d94d1-6930-4f2d-9fdf-3414a8d0071e\") " pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.709638 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709573 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2909cc24-d826-42da-9d30-14a4ec63267d-hosts-file\") pod \"node-resolver-vnktr\" (UID: \"2909cc24-d826-42da-9d30-14a4ec63267d\") " pod="openshift-dns/node-resolver-vnktr" Jul 15 22:33:11.709638 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709589 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2drpj\" (UniqueName: \"kubernetes.io/projected/ad4d4e81-c00a-4d74-b409-2c7ec97c3002-kube-api-access-2drpj\") pod \"node-ca-jgsqh\" (UID: \"ad4d4e81-c00a-4d74-b409-2c7ec97c3002\") " pod="openshift-image-registry/node-ca-jgsqh" Jul 15 22:33:11.709638 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709616 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.709638 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709641 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-etc-sysctl-d\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.710401 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709664 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-var-lib-kubelet\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.710401 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709684 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-etc-kubernetes\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.710401 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709697 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-etc-sysctl-conf\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.710401 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709711 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26846\" (UniqueName: \"kubernetes.io/projected/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-kube-api-access-26846\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.710401 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709731 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/163d94d1-6930-4f2d-9fdf-3414a8d0071e-cni-binary-copy\") pod \"multus-additional-cni-plugins-h6wpj\" (UID: \"163d94d1-6930-4f2d-9fdf-3414a8d0071e\") " pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.710401 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709764 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-system-cni-dir\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.710401 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709782 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-cnibin\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.710401 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709803 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt4q4\" (UniqueName: \"kubernetes.io/projected/162185e2-da05-43cd-9b88-f2fa765a4a55-kube-api-access-jt4q4\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.710401 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709821 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/292fa64f-5495-4b75-8ac8-8d4893320cc1-iptables-alerter-script\") pod \"iptables-alerter-xk42n\" (UID: \"292fa64f-5495-4b75-8ac8-8d4893320cc1\") " pod="openshift-network-operator/iptables-alerter-xk42n" Jul 15 22:33:11.710401 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709843 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-host-cni-netd\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.710401 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709892 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-etc-sysconfig\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.710401 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709914 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-tmp\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.710401 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709935 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjw7v\" (UniqueName: \"kubernetes.io/projected/ff68c09e-7343-4947-8750-7fa6e793287c-kube-api-access-gjw7v\") pod \"network-metrics-daemon-qmvbm\" (UID: \"ff68c09e-7343-4947-8750-7fa6e793287c\") " pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:11.710401 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709953 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/163d94d1-6930-4f2d-9fdf-3414a8d0071e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h6wpj\" (UID: \"163d94d1-6930-4f2d-9fdf-3414a8d0071e\") " pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.710401 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709976 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-etc-openvswitch\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.710401 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.709999 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-node-log\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.711085 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710069 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-host-run-ovn-kubernetes\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.711085 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710087 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-etc-kubernetes\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.711085 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710101 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/163d94d1-6930-4f2d-9fdf-3414a8d0071e-system-cni-dir\") pod \"multus-additional-cni-plugins-h6wpj\" (UID: \"163d94d1-6930-4f2d-9fdf-3414a8d0071e\") " pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.711085 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710115 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-multus-daemon-config\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.711085 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710135 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/162185e2-da05-43cd-9b88-f2fa765a4a55-ovnkube-script-lib\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.711085 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710183 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-run\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.711085 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710245 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-etc-tuned\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.711085 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710268 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/163d94d1-6930-4f2d-9fdf-3414a8d0071e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h6wpj\" (UID: \"163d94d1-6930-4f2d-9fdf-3414a8d0071e\") " pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.711085 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710296 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-host-run-multus-certs\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.711085 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710329 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-var-lib-openvswitch\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.711085 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710351 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c60b5390-688d-46bb-a3f8-70b746073689-konnectivity-ca\") pod \"konnectivity-agent-xgqq7\" (UID: \"c60b5390-688d-46bb-a3f8-70b746073689\") " pod="kube-system/konnectivity-agent-xgqq7" Jul 15 22:33:11.711085 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710376 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-host-var-lib-cni-multus\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.711085 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710400 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/292fa64f-5495-4b75-8ac8-8d4893320cc1-host-slash\") pod \"iptables-alerter-xk42n\" (UID: \"292fa64f-5495-4b75-8ac8-8d4893320cc1\") " pod="openshift-network-operator/iptables-alerter-xk42n" Jul 15 22:33:11.711085 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710421 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-run-openvswitch\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.711085 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710460 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-run-ovn\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.711085 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710483 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-log-socket\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.711510 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710537 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/23a965f4-47c0-432e-9676-53861bba6186-dbus\") pod \"global-pull-secret-syncer-dvf88\" (UID: \"23a965f4-47c0-432e-9676-53861bba6186\") " pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:11.711510 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710573 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-host\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.711510 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710594 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-cni-binary-copy\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.711510 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710629 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6wvs\" (UniqueName: \"kubernetes.io/projected/6fe341c4-845e-4412-a026-ea8463d7191c-kube-api-access-m6wvs\") pod \"network-check-target-x64tv\" (UID: \"6fe341c4-845e-4412-a026-ea8463d7191c\") " pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:11.711510 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710655 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/162185e2-da05-43cd-9b88-f2fa765a4a55-ovnkube-config\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.711510 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710687 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fceccc65-d0e0-463d-a160-7224b2798647-registration-dir\") pod \"aws-ebs-csi-driver-node-kpqx5\" (UID: \"fceccc65-d0e0-463d-a160-7224b2798647\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" Jul 15 22:33:11.711510 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710727 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2909cc24-d826-42da-9d30-14a4ec63267d-tmp-dir\") pod \"node-resolver-vnktr\" (UID: \"2909cc24-d826-42da-9d30-14a4ec63267d\") " pod="openshift-dns/node-resolver-vnktr" Jul 15 22:33:11.711510 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710751 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-host-kubelet\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.711510 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710775 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-systemd-units\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.711510 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710797 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-multus-conf-dir\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.711510 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710843 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fceccc65-d0e0-463d-a160-7224b2798647-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kpqx5\" (UID: \"fceccc65-d0e0-463d-a160-7224b2798647\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" Jul 15 22:33:11.711510 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710890 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-etc-modprobe-d\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.711510 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710935 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nz6s\" (UniqueName: \"kubernetes.io/projected/163d94d1-6930-4f2d-9fdf-3414a8d0071e-kube-api-access-6nz6s\") pod \"multus-additional-cni-plugins-h6wpj\" (UID: \"163d94d1-6930-4f2d-9fdf-3414a8d0071e\") " pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.711510 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710959 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-host-var-lib-kubelet\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.711510 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710981 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrgrm\" (UniqueName: \"kubernetes.io/projected/fceccc65-d0e0-463d-a160-7224b2798647-kube-api-access-xrgrm\") pod \"aws-ebs-csi-driver-node-kpqx5\" (UID: \"fceccc65-d0e0-463d-a160-7224b2798647\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" Jul 15 22:33:11.711510 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.710996 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-host-run-netns\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.713773 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.713756 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal"] Jul 15 22:33:11.714240 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.714215 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 22:33:11.714305 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.714295 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" Jul 15 22:33:11.716980 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.716957 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 22:33:11.725391 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.725346 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal"] Jul 15 22:33:11.725479 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.725389 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 22:33:11.742988 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.742971 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xtvng" Jul 15 22:33:11.753781 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.753755 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xtvng" Jul 15 22:33:11.797536 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.797486 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 22:28:11 +0000 UTC" deadline="2028-02-08 19:29:35.951288751 +0000 UTC" Jul 15 22:33:11.797618 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.797536 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13748h56m24.153756823s" Jul 15 22:33:11.803323 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.803301 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 22:33:11.805261 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:11.805233 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd92af667d32b12b1c5e1720a5f8568a2.slice/crio-46730c1b4834a3973f4587bf6b2b3e865304ae6dcebb6ff3a9463f74e59e95fc WatchSource:0}: Error finding container 46730c1b4834a3973f4587bf6b2b3e865304ae6dcebb6ff3a9463f74e59e95fc: Status 404 returned error can't find the container with id 46730c1b4834a3973f4587bf6b2b3e865304ae6dcebb6ff3a9463f74e59e95fc Jul 15 22:33:11.805574 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:11.805550 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc502a8ea47d4d8f1c1a1b6b929db20a.slice/crio-0cf2c6bc19971881e47212efcb1948cb23576b212314fbb7a8311e7c18d330ae WatchSource:0}: Error finding container 0cf2c6bc19971881e47212efcb1948cb23576b212314fbb7a8311e7c18d330ae: Status 404 returned error can't find the container with id 0cf2c6bc19971881e47212efcb1948cb23576b212314fbb7a8311e7c18d330ae Jul 15 22:33:11.809684 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.809670 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 22:33:11.811202 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811167 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-etc-systemd\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.811255 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811224 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/163d94d1-6930-4f2d-9fdf-3414a8d0071e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h6wpj\" (UID: \"163d94d1-6930-4f2d-9fdf-3414a8d0071e\") " pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.811289 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811261 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2909cc24-d826-42da-9d30-14a4ec63267d-hosts-file\") pod \"node-resolver-vnktr\" (UID: \"2909cc24-d826-42da-9d30-14a4ec63267d\") " pod="openshift-dns/node-resolver-vnktr" Jul 15 22:33:11.811326 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811295 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2drpj\" (UniqueName: \"kubernetes.io/projected/ad4d4e81-c00a-4d74-b409-2c7ec97c3002-kube-api-access-2drpj\") pod \"node-ca-jgsqh\" (UID: \"ad4d4e81-c00a-4d74-b409-2c7ec97c3002\") " pod="openshift-image-registry/node-ca-jgsqh" Jul 15 22:33:11.811366 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811343 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.811398 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811389 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-etc-sysctl-d\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.811431 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811410 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-var-lib-kubelet\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.811464 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811430 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-etc-kubernetes\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.811464 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811451 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-etc-sysctl-conf\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.811531 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811494 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26846\" (UniqueName: \"kubernetes.io/projected/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-kube-api-access-26846\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.811531 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811521 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/163d94d1-6930-4f2d-9fdf-3414a8d0071e-cni-binary-copy\") pod \"multus-additional-cni-plugins-h6wpj\" (UID: \"163d94d1-6930-4f2d-9fdf-3414a8d0071e\") " pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.811592 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811547 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-system-cni-dir\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.811622 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811590 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-cnibin\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.811622 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811615 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt4q4\" (UniqueName: \"kubernetes.io/projected/162185e2-da05-43cd-9b88-f2fa765a4a55-kube-api-access-jt4q4\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.811677 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811625 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-etc-systemd\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.811677 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811643 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/292fa64f-5495-4b75-8ac8-8d4893320cc1-iptables-alerter-script\") pod \"iptables-alerter-xk42n\" (UID: \"292fa64f-5495-4b75-8ac8-8d4893320cc1\") " pod="openshift-network-operator/iptables-alerter-xk42n" Jul 15 22:33:11.811737 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811675 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-host-cni-netd\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.811737 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811707 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-etc-sysconfig\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.811737 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811724 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-tmp\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.811824 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811742 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjw7v\" (UniqueName: \"kubernetes.io/projected/ff68c09e-7343-4947-8750-7fa6e793287c-kube-api-access-gjw7v\") pod \"network-metrics-daemon-qmvbm\" (UID: \"ff68c09e-7343-4947-8750-7fa6e793287c\") " pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:11.811824 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811759 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/163d94d1-6930-4f2d-9fdf-3414a8d0071e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h6wpj\" (UID: \"163d94d1-6930-4f2d-9fdf-3414a8d0071e\") " pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.811824 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811784 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-etc-openvswitch\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.811824 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811798 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-node-log\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.811824 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811812 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-host-run-ovn-kubernetes\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.812064 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811826 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-etc-kubernetes\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.812064 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811871 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/163d94d1-6930-4f2d-9fdf-3414a8d0071e-system-cni-dir\") pod \"multus-additional-cni-plugins-h6wpj\" (UID: \"163d94d1-6930-4f2d-9fdf-3414a8d0071e\") " pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.812064 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811915 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/163d94d1-6930-4f2d-9fdf-3414a8d0071e-system-cni-dir\") pod \"multus-additional-cni-plugins-h6wpj\" (UID: \"163d94d1-6930-4f2d-9fdf-3414a8d0071e\") " pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.812064 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811997 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-etc-sysctl-d\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.812064 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811997 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2909cc24-d826-42da-9d30-14a4ec63267d-hosts-file\") pod \"node-resolver-vnktr\" (UID: \"2909cc24-d826-42da-9d30-14a4ec63267d\") " pod="openshift-dns/node-resolver-vnktr" Jul 15 22:33:11.812064 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.811998 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-host-run-ovn-kubernetes\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.812064 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.812001 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-system-cni-dir\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.812064 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.812046 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-etc-kubernetes\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.812538 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.812074 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-multus-daemon-config\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.812538 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.812108 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/162185e2-da05-43cd-9b88-f2fa765a4a55-ovnkube-script-lib\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.812538 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.812134 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-run\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.812538 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.812164 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-etc-tuned\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.812538 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.812402 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/292fa64f-5495-4b75-8ac8-8d4893320cc1-iptables-alerter-script\") pod \"iptables-alerter-xk42n\" (UID: \"292fa64f-5495-4b75-8ac8-8d4893320cc1\") " pod="openshift-network-operator/iptables-alerter-xk42n" Jul 15 22:33:11.812758 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.812534 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-node-log\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.812758 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.812585 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/163d94d1-6930-4f2d-9fdf-3414a8d0071e-cni-binary-copy\") pod \"multus-additional-cni-plugins-h6wpj\" (UID: \"163d94d1-6930-4f2d-9fdf-3414a8d0071e\") " pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.812758 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.812599 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.812758 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.812670 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-etc-sysconfig\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.812758 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.812678 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/163d94d1-6930-4f2d-9fdf-3414a8d0071e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h6wpj\" (UID: \"163d94d1-6930-4f2d-9fdf-3414a8d0071e\") " pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.812758 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.812718 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-host-run-multus-certs\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.812758 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.812747 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-var-lib-openvswitch\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.812758 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.812757 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-var-lib-kubelet\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.813173 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.812773 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c60b5390-688d-46bb-a3f8-70b746073689-konnectivity-ca\") pod \"konnectivity-agent-xgqq7\" (UID: \"c60b5390-688d-46bb-a3f8-70b746073689\") " pod="kube-system/konnectivity-agent-xgqq7" Jul 15 22:33:11.813173 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.812767 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 22:33:11.813173 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.812800 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-host-var-lib-cni-multus\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.813173 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.812827 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/292fa64f-5495-4b75-8ac8-8d4893320cc1-host-slash\") pod \"iptables-alerter-xk42n\" (UID: \"292fa64f-5495-4b75-8ac8-8d4893320cc1\") " pod="openshift-network-operator/iptables-alerter-xk42n" Jul 15 22:33:11.813173 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.812718 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-etc-kubernetes\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.813173 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.812801 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-host-cni-netd\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.813173 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.812979 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-run-openvswitch\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.813173 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.812993 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-etc-sysctl-conf\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.813173 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.813005 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-run-ovn\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.813173 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.812998 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/163d94d1-6930-4f2d-9fdf-3414a8d0071e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h6wpj\" (UID: \"163d94d1-6930-4f2d-9fdf-3414a8d0071e\") " pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.813173 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.813036 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-log-socket\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.813173 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.813044 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/292fa64f-5495-4b75-8ac8-8d4893320cc1-host-slash\") pod \"iptables-alerter-xk42n\" (UID: \"292fa64f-5495-4b75-8ac8-8d4893320cc1\") " pod="openshift-network-operator/iptables-alerter-xk42n" Jul 15 22:33:11.813173 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.813064 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/23a965f4-47c0-432e-9676-53861bba6186-dbus\") pod \"global-pull-secret-syncer-dvf88\" (UID: \"23a965f4-47c0-432e-9676-53861bba6186\") " pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:11.813173 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.813070 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-host-run-multus-certs\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.813173 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.813090 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-host\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.813173 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.813113 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-var-lib-openvswitch\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.813173 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.813119 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-cni-binary-copy\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.813876 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.813188 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-cnibin\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.813876 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.813358 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/163d94d1-6930-4f2d-9fdf-3414a8d0071e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h6wpj\" (UID: \"163d94d1-6930-4f2d-9fdf-3414a8d0071e\") " pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.813876 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.813357 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/163d94d1-6930-4f2d-9fdf-3414a8d0071e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h6wpj\" (UID: \"163d94d1-6930-4f2d-9fdf-3414a8d0071e\") " pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.813876 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.813394 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6wvs\" (UniqueName: \"kubernetes.io/projected/6fe341c4-845e-4412-a026-ea8463d7191c-kube-api-access-m6wvs\") pod \"network-check-target-x64tv\" (UID: \"6fe341c4-845e-4412-a026-ea8463d7191c\") " pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:11.813876 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.813410 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-run\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.813876 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.813422 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-run-openvswitch\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.813876 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.813444 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/162185e2-da05-43cd-9b88-f2fa765a4a55-ovnkube-config\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.813876 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.813476 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fceccc65-d0e0-463d-a160-7224b2798647-registration-dir\") pod \"aws-ebs-csi-driver-node-kpqx5\" (UID: \"fceccc65-d0e0-463d-a160-7224b2798647\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" Jul 15 22:33:11.813876 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.813502 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2909cc24-d826-42da-9d30-14a4ec63267d-tmp-dir\") pod \"node-resolver-vnktr\" (UID: \"2909cc24-d826-42da-9d30-14a4ec63267d\") " pod="openshift-dns/node-resolver-vnktr" Jul 15 22:33:11.813876 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.813526 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-host-kubelet\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.813876 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.813552 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-systemd-units\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.813876 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.813572 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c60b5390-688d-46bb-a3f8-70b746073689-konnectivity-ca\") pod \"konnectivity-agent-xgqq7\" (UID: \"c60b5390-688d-46bb-a3f8-70b746073689\") " pod="kube-system/konnectivity-agent-xgqq7" Jul 15 22:33:11.814371 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.814195 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-multus-conf-dir\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.814371 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.814244 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fceccc65-d0e0-463d-a160-7224b2798647-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kpqx5\" (UID: \"fceccc65-d0e0-463d-a160-7224b2798647\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" Jul 15 22:33:11.814371 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.814274 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-etc-modprobe-d\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.814371 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.814308 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nz6s\" (UniqueName: \"kubernetes.io/projected/163d94d1-6930-4f2d-9fdf-3414a8d0071e-kube-api-access-6nz6s\") pod \"multus-additional-cni-plugins-h6wpj\" (UID: \"163d94d1-6930-4f2d-9fdf-3414a8d0071e\") " pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.814371 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.814340 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-host-var-lib-kubelet\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.814580 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.814372 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrgrm\" (UniqueName: \"kubernetes.io/projected/fceccc65-d0e0-463d-a160-7224b2798647-kube-api-access-xrgrm\") pod \"aws-ebs-csi-driver-node-kpqx5\" (UID: \"fceccc65-d0e0-463d-a160-7224b2798647\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" Jul 15 22:33:11.815445 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.815425 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/162185e2-da05-43cd-9b88-f2fa765a4a55-ovnkube-config\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.815932 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.815912 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-cni-binary-copy\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.816079 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.816064 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-etc-openvswitch\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.816554 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.816533 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-systemd-units\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.816643 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.816589 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-run-ovn\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.816643 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.816621 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-etc-tuned\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.816739 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.816643 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-log-socket\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.816739 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.816716 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-host-run-netns\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.816829 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.816755 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-run-systemd\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.816829 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.816785 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-host-run-netns\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.816829 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.816809 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-etc-modprobe-d\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.816829 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.816818 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fceccc65-d0e0-463d-a160-7224b2798647-socket-dir\") pod \"aws-ebs-csi-driver-node-kpqx5\" (UID: \"fceccc65-d0e0-463d-a160-7224b2798647\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" Jul 15 22:33:11.816829 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.816822 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2909cc24-d826-42da-9d30-14a4ec63267d-tmp-dir\") pod \"node-resolver-vnktr\" (UID: \"2909cc24-d826-42da-9d30-14a4ec63267d\") " pod="openshift-dns/node-resolver-vnktr" Jul 15 22:33:11.817071 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.816876 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnskv\" (UniqueName: \"kubernetes.io/projected/292fa64f-5495-4b75-8ac8-8d4893320cc1-kube-api-access-lnskv\") pod \"iptables-alerter-xk42n\" (UID: \"292fa64f-5495-4b75-8ac8-8d4893320cc1\") " pod="openshift-network-operator/iptables-alerter-xk42n" Jul 15 22:33:11.817071 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.816917 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/162185e2-da05-43cd-9b88-f2fa765a4a55-env-overrides\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.817071 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.816922 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fceccc65-d0e0-463d-a160-7224b2798647-registration-dir\") pod \"aws-ebs-csi-driver-node-kpqx5\" (UID: \"fceccc65-d0e0-463d-a160-7224b2798647\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" Jul 15 22:33:11.817071 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.816954 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/163d94d1-6930-4f2d-9fdf-3414a8d0071e-os-release\") pod \"multus-additional-cni-plugins-h6wpj\" (UID: \"163d94d1-6930-4f2d-9fdf-3414a8d0071e\") " pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.817071 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.816965 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-host-kubelet\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.817071 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.816984 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-sys\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.817071 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.817012 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-host-run-netns\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.817366 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.817102 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-multus-conf-dir\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.817366 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.817110 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-host\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.817366 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.817167 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/23a965f4-47c0-432e-9676-53861bba6186-dbus\") pod \"global-pull-secret-syncer-dvf88\" (UID: \"23a965f4-47c0-432e-9676-53861bba6186\") " pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:11.817366 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.817170 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-sys\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.817366 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.817197 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-run-systemd\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.817366 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.817219 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-host-var-lib-cni-multus\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.817366 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.817236 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-host-run-netns\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.817366 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.817247 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-multus-cni-dir\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.817366 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.817282 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-os-release\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.817366 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.817313 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-multus-socket-dir-parent\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.817366 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.817322 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fceccc65-d0e0-463d-a160-7224b2798647-socket-dir\") pod \"aws-ebs-csi-driver-node-kpqx5\" (UID: \"fceccc65-d0e0-463d-a160-7224b2798647\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" Jul 15 22:33:11.817366 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.817345 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fceccc65-d0e0-463d-a160-7224b2798647-device-dir\") pod \"aws-ebs-csi-driver-node-kpqx5\" (UID: \"fceccc65-d0e0-463d-a160-7224b2798647\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" Jul 15 22:33:11.817872 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.817531 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fceccc65-d0e0-463d-a160-7224b2798647-etc-selinux\") pod \"aws-ebs-csi-driver-node-kpqx5\" (UID: \"fceccc65-d0e0-463d-a160-7224b2798647\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" Jul 15 22:33:11.817872 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.817568 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j84jn\" (UniqueName: \"kubernetes.io/projected/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-kube-api-access-j84jn\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.817872 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.817600 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff68c09e-7343-4947-8750-7fa6e793287c-metrics-certs\") pod \"network-metrics-daemon-qmvbm\" (UID: \"ff68c09e-7343-4947-8750-7fa6e793287c\") " pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:11.817872 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.817629 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/163d94d1-6930-4f2d-9fdf-3414a8d0071e-cnibin\") pod \"multus-additional-cni-plugins-h6wpj\" (UID: \"163d94d1-6930-4f2d-9fdf-3414a8d0071e\") " pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.817872 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.817655 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-host-run-k8s-cni-cncf-io\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.817872 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.817683 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-host-var-lib-cni-bin\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.817872 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.817712 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ad4d4e81-c00a-4d74-b409-2c7ec97c3002-serviceca\") pod \"node-ca-jgsqh\" (UID: \"ad4d4e81-c00a-4d74-b409-2c7ec97c3002\") " pod="openshift-image-registry/node-ca-jgsqh" Jul 15 22:33:11.817872 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.817742 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz4bx\" (UniqueName: \"kubernetes.io/projected/2909cc24-d826-42da-9d30-14a4ec63267d-kube-api-access-nz4bx\") pod \"node-resolver-vnktr\" (UID: \"2909cc24-d826-42da-9d30-14a4ec63267d\") " pod="openshift-dns/node-resolver-vnktr" Jul 15 22:33:11.818213 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.817980 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/162185e2-da05-43cd-9b88-f2fa765a4a55-ovn-node-metrics-cert\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.818213 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.818013 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/23a965f4-47c0-432e-9676-53861bba6186-kubelet-config\") pod \"global-pull-secret-syncer-dvf88\" (UID: \"23a965f4-47c0-432e-9676-53861bba6186\") " pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:11.818213 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.818044 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c60b5390-688d-46bb-a3f8-70b746073689-agent-certs\") pod \"konnectivity-agent-xgqq7\" (UID: \"c60b5390-688d-46bb-a3f8-70b746073689\") " pod="kube-system/konnectivity-agent-xgqq7" Jul 15 22:33:11.818213 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.818080 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-lib-modules\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.818213 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.818105 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-hostroot\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.818213 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.818136 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/162185e2-da05-43cd-9b88-f2fa765a4a55-ovnkube-script-lib\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.818213 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.818143 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fceccc65-d0e0-463d-a160-7224b2798647-sys-fs\") pod \"aws-ebs-csi-driver-node-kpqx5\" (UID: \"fceccc65-d0e0-463d-a160-7224b2798647\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" Jul 15 22:33:11.818213 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.818196 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fceccc65-d0e0-463d-a160-7224b2798647-sys-fs\") pod \"aws-ebs-csi-driver-node-kpqx5\" (UID: \"fceccc65-d0e0-463d-a160-7224b2798647\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" Jul 15 22:33:11.818213 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.818195 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad4d4e81-c00a-4d74-b409-2c7ec97c3002-host\") pod \"node-ca-jgsqh\" (UID: \"ad4d4e81-c00a-4d74-b409-2c7ec97c3002\") " pod="openshift-image-registry/node-ca-jgsqh" Jul 15 22:33:11.818641 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.818235 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-host-slash\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.818641 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.818238 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad4d4e81-c00a-4d74-b409-2c7ec97c3002-host\") pod \"node-ca-jgsqh\" (UID: \"ad4d4e81-c00a-4d74-b409-2c7ec97c3002\") " pod="openshift-image-registry/node-ca-jgsqh" Jul 15 22:33:11.818641 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.818265 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-host-cni-bin\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.818641 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.818305 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23a965f4-47c0-432e-9676-53861bba6186-original-pull-secret\") pod \"global-pull-secret-syncer-dvf88\" (UID: \"23a965f4-47c0-432e-9676-53861bba6186\") " pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:11.818641 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:11.818376 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:11.818641 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:11.818450 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff68c09e-7343-4947-8750-7fa6e793287c-metrics-certs podName:ff68c09e-7343-4947-8750-7fa6e793287c nodeName:}" failed. No retries permitted until 2026-07-15 22:33:12.318424585 +0000 UTC m=+2.026222174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff68c09e-7343-4947-8750-7fa6e793287c-metrics-certs") pod "network-metrics-daemon-qmvbm" (UID: "ff68c09e-7343-4947-8750-7fa6e793287c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:11.818641 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.818570 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-host-var-lib-kubelet\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.818641 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:11.818624 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:11.819017 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:11.818677 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a965f4-47c0-432e-9676-53861bba6186-original-pull-secret podName:23a965f4-47c0-432e-9676-53861bba6186 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:12.318662 +0000 UTC m=+2.026459570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23a965f4-47c0-432e-9676-53861bba6186-original-pull-secret") pod "global-pull-secret-syncer-dvf88" (UID: "23a965f4-47c0-432e-9676-53861bba6186") : object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:11.819017 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.818731 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fceccc65-d0e0-463d-a160-7224b2798647-device-dir\") pod \"aws-ebs-csi-driver-node-kpqx5\" (UID: \"fceccc65-d0e0-463d-a160-7224b2798647\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" Jul 15 22:33:11.819017 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.818742 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/163d94d1-6930-4f2d-9fdf-3414a8d0071e-cnibin\") pod \"multus-additional-cni-plugins-h6wpj\" (UID: \"163d94d1-6930-4f2d-9fdf-3414a8d0071e\") " pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.819017 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.818761 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-multus-daemon-config\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.819017 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.818795 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-os-release\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.819017 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.818803 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-multus-cni-dir\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.819017 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.818867 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/23a965f4-47c0-432e-9676-53861bba6186-kubelet-config\") pod \"global-pull-secret-syncer-dvf88\" (UID: \"23a965f4-47c0-432e-9676-53861bba6186\") " pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:11.819017 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.818882 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/163d94d1-6930-4f2d-9fdf-3414a8d0071e-os-release\") pod \"multus-additional-cni-plugins-h6wpj\" (UID: \"163d94d1-6930-4f2d-9fdf-3414a8d0071e\") " pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.819017 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.818910 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-hostroot\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.819017 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.818924 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fceccc65-d0e0-463d-a160-7224b2798647-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kpqx5\" (UID: \"fceccc65-d0e0-463d-a160-7224b2798647\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" Jul 15 22:33:11.819017 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.818929 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-lib-modules\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.819017 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.818911 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-host-slash\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.819017 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.819004 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fceccc65-d0e0-463d-a160-7224b2798647-etc-selinux\") pod \"aws-ebs-csi-driver-node-kpqx5\" (UID: \"fceccc65-d0e0-463d-a160-7224b2798647\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" Jul 15 22:33:11.819574 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.819046 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/162185e2-da05-43cd-9b88-f2fa765a4a55-host-cni-bin\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.819574 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.819388 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-tmp\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.819574 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.819502 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ad4d4e81-c00a-4d74-b409-2c7ec97c3002-serviceca\") pod \"node-ca-jgsqh\" (UID: \"ad4d4e81-c00a-4d74-b409-2c7ec97c3002\") " pod="openshift-image-registry/node-ca-jgsqh" Jul 15 22:33:11.819702 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.819637 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-multus-socket-dir-parent\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.819751 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.819706 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-host-var-lib-cni-bin\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.820206 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.819845 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-host-run-k8s-cni-cncf-io\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.820206 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.819921 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/162185e2-da05-43cd-9b88-f2fa765a4a55-env-overrides\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.823612 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.823574 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt4q4\" (UniqueName: \"kubernetes.io/projected/162185e2-da05-43cd-9b88-f2fa765a4a55-kube-api-access-jt4q4\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.824250 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.824232 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2drpj\" (UniqueName: \"kubernetes.io/projected/ad4d4e81-c00a-4d74-b409-2c7ec97c3002-kube-api-access-2drpj\") pod \"node-ca-jgsqh\" (UID: \"ad4d4e81-c00a-4d74-b409-2c7ec97c3002\") " pod="openshift-image-registry/node-ca-jgsqh" Jul 15 22:33:11.825063 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.825033 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/162185e2-da05-43cd-9b88-f2fa765a4a55-ovn-node-metrics-cert\") pod \"ovnkube-node-f7fk4\" (UID: \"162185e2-da05-43cd-9b88-f2fa765a4a55\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:11.825063 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.825055 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c60b5390-688d-46bb-a3f8-70b746073689-agent-certs\") pod \"konnectivity-agent-xgqq7\" (UID: \"c60b5390-688d-46bb-a3f8-70b746073689\") " pod="kube-system/konnectivity-agent-xgqq7" Jul 15 22:33:11.825591 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.825558 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrgrm\" (UniqueName: \"kubernetes.io/projected/fceccc65-d0e0-463d-a160-7224b2798647-kube-api-access-xrgrm\") pod \"aws-ebs-csi-driver-node-kpqx5\" (UID: \"fceccc65-d0e0-463d-a160-7224b2798647\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" Jul 15 22:33:11.826321 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.826261 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26846\" (UniqueName: \"kubernetes.io/projected/273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a-kube-api-access-26846\") pod \"tuned-rgnf2\" (UID: \"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:11.827032 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.827008 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjw7v\" (UniqueName: \"kubernetes.io/projected/ff68c09e-7343-4947-8750-7fa6e793287c-kube-api-access-gjw7v\") pod \"network-metrics-daemon-qmvbm\" (UID: \"ff68c09e-7343-4947-8750-7fa6e793287c\") " pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:11.827283 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.827253 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nz6s\" (UniqueName: \"kubernetes.io/projected/163d94d1-6930-4f2d-9fdf-3414a8d0071e-kube-api-access-6nz6s\") pod \"multus-additional-cni-plugins-h6wpj\" (UID: \"163d94d1-6930-4f2d-9fdf-3414a8d0071e\") " pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.827456 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.827419 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnskv\" (UniqueName: \"kubernetes.io/projected/292fa64f-5495-4b75-8ac8-8d4893320cc1-kube-api-access-lnskv\") pod \"iptables-alerter-xk42n\" (UID: \"292fa64f-5495-4b75-8ac8-8d4893320cc1\") " pod="openshift-network-operator/iptables-alerter-xk42n" Jul 15 22:33:11.830090 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.830065 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jgsqh" Jul 15 22:33:11.830223 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.830206 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz4bx\" (UniqueName: \"kubernetes.io/projected/2909cc24-d826-42da-9d30-14a4ec63267d-kube-api-access-nz4bx\") pod \"node-resolver-vnktr\" (UID: \"2909cc24-d826-42da-9d30-14a4ec63267d\") " pod="openshift-dns/node-resolver-vnktr" Jul 15 22:33:11.830764 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:11.830748 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 22:33:11.830764 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:11.830763 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 22:33:11.830917 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:11.830773 2560 projected.go:196] Error preparing data for projected volume kube-api-access-m6wvs for pod openshift-network-diagnostics/network-check-target-x64tv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:11.830917 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:11.830831 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fe341c4-845e-4412-a026-ea8463d7191c-kube-api-access-m6wvs podName:6fe341c4-845e-4412-a026-ea8463d7191c nodeName:}" failed. No retries permitted until 2026-07-15 22:33:12.330818918 +0000 UTC m=+2.038616501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m6wvs" (UniqueName: "kubernetes.io/projected/6fe341c4-845e-4412-a026-ea8463d7191c-kube-api-access-m6wvs") pod "network-check-target-x64tv" (UID: "6fe341c4-845e-4412-a026-ea8463d7191c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:11.833501 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.833486 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h6wpj" Jul 15 22:33:11.834046 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.834030 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j84jn\" (UniqueName: \"kubernetes.io/projected/7c1ed5d4-21de-48c5-8484-c48f03cc84f4-kube-api-access-j84jn\") pod \"multus-km6gb\" (UID: \"7c1ed5d4-21de-48c5-8484-c48f03cc84f4\") " pod="openshift-multus/multus-km6gb" Jul 15 22:33:11.838301 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.838203 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal" event={"ID":"d92af667d32b12b1c5e1720a5f8568a2","Type":"ContainerStarted","Data":"46730c1b4834a3973f4587bf6b2b3e865304ae6dcebb6ff3a9463f74e59e95fc"} Jul 15 22:33:11.839316 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:11.839286 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" event={"ID":"fc502a8ea47d4d8f1c1a1b6b929db20a","Type":"ContainerStarted","Data":"0cf2c6bc19971881e47212efcb1948cb23576b212314fbb7a8311e7c18d330ae"} Jul 15 22:33:11.841432 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:11.841410 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad4d4e81_c00a_4d74_b409_2c7ec97c3002.slice/crio-bca1102a99927e6690b006499cfa3241bfe89a94702adca65d2cc3ba665fc54b WatchSource:0}: Error finding container bca1102a99927e6690b006499cfa3241bfe89a94702adca65d2cc3ba665fc54b: Status 404 returned error can't find the container with id bca1102a99927e6690b006499cfa3241bfe89a94702adca65d2cc3ba665fc54b Jul 15 22:33:11.841815 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:11.841795 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod163d94d1_6930_4f2d_9fdf_3414a8d0071e.slice/crio-082ff01301cf392278a5c6f63e31ddd8ea32171d1593e0418220a85f8f05700d WatchSource:0}: Error finding container 082ff01301cf392278a5c6f63e31ddd8ea32171d1593e0418220a85f8f05700d: Status 404 returned error can't find the container with id 082ff01301cf392278a5c6f63e31ddd8ea32171d1593e0418220a85f8f05700d Jul 15 22:33:12.005582 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:12.005498 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-km6gb" Jul 15 22:33:12.013648 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:12.013627 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c1ed5d4_21de_48c5_8484_c48f03cc84f4.slice/crio-fada3a12c938063dc8e94f30f93739d11525e1cb3bfe44d613b50e2a9efb12f2 WatchSource:0}: Error finding container fada3a12c938063dc8e94f30f93739d11525e1cb3bfe44d613b50e2a9efb12f2: Status 404 returned error can't find the container with id fada3a12c938063dc8e94f30f93739d11525e1cb3bfe44d613b50e2a9efb12f2 Jul 15 22:33:12.027699 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:12.027679 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xk42n" Jul 15 22:33:12.035525 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:12.035506 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod292fa64f_5495_4b75_8ac8_8d4893320cc1.slice/crio-adc03c5b65cd761bb3d7313227b0d0ffd3414f9d4b48860035c5c3c854a80ec5 WatchSource:0}: Error finding container adc03c5b65cd761bb3d7313227b0d0ffd3414f9d4b48860035c5c3c854a80ec5: Status 404 returned error can't find the container with id adc03c5b65cd761bb3d7313227b0d0ffd3414f9d4b48860035c5c3c854a80ec5 Jul 15 22:33:12.051931 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:12.051897 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:12.059751 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:12.059730 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod162185e2_da05_43cd_9b88_f2fa765a4a55.slice/crio-c4e90dfb38a54d9d966ffcc9f8352d7599b68847532de3da0b3d1fef59299c3b WatchSource:0}: Error finding container c4e90dfb38a54d9d966ffcc9f8352d7599b68847532de3da0b3d1fef59299c3b: Status 404 returned error can't find the container with id c4e90dfb38a54d9d966ffcc9f8352d7599b68847532de3da0b3d1fef59299c3b Jul 15 22:33:12.061629 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:12.061607 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xgqq7" Jul 15 22:33:12.069607 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:12.069586 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc60b5390_688d_46bb_a3f8_70b746073689.slice/crio-9d8be46a76a38d8b5121d2e98dce84b732ad2e6a711d0033e88527f4f37ed1d1 WatchSource:0}: Error finding container 9d8be46a76a38d8b5121d2e98dce84b732ad2e6a711d0033e88527f4f37ed1d1: Status 404 returned error can't find the container with id 9d8be46a76a38d8b5121d2e98dce84b732ad2e6a711d0033e88527f4f37ed1d1 Jul 15 22:33:12.077878 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:12.077839 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" Jul 15 22:33:12.101387 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:12.101356 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" Jul 15 22:33:12.109895 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:12.109875 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod273e80ff_3bbf_4a4f_ab09_4a1c3e1f4d2a.slice/crio-f1c322aa599f70cb28a3551b5c845f3c7dc860ed931ff439ef8f7c9319ec6f72 WatchSource:0}: Error finding container f1c322aa599f70cb28a3551b5c845f3c7dc860ed931ff439ef8f7c9319ec6f72: Status 404 returned error can't find the container with id f1c322aa599f70cb28a3551b5c845f3c7dc860ed931ff439ef8f7c9319ec6f72 Jul 15 22:33:12.117017 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:12.117000 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vnktr" Jul 15 22:33:12.124942 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:12.124900 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2909cc24_d826_42da_9d30_14a4ec63267d.slice/crio-68f305dde919b0f09424674c59345d687ed076def3b07e61bad9e65269dfe8fc WatchSource:0}: Error finding container 68f305dde919b0f09424674c59345d687ed076def3b07e61bad9e65269dfe8fc: Status 404 returned error can't find the container with id 68f305dde919b0f09424674c59345d687ed076def3b07e61bad9e65269dfe8fc Jul 15 22:33:12.240748 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:12.240708 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 22:33:12.322301 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:12.322203 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23a965f4-47c0-432e-9676-53861bba6186-original-pull-secret\") pod \"global-pull-secret-syncer-dvf88\" (UID: \"23a965f4-47c0-432e-9676-53861bba6186\") " pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:12.322301 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:12.322303 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff68c09e-7343-4947-8750-7fa6e793287c-metrics-certs\") pod \"network-metrics-daemon-qmvbm\" (UID: \"ff68c09e-7343-4947-8750-7fa6e793287c\") " pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:12.322636 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:12.322446 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:12.322636 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:12.322507 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff68c09e-7343-4947-8750-7fa6e793287c-metrics-certs podName:ff68c09e-7343-4947-8750-7fa6e793287c nodeName:}" failed. No retries permitted until 2026-07-15 22:33:13.322487826 +0000 UTC m=+3.030285422 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff68c09e-7343-4947-8750-7fa6e793287c-metrics-certs") pod "network-metrics-daemon-qmvbm" (UID: "ff68c09e-7343-4947-8750-7fa6e793287c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:12.323396 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:12.322918 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:12.323396 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:12.323029 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a965f4-47c0-432e-9676-53861bba6186-original-pull-secret podName:23a965f4-47c0-432e-9676-53861bba6186 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:13.323011345 +0000 UTC m=+3.030808920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23a965f4-47c0-432e-9676-53861bba6186-original-pull-secret") pod "global-pull-secret-syncer-dvf88" (UID: "23a965f4-47c0-432e-9676-53861bba6186") : object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:12.423285 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:12.423246 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6wvs\" (UniqueName: \"kubernetes.io/projected/6fe341c4-845e-4412-a026-ea8463d7191c-kube-api-access-m6wvs\") pod \"network-check-target-x64tv\" (UID: \"6fe341c4-845e-4412-a026-ea8463d7191c\") " pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:12.423494 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:12.423475 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 22:33:12.423552 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:12.423506 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 22:33:12.423552 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:12.423520 2560 projected.go:196] Error preparing data for projected volume kube-api-access-m6wvs for pod openshift-network-diagnostics/network-check-target-x64tv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:12.423626 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:12.423580 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fe341c4-845e-4412-a026-ea8463d7191c-kube-api-access-m6wvs podName:6fe341c4-845e-4412-a026-ea8463d7191c nodeName:}" failed. No retries permitted until 2026-07-15 22:33:13.42355882 +0000 UTC m=+3.131356622 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-m6wvs" (UniqueName: "kubernetes.io/projected/6fe341c4-845e-4412-a026-ea8463d7191c-kube-api-access-m6wvs") pod "network-check-target-x64tv" (UID: "6fe341c4-845e-4412-a026-ea8463d7191c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:12.756054 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:12.755967 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 22:28:12 +0000 UTC" deadline="2028-01-30 05:47:16.53515341 +0000 UTC" Jul 15 22:33:12.756054 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:12.756008 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13519h14m3.779150102s" Jul 15 22:33:12.839127 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:12.838301 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:12.839127 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:12.838455 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmvbm" podUID="ff68c09e-7343-4947-8750-7fa6e793287c" Jul 15 22:33:12.841460 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:12.841232 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 22:33:12.875337 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:12.875294 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xgqq7" event={"ID":"c60b5390-688d-46bb-a3f8-70b746073689","Type":"ContainerStarted","Data":"9d8be46a76a38d8b5121d2e98dce84b732ad2e6a711d0033e88527f4f37ed1d1"} Jul 15 22:33:12.884261 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:12.884230 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" event={"ID":"162185e2-da05-43cd-9b88-f2fa765a4a55","Type":"ContainerStarted","Data":"c4e90dfb38a54d9d966ffcc9f8352d7599b68847532de3da0b3d1fef59299c3b"} Jul 15 22:33:12.898331 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:12.898297 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xk42n" event={"ID":"292fa64f-5495-4b75-8ac8-8d4893320cc1","Type":"ContainerStarted","Data":"adc03c5b65cd761bb3d7313227b0d0ffd3414f9d4b48860035c5c3c854a80ec5"} Jul 15 22:33:12.902291 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:12.901418 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jgsqh" event={"ID":"ad4d4e81-c00a-4d74-b409-2c7ec97c3002","Type":"ContainerStarted","Data":"bca1102a99927e6690b006499cfa3241bfe89a94702adca65d2cc3ba665fc54b"} Jul 15 22:33:12.905783 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:12.905701 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vnktr" event={"ID":"2909cc24-d826-42da-9d30-14a4ec63267d","Type":"ContainerStarted","Data":"68f305dde919b0f09424674c59345d687ed076def3b07e61bad9e65269dfe8fc"} Jul 15 22:33:12.918301 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:12.918269 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" event={"ID":"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a","Type":"ContainerStarted","Data":"f1c322aa599f70cb28a3551b5c845f3c7dc860ed931ff439ef8f7c9319ec6f72"} Jul 15 22:33:12.935555 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:12.935522 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" event={"ID":"fceccc65-d0e0-463d-a160-7224b2798647","Type":"ContainerStarted","Data":"18fd8e4fdd499ff0c64039c03f9477747fee5a5092f8c6da914b49ea278c94da"} Jul 15 22:33:12.957833 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:12.957796 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-km6gb" event={"ID":"7c1ed5d4-21de-48c5-8484-c48f03cc84f4","Type":"ContainerStarted","Data":"fada3a12c938063dc8e94f30f93739d11525e1cb3bfe44d613b50e2a9efb12f2"} Jul 15 22:33:12.981110 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:12.980647 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6wpj" event={"ID":"163d94d1-6930-4f2d-9fdf-3414a8d0071e","Type":"ContainerStarted","Data":"082ff01301cf392278a5c6f63e31ddd8ea32171d1593e0418220a85f8f05700d"} Jul 15 22:33:13.330336 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:13.330287 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff68c09e-7343-4947-8750-7fa6e793287c-metrics-certs\") pod \"network-metrics-daemon-qmvbm\" (UID: \"ff68c09e-7343-4947-8750-7fa6e793287c\") " pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:13.330527 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:13.330358 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23a965f4-47c0-432e-9676-53861bba6186-original-pull-secret\") pod \"global-pull-secret-syncer-dvf88\" (UID: \"23a965f4-47c0-432e-9676-53861bba6186\") " pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:13.330527 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:13.330512 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:13.330661 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:13.330584 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a965f4-47c0-432e-9676-53861bba6186-original-pull-secret podName:23a965f4-47c0-432e-9676-53861bba6186 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:15.330563567 +0000 UTC m=+5.038361142 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23a965f4-47c0-432e-9676-53861bba6186-original-pull-secret") pod "global-pull-secret-syncer-dvf88" (UID: "23a965f4-47c0-432e-9676-53861bba6186") : object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:13.331064 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:13.331041 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:13.331165 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:13.331103 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff68c09e-7343-4947-8750-7fa6e793287c-metrics-certs podName:ff68c09e-7343-4947-8750-7fa6e793287c nodeName:}" failed. No retries permitted until 2026-07-15 22:33:15.331086372 +0000 UTC m=+5.038883946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff68c09e-7343-4947-8750-7fa6e793287c-metrics-certs") pod "network-metrics-daemon-qmvbm" (UID: "ff68c09e-7343-4947-8750-7fa6e793287c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:13.431407 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:13.431359 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6wvs\" (UniqueName: \"kubernetes.io/projected/6fe341c4-845e-4412-a026-ea8463d7191c-kube-api-access-m6wvs\") pod \"network-check-target-x64tv\" (UID: \"6fe341c4-845e-4412-a026-ea8463d7191c\") " pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:13.431604 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:13.431561 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 22:33:13.431604 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:13.431583 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 22:33:13.431604 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:13.431596 2560 projected.go:196] Error preparing data for projected volume kube-api-access-m6wvs for pod openshift-network-diagnostics/network-check-target-x64tv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:13.431780 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:13.431660 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fe341c4-845e-4412-a026-ea8463d7191c-kube-api-access-m6wvs podName:6fe341c4-845e-4412-a026-ea8463d7191c nodeName:}" failed. No retries permitted until 2026-07-15 22:33:15.431640129 +0000 UTC m=+5.139437704 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-m6wvs" (UniqueName: "kubernetes.io/projected/6fe341c4-845e-4412-a026-ea8463d7191c-kube-api-access-m6wvs") pod "network-check-target-x64tv" (UID: "6fe341c4-845e-4412-a026-ea8463d7191c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:13.756454 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:13.756331 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 22:28:12 +0000 UTC" deadline="2028-02-08 23:58:29.071431368 +0000 UTC" Jul 15 22:33:13.756454 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:13.756402 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13753h25m15.315034759s" Jul 15 22:33:13.835823 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:13.835331 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:13.835823 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:13.835466 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x64tv" podUID="6fe341c4-845e-4412-a026-ea8463d7191c" Jul 15 22:33:13.835823 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:13.835516 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:13.835823 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:13.835633 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvf88" podUID="23a965f4-47c0-432e-9676-53861bba6186" Jul 15 22:33:14.003147 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:14.003068 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 22:33:14.838391 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:14.838116 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:14.838866 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:14.838525 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmvbm" podUID="ff68c09e-7343-4947-8750-7fa6e793287c" Jul 15 22:33:15.347721 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:15.347675 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff68c09e-7343-4947-8750-7fa6e793287c-metrics-certs\") pod \"network-metrics-daemon-qmvbm\" (UID: \"ff68c09e-7343-4947-8750-7fa6e793287c\") " pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:15.347913 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:15.347735 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23a965f4-47c0-432e-9676-53861bba6186-original-pull-secret\") pod \"global-pull-secret-syncer-dvf88\" (UID: \"23a965f4-47c0-432e-9676-53861bba6186\") " pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:15.348055 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:15.348035 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:15.348151 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:15.348112 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a965f4-47c0-432e-9676-53861bba6186-original-pull-secret podName:23a965f4-47c0-432e-9676-53861bba6186 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:19.348092232 +0000 UTC m=+9.055889806 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23a965f4-47c0-432e-9676-53861bba6186-original-pull-secret") pod "global-pull-secret-syncer-dvf88" (UID: "23a965f4-47c0-432e-9676-53861bba6186") : object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:15.348547 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:15.348527 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:15.348645 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:15.348590 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff68c09e-7343-4947-8750-7fa6e793287c-metrics-certs podName:ff68c09e-7343-4947-8750-7fa6e793287c nodeName:}" failed. No retries permitted until 2026-07-15 22:33:19.348571327 +0000 UTC m=+9.056368902 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff68c09e-7343-4947-8750-7fa6e793287c-metrics-certs") pod "network-metrics-daemon-qmvbm" (UID: "ff68c09e-7343-4947-8750-7fa6e793287c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:15.448295 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:15.448202 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6wvs\" (UniqueName: \"kubernetes.io/projected/6fe341c4-845e-4412-a026-ea8463d7191c-kube-api-access-m6wvs\") pod \"network-check-target-x64tv\" (UID: \"6fe341c4-845e-4412-a026-ea8463d7191c\") " pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:15.448453 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:15.448431 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 22:33:15.448453 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:15.448451 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 22:33:15.448591 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:15.448464 2560 projected.go:196] Error preparing data for projected volume kube-api-access-m6wvs for pod openshift-network-diagnostics/network-check-target-x64tv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:15.448591 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:15.448522 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fe341c4-845e-4412-a026-ea8463d7191c-kube-api-access-m6wvs podName:6fe341c4-845e-4412-a026-ea8463d7191c nodeName:}" failed. No retries permitted until 2026-07-15 22:33:19.448502735 +0000 UTC m=+9.156300309 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-m6wvs" (UniqueName: "kubernetes.io/projected/6fe341c4-845e-4412-a026-ea8463d7191c-kube-api-access-m6wvs") pod "network-check-target-x64tv" (UID: "6fe341c4-845e-4412-a026-ea8463d7191c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:15.835482 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:15.835395 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:15.835645 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:15.835570 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x64tv" podUID="6fe341c4-845e-4412-a026-ea8463d7191c" Jul 15 22:33:15.835710 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:15.835647 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:15.835757 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:15.835717 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvf88" podUID="23a965f4-47c0-432e-9676-53861bba6186" Jul 15 22:33:16.835689 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:16.835649 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:16.836232 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:16.835797 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmvbm" podUID="ff68c09e-7343-4947-8750-7fa6e793287c" Jul 15 22:33:17.834846 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:17.834807 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:17.835072 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:17.834979 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x64tv" podUID="6fe341c4-845e-4412-a026-ea8463d7191c" Jul 15 22:33:17.835424 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:17.835397 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:17.835544 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:17.835520 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvf88" podUID="23a965f4-47c0-432e-9676-53861bba6186" Jul 15 22:33:18.835522 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:18.835482 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:18.835989 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:18.835645 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmvbm" podUID="ff68c09e-7343-4947-8750-7fa6e793287c" Jul 15 22:33:19.384357 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:19.383373 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff68c09e-7343-4947-8750-7fa6e793287c-metrics-certs\") pod \"network-metrics-daemon-qmvbm\" (UID: \"ff68c09e-7343-4947-8750-7fa6e793287c\") " pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:19.384357 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:19.383427 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23a965f4-47c0-432e-9676-53861bba6186-original-pull-secret\") pod \"global-pull-secret-syncer-dvf88\" (UID: \"23a965f4-47c0-432e-9676-53861bba6186\") " pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:19.384357 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:19.383488 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:19.384357 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:19.383554 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff68c09e-7343-4947-8750-7fa6e793287c-metrics-certs podName:ff68c09e-7343-4947-8750-7fa6e793287c nodeName:}" failed. No retries permitted until 2026-07-15 22:33:27.383538522 +0000 UTC m=+17.091336092 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff68c09e-7343-4947-8750-7fa6e793287c-metrics-certs") pod "network-metrics-daemon-qmvbm" (UID: "ff68c09e-7343-4947-8750-7fa6e793287c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:19.384357 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:19.383565 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:19.384357 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:19.383619 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a965f4-47c0-432e-9676-53861bba6186-original-pull-secret podName:23a965f4-47c0-432e-9676-53861bba6186 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:27.383603484 +0000 UTC m=+17.091401076 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23a965f4-47c0-432e-9676-53861bba6186-original-pull-secret") pod "global-pull-secret-syncer-dvf88" (UID: "23a965f4-47c0-432e-9676-53861bba6186") : object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:19.484327 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:19.484285 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6wvs\" (UniqueName: \"kubernetes.io/projected/6fe341c4-845e-4412-a026-ea8463d7191c-kube-api-access-m6wvs\") pod \"network-check-target-x64tv\" (UID: \"6fe341c4-845e-4412-a026-ea8463d7191c\") " pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:19.484533 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:19.484512 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 22:33:19.484626 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:19.484537 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 22:33:19.484626 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:19.484547 2560 projected.go:196] Error preparing data for projected volume kube-api-access-m6wvs for pod openshift-network-diagnostics/network-check-target-x64tv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:19.484626 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:19.484612 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fe341c4-845e-4412-a026-ea8463d7191c-kube-api-access-m6wvs podName:6fe341c4-845e-4412-a026-ea8463d7191c nodeName:}" failed. No retries permitted until 2026-07-15 22:33:27.484593779 +0000 UTC m=+17.192391355 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-m6wvs" (UniqueName: "kubernetes.io/projected/6fe341c4-845e-4412-a026-ea8463d7191c-kube-api-access-m6wvs") pod "network-check-target-x64tv" (UID: "6fe341c4-845e-4412-a026-ea8463d7191c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:19.835427 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:19.834844 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:19.835427 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:19.834983 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvf88" podUID="23a965f4-47c0-432e-9676-53861bba6186" Jul 15 22:33:19.835427 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:19.835267 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:19.835427 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:19.835332 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x64tv" podUID="6fe341c4-845e-4412-a026-ea8463d7191c" Jul 15 22:33:20.835392 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:20.835361 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:20.835553 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:20.835452 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmvbm" podUID="ff68c09e-7343-4947-8750-7fa6e793287c" Jul 15 22:33:21.834981 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:21.834942 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:21.835157 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:21.834949 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:21.835157 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:21.835080 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvf88" podUID="23a965f4-47c0-432e-9676-53861bba6186" Jul 15 22:33:21.835281 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:21.835163 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x64tv" podUID="6fe341c4-845e-4412-a026-ea8463d7191c" Jul 15 22:33:22.835686 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:22.835650 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:22.836255 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:22.835800 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmvbm" podUID="ff68c09e-7343-4947-8750-7fa6e793287c" Jul 15 22:33:23.835213 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:23.835185 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:23.835213 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:23.835199 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:23.835401 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:23.835291 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvf88" podUID="23a965f4-47c0-432e-9676-53861bba6186" Jul 15 22:33:23.835444 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:23.835420 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x64tv" podUID="6fe341c4-845e-4412-a026-ea8463d7191c" Jul 15 22:33:24.835065 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:24.834982 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:24.835509 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:24.835115 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmvbm" podUID="ff68c09e-7343-4947-8750-7fa6e793287c" Jul 15 22:33:25.834898 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:25.834865 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:25.835069 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:25.834909 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:25.835069 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:25.834990 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x64tv" podUID="6fe341c4-845e-4412-a026-ea8463d7191c" Jul 15 22:33:25.835438 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:25.835080 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvf88" podUID="23a965f4-47c0-432e-9676-53861bba6186" Jul 15 22:33:26.834827 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:26.834785 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:26.835025 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:26.834936 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmvbm" podUID="ff68c09e-7343-4947-8750-7fa6e793287c" Jul 15 22:33:27.442255 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:27.442210 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff68c09e-7343-4947-8750-7fa6e793287c-metrics-certs\") pod \"network-metrics-daemon-qmvbm\" (UID: \"ff68c09e-7343-4947-8750-7fa6e793287c\") " pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:27.442780 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:27.442263 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23a965f4-47c0-432e-9676-53861bba6186-original-pull-secret\") pod \"global-pull-secret-syncer-dvf88\" (UID: \"23a965f4-47c0-432e-9676-53861bba6186\") " pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:27.442780 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:27.442367 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:27.442780 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:27.442388 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:27.442780 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:27.442434 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff68c09e-7343-4947-8750-7fa6e793287c-metrics-certs podName:ff68c09e-7343-4947-8750-7fa6e793287c nodeName:}" failed. No retries permitted until 2026-07-15 22:33:43.44241739 +0000 UTC m=+33.150214959 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff68c09e-7343-4947-8750-7fa6e793287c-metrics-certs") pod "network-metrics-daemon-qmvbm" (UID: "ff68c09e-7343-4947-8750-7fa6e793287c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:27.442780 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:27.442459 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a965f4-47c0-432e-9676-53861bba6186-original-pull-secret podName:23a965f4-47c0-432e-9676-53861bba6186 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:43.442444983 +0000 UTC m=+33.150242553 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23a965f4-47c0-432e-9676-53861bba6186-original-pull-secret") pod "global-pull-secret-syncer-dvf88" (UID: "23a965f4-47c0-432e-9676-53861bba6186") : object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:27.543044 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:27.543010 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6wvs\" (UniqueName: \"kubernetes.io/projected/6fe341c4-845e-4412-a026-ea8463d7191c-kube-api-access-m6wvs\") pod \"network-check-target-x64tv\" (UID: \"6fe341c4-845e-4412-a026-ea8463d7191c\") " pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:27.543196 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:27.543164 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 22:33:27.543196 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:27.543184 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 22:33:27.543196 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:27.543194 2560 projected.go:196] Error preparing data for projected volume kube-api-access-m6wvs for pod openshift-network-diagnostics/network-check-target-x64tv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:27.543309 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:27.543253 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fe341c4-845e-4412-a026-ea8463d7191c-kube-api-access-m6wvs podName:6fe341c4-845e-4412-a026-ea8463d7191c nodeName:}" failed. No retries permitted until 2026-07-15 22:33:43.543236322 +0000 UTC m=+33.251033896 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-m6wvs" (UniqueName: "kubernetes.io/projected/6fe341c4-845e-4412-a026-ea8463d7191c-kube-api-access-m6wvs") pod "network-check-target-x64tv" (UID: "6fe341c4-845e-4412-a026-ea8463d7191c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:27.835671 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:27.835575 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:27.835671 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:27.835629 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:27.835933 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:27.835730 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvf88" podUID="23a965f4-47c0-432e-9676-53861bba6186" Jul 15 22:33:27.835933 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:27.835898 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x64tv" podUID="6fe341c4-845e-4412-a026-ea8463d7191c" Jul 15 22:33:28.834720 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:28.834689 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:28.835092 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:28.834797 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmvbm" podUID="ff68c09e-7343-4947-8750-7fa6e793287c" Jul 15 22:33:29.835625 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:29.835583 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:29.835625 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:29.835610 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:29.836140 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:29.835712 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvf88" podUID="23a965f4-47c0-432e-9676-53861bba6186" Jul 15 22:33:29.836140 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:29.835878 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x64tv" podUID="6fe341c4-845e-4412-a026-ea8463d7191c" Jul 15 22:33:30.837365 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:30.837333 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:30.837755 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:30.837433 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmvbm" podUID="ff68c09e-7343-4947-8750-7fa6e793287c" Jul 15 22:33:31.834916 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:31.834873 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:31.835077 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:31.834919 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:31.835077 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:31.835004 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvf88" podUID="23a965f4-47c0-432e-9676-53861bba6186" Jul 15 22:33:31.835163 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:31.835119 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x64tv" podUID="6fe341c4-845e-4412-a026-ea8463d7191c" Jul 15 22:33:32.834821 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:32.834793 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:32.835222 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:32.834923 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmvbm" podUID="ff68c09e-7343-4947-8750-7fa6e793287c" Jul 15 22:33:33.835965 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:33.835332 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:33.835965 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:33.835810 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x64tv" podUID="6fe341c4-845e-4412-a026-ea8463d7191c" Jul 15 22:33:33.837358 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:33.837197 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:33.837358 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:33.837318 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvf88" podUID="23a965f4-47c0-432e-9676-53861bba6186" Jul 15 22:33:34.031694 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.031658 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal" event={"ID":"d92af667d32b12b1c5e1720a5f8568a2","Type":"ContainerStarted","Data":"e067b4a7c5591b5c06feb8c0c1813d100b4019c957f05e20e56479b24537b140"} Jul 15 22:33:34.033182 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.033159 2560 generic.go:356] "Generic (PLEG): container finished" podID="fc502a8ea47d4d8f1c1a1b6b929db20a" containerID="bfde8535490ece4a9b2b319946037eeee6c67f2de3da41a6bc9efd45081209b3" exitCode=0 Jul 15 22:33:34.033286 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.033226 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" event={"ID":"fc502a8ea47d4d8f1c1a1b6b929db20a","Type":"ContainerDied","Data":"bfde8535490ece4a9b2b319946037eeee6c67f2de3da41a6bc9efd45081209b3"} Jul 15 22:33:34.034705 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.034685 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xgqq7" event={"ID":"c60b5390-688d-46bb-a3f8-70b746073689","Type":"ContainerStarted","Data":"4fa398bd4255f5d57027e2bf08d55ec52e90cbedf876652dea2e8ef4493d3376"} Jul 15 22:33:34.037284 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.037267 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/ovn-acl-logging/0.log" Jul 15 22:33:34.037594 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.037577 2560 generic.go:356] "Generic (PLEG): container finished" podID="162185e2-da05-43cd-9b88-f2fa765a4a55" containerID="54f010dd8f48de68b710fec21e809ef3d30acdffb32aac6f02ea57862c7a33d3" exitCode=1 Jul 15 22:33:34.037649 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.037636 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" event={"ID":"162185e2-da05-43cd-9b88-f2fa765a4a55","Type":"ContainerStarted","Data":"4894a4c7f51941e2a18efba21b2174c988b47017a3db7ef3e2304db5c740c5ea"} Jul 15 22:33:34.037703 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.037682 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" event={"ID":"162185e2-da05-43cd-9b88-f2fa765a4a55","Type":"ContainerStarted","Data":"764cb6837c5febe1ad2180a8f17527ffa408be32af7712abaa9a0ed5721251ab"} Jul 15 22:33:34.037822 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.037731 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" event={"ID":"162185e2-da05-43cd-9b88-f2fa765a4a55","Type":"ContainerStarted","Data":"18e02b2f2702e0c56562ea2a32db61c3e1e5a5713973a9a0d7d2112cb815b682"} Jul 15 22:33:34.037822 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.037769 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" event={"ID":"162185e2-da05-43cd-9b88-f2fa765a4a55","Type":"ContainerStarted","Data":"61ff3a7ecd74893550ca85bc290d86fc63f4e08ccc1691824ebb34e8e112933d"} Jul 15 22:33:34.037822 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.037797 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" event={"ID":"162185e2-da05-43cd-9b88-f2fa765a4a55","Type":"ContainerDied","Data":"54f010dd8f48de68b710fec21e809ef3d30acdffb32aac6f02ea57862c7a33d3"} Jul 15 22:33:34.037970 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.037835 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" event={"ID":"162185e2-da05-43cd-9b88-f2fa765a4a55","Type":"ContainerStarted","Data":"3fde572c07506aedc84c5c410f48d3a069919b795dcf133414237991d43a3e2f"} Jul 15 22:33:34.038931 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.038912 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jgsqh" event={"ID":"ad4d4e81-c00a-4d74-b409-2c7ec97c3002","Type":"ContainerStarted","Data":"1385c61437cf74337743f9ab537ee68739bccb9ca86ddeddae0e788baf37cdf8"} Jul 15 22:33:34.040206 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.040187 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vnktr" event={"ID":"2909cc24-d826-42da-9d30-14a4ec63267d","Type":"ContainerStarted","Data":"0641c5e75be7e73f40da0b8590398b0502ab62b7e7ff0cadf8a788c634c5ce4e"} Jul 15 22:33:34.041567 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.041548 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" event={"ID":"273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a","Type":"ContainerStarted","Data":"57a36027309cc764a9289f2533f6d06fe5677f12f3f3a50ece49182716b3242a"} Jul 15 22:33:34.042757 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.042740 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" event={"ID":"fceccc65-d0e0-463d-a160-7224b2798647","Type":"ContainerStarted","Data":"0ec27774b49c82c1168c13ecf515aa2e0b144548c112f3e636bf27d288214d4c"} Jul 15 22:33:34.043987 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.043968 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-km6gb" event={"ID":"7c1ed5d4-21de-48c5-8484-c48f03cc84f4","Type":"ContainerStarted","Data":"7431bd87ee73c1e520213a0b2cdbad449518dec35ae9bf19ff443975c466867d"} Jul 15 22:33:34.045268 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.045248 2560 generic.go:356] "Generic (PLEG): container finished" podID="163d94d1-6930-4f2d-9fdf-3414a8d0071e" containerID="2c110bf58f91a7c8c8f6b26fc69bcc4b10216c9da890a89294267002ee7f01af" exitCode=0 Jul 15 22:33:34.045349 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.045278 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6wpj" event={"ID":"163d94d1-6930-4f2d-9fdf-3414a8d0071e","Type":"ContainerDied","Data":"2c110bf58f91a7c8c8f6b26fc69bcc4b10216c9da890a89294267002ee7f01af"} Jul 15 22:33:34.046055 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.045924 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal" podStartSLOduration=22.045912317 podStartE2EDuration="22.045912317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:33:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:34.04572738 +0000 UTC m=+23.753524974" watchObservedRunningTime="2026-07-15 22:33:34.045912317 +0000 UTC m=+23.753709909" Jul 15 22:33:34.059459 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.059424 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xgqq7" podStartSLOduration=2.210456203 podStartE2EDuration="23.059412793s" totalImagesPullingTime="20.84895659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:34.059310654 +0000 UTC m=+23.767108242" watchObservedRunningTime="2026-07-15 22:33:34.059412793 +0000 UTC m=+23.767210386" Jul 15 22:33:34.099151 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.099109 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vnktr" podStartSLOduration=2.290403134 podStartE2EDuration="23.099090007s" totalImagesPullingTime="20.808686873s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:34.079252125 +0000 UTC m=+23.787049717" watchObservedRunningTime="2026-07-15 22:33:34.099090007 +0000 UTC m=+23.806887601" Jul 15 22:33:34.130794 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.130752 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-km6gb" podStartSLOduration=2.172913931 podStartE2EDuration="23.130738243s" totalImagesPullingTime="20.957824312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:34.1303215 +0000 UTC m=+23.838119091" watchObservedRunningTime="2026-07-15 22:33:34.130738243 +0000 UTC m=+23.838535842" Jul 15 22:33:34.135262 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.135211 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xgqq7" Jul 15 22:33:34.135678 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.135662 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xgqq7" Jul 15 22:33:34.147711 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.147677 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rgnf2" podStartSLOduration=2.321728221 podStartE2EDuration="23.147665568s" totalImagesPullingTime="20.825937347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:34.147366756 +0000 UTC m=+23.855164349" watchObservedRunningTime="2026-07-15 22:33:34.147665568 +0000 UTC m=+23.855463159" Jul 15 22:33:34.162254 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.162217 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jgsqh" podStartSLOduration=2.085105094 podStartE2EDuration="23.162205066s" totalImagesPullingTime="21.077099972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:34.161906333 +0000 UTC m=+23.869703925" watchObservedRunningTime="2026-07-15 22:33:34.162205066 +0000 UTC m=+23.870002657" Jul 15 22:33:34.835546 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:34.835515 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:34.835710 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:34.835655 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmvbm" podUID="ff68c09e-7343-4947-8750-7fa6e793287c" Jul 15 22:33:35.049429 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:35.049389 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" event={"ID":"fc502a8ea47d4d8f1c1a1b6b929db20a","Type":"ContainerStarted","Data":"34918133d88bd7326635275e40853662ce11e98bd379687a6773a3f60df2b4ef"} Jul 15 22:33:35.051043 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:35.051015 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xk42n" event={"ID":"292fa64f-5495-4b75-8ac8-8d4893320cc1","Type":"ContainerStarted","Data":"d65881f98b4e5ea1557f08cd4b85d02485f6b55532f4a68171f0dad512e1dfe9"} Jul 15 22:33:35.065617 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:35.065497 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" podStartSLOduration=23.065480292 podStartE2EDuration="23.065480292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:33:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:35.065430224 +0000 UTC m=+24.773227817" watchObservedRunningTime="2026-07-15 22:33:35.065480292 +0000 UTC m=+24.773277885" Jul 15 22:33:35.081786 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:35.081762 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 22:33:35.779359 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:35.779233 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T22:33:35.081779572Z","UUID":"a44e00b6-2f45-4be7-abd1-06a41fa41950","Handler":null,"Name":"","Endpoint":""} Jul 15 22:33:35.781974 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:35.781662 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 22:33:35.781974 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:35.781710 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 22:33:35.835818 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:35.835139 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:35.835818 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:35.835270 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x64tv" podUID="6fe341c4-845e-4412-a026-ea8463d7191c" Jul 15 22:33:35.835818 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:35.835671 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:35.835818 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:35.835772 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvf88" podUID="23a965f4-47c0-432e-9676-53861bba6186" Jul 15 22:33:36.056808 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:36.056591 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" event={"ID":"fceccc65-d0e0-463d-a160-7224b2798647","Type":"ContainerStarted","Data":"bd1f69e23ab5a996e9923e606532ed8f4428fa9c4a3c24339b9490b1b1b6e5e0"} Jul 15 22:33:36.062512 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:36.062493 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/ovn-acl-logging/0.log" Jul 15 22:33:36.063072 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:36.062986 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" event={"ID":"162185e2-da05-43cd-9b88-f2fa765a4a55","Type":"ContainerStarted","Data":"bb60875f19f2e848e44226e3cdeb42f5e569a3fa72660105a72e9c2e94d4ee2b"} Jul 15 22:33:36.063249 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:36.063229 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 15 22:33:36.835706 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:36.835669 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:36.835975 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:36.835813 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmvbm" podUID="ff68c09e-7343-4947-8750-7fa6e793287c" Jul 15 22:33:36.955224 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:36.955179 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xgqq7" Jul 15 22:33:36.955792 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:36.955771 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xgqq7" Jul 15 22:33:36.970736 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:36.970679 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xk42n" podStartSLOduration=5.072485305 podStartE2EDuration="25.970658261s" totalImagesPullingTime="20.898172956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:35.081357691 +0000 UTC m=+24.789155284" watchObservedRunningTime="2026-07-15 22:33:36.970658261 +0000 UTC m=+26.678455854" Jul 15 22:33:37.067593 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:37.067552 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" event={"ID":"fceccc65-d0e0-463d-a160-7224b2798647","Type":"ContainerStarted","Data":"9f6bf08674ff37ac849f9b5c9a31a2dcdeb856ce6e5035baa8501e1c362c0b14"} Jul 15 22:33:37.086450 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:37.086352 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpqx5" podStartSLOduration=3.125457925 podStartE2EDuration="26.086336512s" totalImagesPullingTime="22.960878587s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:33:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:37.085998405 +0000 UTC m=+26.793795998" watchObservedRunningTime="2026-07-15 22:33:37.086336512 +0000 UTC m=+26.794134148" Jul 15 22:33:37.835252 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:37.835215 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:37.835427 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:37.835320 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x64tv" podUID="6fe341c4-845e-4412-a026-ea8463d7191c" Jul 15 22:33:37.835427 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:37.835378 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:37.835535 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:37.835502 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvf88" podUID="23a965f4-47c0-432e-9676-53861bba6186" Jul 15 22:33:38.835403 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:38.835181 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:38.836101 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:38.835431 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmvbm" podUID="ff68c09e-7343-4947-8750-7fa6e793287c" Jul 15 22:33:39.074254 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:39.074222 2560 generic.go:356] "Generic (PLEG): container finished" podID="163d94d1-6930-4f2d-9fdf-3414a8d0071e" containerID="0c0971ffc7ecc9d9beb0f0a3a9e19a8e6f7676c4d5cdca9ce7f34e359369e17e" exitCode=0 Jul 15 22:33:39.074428 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:39.074311 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6wpj" event={"ID":"163d94d1-6930-4f2d-9fdf-3414a8d0071e","Type":"ContainerDied","Data":"0c0971ffc7ecc9d9beb0f0a3a9e19a8e6f7676c4d5cdca9ce7f34e359369e17e"} Jul 15 22:33:39.077775 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:39.077758 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/ovn-acl-logging/0.log" Jul 15 22:33:39.078124 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:39.078102 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" event={"ID":"162185e2-da05-43cd-9b88-f2fa765a4a55","Type":"ContainerStarted","Data":"2b6ece643d12586e9f00cad3933021f9638c7d7a72b1297bcb6d0f4319edb285"} Jul 15 22:33:39.078403 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:39.078383 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:39.078621 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:39.078605 2560 scope.go:117] "RemoveContainer" containerID="54f010dd8f48de68b710fec21e809ef3d30acdffb32aac6f02ea57862c7a33d3" Jul 15 22:33:39.096164 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:39.096140 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:39.835362 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:39.835186 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:39.835725 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:39.835235 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:39.835725 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:39.835460 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x64tv" podUID="6fe341c4-845e-4412-a026-ea8463d7191c" Jul 15 22:33:39.835725 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:39.835499 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvf88" podUID="23a965f4-47c0-432e-9676-53861bba6186" Jul 15 22:33:40.083459 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:40.083429 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/ovn-acl-logging/0.log" Jul 15 22:33:40.083871 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:40.083829 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" event={"ID":"162185e2-da05-43cd-9b88-f2fa765a4a55","Type":"ContainerStarted","Data":"01246f17a41aa6046be1233c10a8eb818177384221cad91c615cfcf66b584b3c"} Jul 15 22:33:40.084157 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:40.084138 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:40.084253 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:40.084219 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:40.100529 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:40.100469 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:33:40.111756 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:40.111696 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" podStartSLOduration=8.115795102 podStartE2EDuration="29.111669826s" totalImagesPullingTime="20.995874724s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:40.110920129 +0000 UTC m=+29.818717720" watchObservedRunningTime="2026-07-15 22:33:40.111669826 +0000 UTC m=+29.819467416" Jul 15 22:33:40.289173 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:40.289142 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dvf88"] Jul 15 22:33:40.289320 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:40.289258 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:40.289386 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:40.289365 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvf88" podUID="23a965f4-47c0-432e-9676-53861bba6186" Jul 15 22:33:40.292523 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:40.292482 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x64tv"] Jul 15 22:33:40.292659 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:40.292610 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:40.292727 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:40.292707 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x64tv" podUID="6fe341c4-845e-4412-a026-ea8463d7191c" Jul 15 22:33:40.293324 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:40.293304 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qmvbm"] Jul 15 22:33:40.293414 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:40.293399 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:40.293500 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:40.293481 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmvbm" podUID="ff68c09e-7343-4947-8750-7fa6e793287c" Jul 15 22:33:41.087995 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:41.087956 2560 generic.go:356] "Generic (PLEG): container finished" podID="163d94d1-6930-4f2d-9fdf-3414a8d0071e" containerID="94f745376c60aaabe673d4aeaab020aaa37f592f388bcc1499b3a27523f3c944" exitCode=0 Jul 15 22:33:41.088650 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:41.088054 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6wpj" event={"ID":"163d94d1-6930-4f2d-9fdf-3414a8d0071e","Type":"ContainerDied","Data":"94f745376c60aaabe673d4aeaab020aaa37f592f388bcc1499b3a27523f3c944"} Jul 15 22:33:41.835388 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:41.835349 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:41.835388 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:41.835380 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:41.835595 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:41.835349 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:41.835595 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:41.835477 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvf88" podUID="23a965f4-47c0-432e-9676-53861bba6186" Jul 15 22:33:41.835595 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:41.835522 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x64tv" podUID="6fe341c4-845e-4412-a026-ea8463d7191c" Jul 15 22:33:41.835708 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:41.835620 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmvbm" podUID="ff68c09e-7343-4947-8750-7fa6e793287c" Jul 15 22:33:43.096408 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:43.096223 2560 generic.go:356] "Generic (PLEG): container finished" podID="163d94d1-6930-4f2d-9fdf-3414a8d0071e" containerID="fda53d6aa32837fcd75f0abe70e8b5c0b44ebff46de3068ad710e11a030f739f" exitCode=0 Jul 15 22:33:43.096408 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:43.096298 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6wpj" event={"ID":"163d94d1-6930-4f2d-9fdf-3414a8d0071e","Type":"ContainerDied","Data":"fda53d6aa32837fcd75f0abe70e8b5c0b44ebff46de3068ad710e11a030f739f"} Jul 15 22:33:43.462707 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:43.462610 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23a965f4-47c0-432e-9676-53861bba6186-original-pull-secret\") pod \"global-pull-secret-syncer-dvf88\" (UID: \"23a965f4-47c0-432e-9676-53861bba6186\") " pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:43.462707 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:43.462681 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff68c09e-7343-4947-8750-7fa6e793287c-metrics-certs\") pod \"network-metrics-daemon-qmvbm\" (UID: \"ff68c09e-7343-4947-8750-7fa6e793287c\") " pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:43.462942 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:43.462772 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:43.462942 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:43.462779 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:43.462942 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:43.462825 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff68c09e-7343-4947-8750-7fa6e793287c-metrics-certs podName:ff68c09e-7343-4947-8750-7fa6e793287c nodeName:}" failed. No retries permitted until 2026-07-15 22:34:15.462811657 +0000 UTC m=+65.170609226 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff68c09e-7343-4947-8750-7fa6e793287c-metrics-certs") pod "network-metrics-daemon-qmvbm" (UID: "ff68c09e-7343-4947-8750-7fa6e793287c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:43.462942 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:43.462868 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a965f4-47c0-432e-9676-53861bba6186-original-pull-secret podName:23a965f4-47c0-432e-9676-53861bba6186 nodeName:}" failed. No retries permitted until 2026-07-15 22:34:15.462831117 +0000 UTC m=+65.170628704 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23a965f4-47c0-432e-9676-53861bba6186-original-pull-secret") pod "global-pull-secret-syncer-dvf88" (UID: "23a965f4-47c0-432e-9676-53861bba6186") : object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:43.563513 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:43.563472 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6wvs\" (UniqueName: \"kubernetes.io/projected/6fe341c4-845e-4412-a026-ea8463d7191c-kube-api-access-m6wvs\") pod \"network-check-target-x64tv\" (UID: \"6fe341c4-845e-4412-a026-ea8463d7191c\") " pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:43.563667 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:43.563623 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 22:33:43.563667 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:43.563642 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 22:33:43.563667 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:43.563651 2560 projected.go:196] Error preparing data for projected volume kube-api-access-m6wvs for pod openshift-network-diagnostics/network-check-target-x64tv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:43.563758 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:43.563707 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fe341c4-845e-4412-a026-ea8463d7191c-kube-api-access-m6wvs podName:6fe341c4-845e-4412-a026-ea8463d7191c nodeName:}" failed. No retries permitted until 2026-07-15 22:34:15.563690051 +0000 UTC m=+65.271487638 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-m6wvs" (UniqueName: "kubernetes.io/projected/6fe341c4-845e-4412-a026-ea8463d7191c-kube-api-access-m6wvs") pod "network-check-target-x64tv" (UID: "6fe341c4-845e-4412-a026-ea8463d7191c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:43.835160 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:43.835072 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:43.835160 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:43.835112 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:43.835377 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:43.835196 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:43.835377 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:43.835212 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmvbm" podUID="ff68c09e-7343-4947-8750-7fa6e793287c" Jul 15 22:33:43.835377 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:43.835266 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x64tv" podUID="6fe341c4-845e-4412-a026-ea8463d7191c" Jul 15 22:33:43.835511 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:43.835371 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvf88" podUID="23a965f4-47c0-432e-9676-53861bba6186" Jul 15 22:33:45.145326 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.145252 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeReady" Jul 15 22:33:45.145781 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.145398 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 22:33:45.180798 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.180761 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58549999b7-njxqg"] Jul 15 22:33:45.196836 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.196780 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-9wb62"] Jul 15 22:33:45.197071 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.196907 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.200098 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.199779 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 15 22:33:45.200098 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.199823 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 15 22:33:45.200098 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.199871 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7pd8h\"" Jul 15 22:33:45.200098 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.199883 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 15 22:33:45.209010 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.208981 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 15 22:33:45.209681 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.209654 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-5q8kf"] Jul 15 22:33:45.209802 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.209786 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-9wb62" Jul 15 22:33:45.212729 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.212703 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vwwhh\"" Jul 15 22:33:45.212890 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.212874 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 15 22:33:45.213004 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.212986 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 15 22:33:45.225831 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.225804 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgtv8"] Jul 15 22:33:45.226092 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.226070 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-5q8kf" Jul 15 22:33:45.231182 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.231155 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 15 22:33:45.231335 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.231184 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 15 22:33:45.231335 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.231188 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-79dqf\"" Jul 15 22:33:45.231749 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.231728 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 15 22:33:45.232091 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.232062 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 15 22:33:45.239198 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.239166 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 15 22:33:45.246714 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.246683 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rm49r"] Jul 15 22:33:45.246925 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.246804 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgtv8" Jul 15 22:33:45.249190 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.249165 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 15 22:33:45.249488 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.249170 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 15 22:33:45.249629 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.249195 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 15 22:33:45.249736 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.249217 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-x52xj\"" Jul 15 22:33:45.249806 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.249236 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 15 22:33:45.266730 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.266694 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-648694dcdd-k656d"] Jul 15 22:33:45.267333 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.267313 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rm49r" Jul 15 22:33:45.269379 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.269350 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-p5hm4\"" Jul 15 22:33:45.269500 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.269354 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 15 22:33:45.269666 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.269569 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 15 22:33:45.269666 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.269608 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 15 22:33:45.269757 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.269708 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 15 22:33:45.273704 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.273676 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-ca-trust-extracted\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.273818 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.273725 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-image-registry-private-configuration\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.273818 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.273756 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-installation-pull-secrets\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.273818 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.273784 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-bound-sa-token\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.273818 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.273812 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-tls\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.274034 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.273841 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-certificates\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.274034 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.273907 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-trusted-ca\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.274034 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.273966 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dhlq\" (UniqueName: \"kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-kube-api-access-8dhlq\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.284916 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.284880 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-slh2k"] Jul 15 22:33:45.285089 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.284955 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:33:45.287172 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.287147 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 15 22:33:45.287318 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.287145 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-k7ftt\"" Jul 15 22:33:45.287318 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.287147 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 15 22:33:45.287428 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.287396 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 15 22:33:45.287482 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.287453 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 22:33:45.287530 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.287510 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 15 22:33:45.287598 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.287579 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 22:33:45.300057 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.300026 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9559b"] Jul 15 22:33:45.300218 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.300145 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" Jul 15 22:33:45.302265 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.302240 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-pzh6c\"" Jul 15 22:33:45.302527 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.302504 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 15 22:33:45.302603 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.302525 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 22:33:45.302763 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.302739 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 22:33:45.302837 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.302765 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 15 22:33:45.309335 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.309308 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 15 22:33:45.318250 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.318216 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-qrbzd"] Jul 15 22:33:45.318442 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.318334 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9559b" Jul 15 22:33:45.320690 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.320666 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 15 22:33:45.320899 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.320869 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 15 22:33:45.321176 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.321160 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-k2gdm\"" Jul 15 22:33:45.321242 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.321202 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 15 22:33:45.344369 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.344332 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-h7fk8"] Jul 15 22:33:45.344574 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.344480 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-qrbzd" Jul 15 22:33:45.346904 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.346878 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 15 22:33:45.347258 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.346961 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bzpvv\"" Jul 15 22:33:45.347378 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.346967 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 15 22:33:45.360375 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.360336 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-9wb62"] Jul 15 22:33:45.360375 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.360373 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-5q8kf"] Jul 15 22:33:45.360569 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.360388 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58549999b7-njxqg"] Jul 15 22:33:45.360569 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.360403 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgtv8"] Jul 15 22:33:45.360569 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.360424 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rm49r"] Jul 15 22:33:45.360569 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.360444 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9559b"] Jul 15 22:33:45.360569 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.360472 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-qrbzd"] Jul 15 22:33:45.360569 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.360489 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-h7fk8"] Jul 15 22:33:45.360569 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.360500 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-h7fk8" Jul 15 22:33:45.360940 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.360509 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-wslf7"] Jul 15 22:33:45.363135 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.362956 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 22:33:45.363135 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.362956 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 22:33:45.363319 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.363236 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 15 22:33:45.363472 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.363448 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 15 22:33:45.363716 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.363650 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b5wsh\"" Jul 15 22:33:45.375350 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.375317 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d57dc934-8cdc-4f82-8ee8-527f9cc60a41-trusted-ca\") pod \"console-operator-7866497494-5q8kf\" (UID: \"d57dc934-8cdc-4f82-8ee8-527f9cc60a41\") " pod="openshift-console-operator/console-operator-7866497494-5q8kf" Jul 15 22:33:45.375350 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.375361 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e0e4204-98b9-48ae-b4c6-f0fba1e4d854-tmp\") pod \"insights-operator-68d9dd94cf-slh2k\" (UID: \"1e0e4204-98b9-48ae-b4c6-f0fba1e4d854\") " pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" Jul 15 22:33:45.375568 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.375394 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d57dc934-8cdc-4f82-8ee8-527f9cc60a41-config\") pod \"console-operator-7866497494-5q8kf\" (UID: \"d57dc934-8cdc-4f82-8ee8-527f9cc60a41\") " pod="openshift-console-operator/console-operator-7866497494-5q8kf" Jul 15 22:33:45.375568 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.375445 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e0e4204-98b9-48ae-b4c6-f0fba1e4d854-serving-cert\") pod \"insights-operator-68d9dd94cf-slh2k\" (UID: \"1e0e4204-98b9-48ae-b4c6-f0fba1e4d854\") " pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" Jul 15 22:33:45.375568 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.375482 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hbv2\" (UniqueName: \"kubernetes.io/projected/1e0e4204-98b9-48ae-b4c6-f0fba1e4d854-kube-api-access-7hbv2\") pod \"insights-operator-68d9dd94cf-slh2k\" (UID: \"1e0e4204-98b9-48ae-b4c6-f0fba1e4d854\") " pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" Jul 15 22:33:45.375568 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.375513 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfq8p\" (UniqueName: \"kubernetes.io/projected/6526d328-fec6-480f-a622-d418194e153f-kube-api-access-pfq8p\") pod \"service-ca-operator-7695fc6c8c-bgtv8\" (UID: \"6526d328-fec6-480f-a622-d418194e153f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgtv8" Jul 15 22:33:45.375568 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.375551 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-ca-trust-extracted\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.375771 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.375577 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6526d328-fec6-480f-a622-d418194e153f-serving-cert\") pod \"service-ca-operator-7695fc6c8c-bgtv8\" (UID: \"6526d328-fec6-480f-a622-d418194e153f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgtv8" Jul 15 22:33:45.375771 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.375612 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-image-registry-private-configuration\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.375771 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.375637 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-installation-pull-secrets\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.375771 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.375662 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-bound-sa-token\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.375771 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.375689 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1e0e4204-98b9-48ae-b4c6-f0fba1e4d854-snapshots\") pod \"insights-operator-68d9dd94cf-slh2k\" (UID: \"1e0e4204-98b9-48ae-b4c6-f0fba1e4d854\") " pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" Jul 15 22:33:45.375771 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.375714 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-certificates\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.375771 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.375741 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ls6n\" (UniqueName: \"kubernetes.io/projected/8cf4b329-d324-41a2-8c29-455e212189df-kube-api-access-9ls6n\") pod \"volume-data-source-validator-78495597f6-9wb62\" (UID: \"8cf4b329-d324-41a2-8c29-455e212189df\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-9wb62" Jul 15 22:33:45.376095 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.375788 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e0e4204-98b9-48ae-b4c6-f0fba1e4d854-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-slh2k\" (UID: \"1e0e4204-98b9-48ae-b4c6-f0fba1e4d854\") " pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" Jul 15 22:33:45.376095 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.375815 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e0e4204-98b9-48ae-b4c6-f0fba1e4d854-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-slh2k\" (UID: \"1e0e4204-98b9-48ae-b4c6-f0fba1e4d854\") " pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" Jul 15 22:33:45.376095 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.375831 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c457296e-9f39-44cf-850d-f0c2de93e13a-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-rm49r\" (UID: \"c457296e-9f39-44cf-850d-f0c2de93e13a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rm49r" Jul 15 22:33:45.376095 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.375875 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr29z\" (UniqueName: \"kubernetes.io/projected/d57dc934-8cdc-4f82-8ee8-527f9cc60a41-kube-api-access-jr29z\") pod \"console-operator-7866497494-5q8kf\" (UID: \"d57dc934-8cdc-4f82-8ee8-527f9cc60a41\") " pod="openshift-console-operator/console-operator-7866497494-5q8kf" Jul 15 22:33:45.376095 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.375895 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-stats-auth\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:33:45.376095 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.375911 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c457296e-9f39-44cf-850d-f0c2de93e13a-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-rm49r\" (UID: \"c457296e-9f39-44cf-850d-f0c2de93e13a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rm49r" Jul 15 22:33:45.376095 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.375943 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dhlq\" (UniqueName: \"kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-kube-api-access-8dhlq\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.376095 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.375960 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4c8e27d-68fe-4f3e-be10-c9995397ce75-service-ca-bundle\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:33:45.376095 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.375975 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-metrics-certs\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:33:45.376095 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.375976 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-ca-trust-extracted\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.376095 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.376000 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-default-certificate\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:33:45.376095 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.376018 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6526d328-fec6-480f-a622-d418194e153f-config\") pod \"service-ca-operator-7695fc6c8c-bgtv8\" (UID: \"6526d328-fec6-480f-a622-d418194e153f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgtv8" Jul 15 22:33:45.376095 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.376036 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-tls\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.376095 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.376054 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-trusted-ca\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.376095 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.376069 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmngv\" (UniqueName: \"kubernetes.io/projected/c457296e-9f39-44cf-850d-f0c2de93e13a-kube-api-access-nmngv\") pod \"kube-storage-version-migrator-operator-799cb7f958-rm49r\" (UID: \"c457296e-9f39-44cf-850d-f0c2de93e13a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rm49r" Jul 15 22:33:45.376742 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.376090 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssn6p\" (UniqueName: \"kubernetes.io/projected/f4c8e27d-68fe-4f3e-be10-c9995397ce75-kube-api-access-ssn6p\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:33:45.376742 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.376107 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d57dc934-8cdc-4f82-8ee8-527f9cc60a41-serving-cert\") pod \"console-operator-7866497494-5q8kf\" (UID: \"d57dc934-8cdc-4f82-8ee8-527f9cc60a41\") " pod="openshift-console-operator/console-operator-7866497494-5q8kf" Jul 15 22:33:45.376742 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:45.376358 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 22:33:45.376742 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:45.376377 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58549999b7-njxqg: secret "image-registry-tls" not found Jul 15 22:33:45.376742 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:45.376447 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-tls podName:9ccbed96-e66b-4d37-8d20-dbe2f78782ff nodeName:}" failed. No retries permitted until 2026-07-15 22:33:45.876422026 +0000 UTC m=+35.584219596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-tls") pod "image-registry-58549999b7-njxqg" (UID: "9ccbed96-e66b-4d37-8d20-dbe2f78782ff") : secret "image-registry-tls" not found Jul 15 22:33:45.377037 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.377017 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-trusted-ca\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.377272 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.377256 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-certificates\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.378476 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.378456 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kxgqn"] Jul 15 22:33:45.378604 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.378583 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-wslf7" Jul 15 22:33:45.380909 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.380875 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-image-registry-private-configuration\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.381052 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.380957 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-installation-pull-secrets\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.381122 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.381073 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 22:33:45.381193 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.381169 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-q5bfg\"" Jul 15 22:33:45.381332 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.381313 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 22:33:45.387917 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.387883 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-bound-sa-token\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.388061 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.387897 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dhlq\" (UniqueName: \"kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-kube-api-access-8dhlq\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.402610 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.402584 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jfckj"] Jul 15 22:33:45.402971 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.402951 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kxgqn" Jul 15 22:33:45.405465 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.405435 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 22:33:45.405805 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.405751 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-trnq4\"" Jul 15 22:33:45.406164 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.406146 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 22:33:45.423079 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.423048 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-648694dcdd-k656d"] Jul 15 22:33:45.423079 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.423089 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-slh2k"] Jul 15 22:33:45.423287 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.423115 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-wslf7"] Jul 15 22:33:45.423287 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.423136 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jfckj"] Jul 15 22:33:45.423287 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.423153 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kxgqn"] Jul 15 22:33:45.423287 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.423177 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jfckj" Jul 15 22:33:45.425797 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.425767 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 22:33:45.426135 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.426116 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 22:33:45.426245 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.426164 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 22:33:45.426245 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.426125 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l8qc7\"" Jul 15 22:33:45.476760 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.476726 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ls6n\" (UniqueName: \"kubernetes.io/projected/8cf4b329-d324-41a2-8c29-455e212189df-kube-api-access-9ls6n\") pod \"volume-data-source-validator-78495597f6-9wb62\" (UID: \"8cf4b329-d324-41a2-8c29-455e212189df\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-9wb62" Jul 15 22:33:45.476972 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.476782 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e0e4204-98b9-48ae-b4c6-f0fba1e4d854-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-slh2k\" (UID: \"1e0e4204-98b9-48ae-b4c6-f0fba1e4d854\") " pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" Jul 15 22:33:45.476972 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.476941 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e0e4204-98b9-48ae-b4c6-f0fba1e4d854-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-slh2k\" (UID: \"1e0e4204-98b9-48ae-b4c6-f0fba1e4d854\") " pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" Jul 15 22:33:45.477082 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.476988 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c457296e-9f39-44cf-850d-f0c2de93e13a-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-rm49r\" (UID: \"c457296e-9f39-44cf-850d-f0c2de93e13a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rm49r" Jul 15 22:33:45.477082 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477025 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr29z\" (UniqueName: \"kubernetes.io/projected/d57dc934-8cdc-4f82-8ee8-527f9cc60a41-kube-api-access-jr29z\") pod \"console-operator-7866497494-5q8kf\" (UID: \"d57dc934-8cdc-4f82-8ee8-527f9cc60a41\") " pod="openshift-console-operator/console-operator-7866497494-5q8kf" Jul 15 22:33:45.477082 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477052 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-config-volume\") pod \"dns-default-kxgqn\" (UID: \"ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c\") " pod="openshift-dns/dns-default-kxgqn" Jul 15 22:33:45.477082 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477073 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-tmp-dir\") pod \"dns-default-kxgqn\" (UID: \"ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c\") " pod="openshift-dns/dns-default-kxgqn" Jul 15 22:33:45.477281 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477100 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-stats-auth\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:33:45.477281 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477123 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c457296e-9f39-44cf-850d-f0c2de93e13a-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-rm49r\" (UID: \"c457296e-9f39-44cf-850d-f0c2de93e13a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rm49r" Jul 15 22:33:45.477281 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477188 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4c8e27d-68fe-4f3e-be10-c9995397ce75-service-ca-bundle\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:33:45.477281 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477216 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-metrics-certs\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:33:45.477281 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477240 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-metrics-tls\") pod \"dns-default-kxgqn\" (UID: \"ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c\") " pod="openshift-dns/dns-default-kxgqn" Jul 15 22:33:45.477281 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477273 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4bnj\" (UniqueName: \"kubernetes.io/projected/a9449068-86e9-4d65-b4bb-5e547dce7a53-kube-api-access-l4bnj\") pod \"network-check-source-869dcfcdcd-wslf7\" (UID: \"a9449068-86e9-4d65-b4bb-5e547dce7a53\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-wslf7" Jul 15 22:33:45.477576 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477300 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/737eff29-32ba-455b-9797-2f28637bc394-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-h7fk8\" (UID: \"737eff29-32ba-455b-9797-2f28637bc394\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-h7fk8" Jul 15 22:33:45.477576 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477328 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-default-certificate\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:33:45.477576 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477357 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6526d328-fec6-480f-a622-d418194e153f-config\") pod \"service-ca-operator-7695fc6c8c-bgtv8\" (UID: \"6526d328-fec6-480f-a622-d418194e153f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgtv8" Jul 15 22:33:45.477576 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477381 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b16bdd28-7aff-4ac6-bcd9-914c5ba36272-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9559b\" (UID: \"b16bdd28-7aff-4ac6-bcd9-914c5ba36272\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9559b" Jul 15 22:33:45.477576 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477406 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c52ad677-93ac-46bf-ab02-65226d1863a2-nginx-conf\") pod \"networking-console-plugin-6cf856758c-qrbzd\" (UID: \"c52ad677-93ac-46bf-ab02-65226d1863a2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qrbzd" Jul 15 22:33:45.477576 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477464 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmngv\" (UniqueName: \"kubernetes.io/projected/c457296e-9f39-44cf-850d-f0c2de93e13a-kube-api-access-nmngv\") pod \"kube-storage-version-migrator-operator-799cb7f958-rm49r\" (UID: \"c457296e-9f39-44cf-850d-f0c2de93e13a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rm49r" Jul 15 22:33:45.477576 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477491 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5bt8\" (UniqueName: \"kubernetes.io/projected/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-kube-api-access-z5bt8\") pod \"dns-default-kxgqn\" (UID: \"ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c\") " pod="openshift-dns/dns-default-kxgqn" Jul 15 22:33:45.477576 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477533 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e0e4204-98b9-48ae-b4c6-f0fba1e4d854-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-slh2k\" (UID: \"1e0e4204-98b9-48ae-b4c6-f0fba1e4d854\") " pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" Jul 15 22:33:45.477576 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477523 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssn6p\" (UniqueName: \"kubernetes.io/projected/f4c8e27d-68fe-4f3e-be10-c9995397ce75-kube-api-access-ssn6p\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:33:45.478026 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477588 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d57dc934-8cdc-4f82-8ee8-527f9cc60a41-serving-cert\") pod \"console-operator-7866497494-5q8kf\" (UID: \"d57dc934-8cdc-4f82-8ee8-527f9cc60a41\") " pod="openshift-console-operator/console-operator-7866497494-5q8kf" Jul 15 22:33:45.478026 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477620 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d57dc934-8cdc-4f82-8ee8-527f9cc60a41-trusted-ca\") pod \"console-operator-7866497494-5q8kf\" (UID: \"d57dc934-8cdc-4f82-8ee8-527f9cc60a41\") " pod="openshift-console-operator/console-operator-7866497494-5q8kf" Jul 15 22:33:45.478026 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477647 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e0e4204-98b9-48ae-b4c6-f0fba1e4d854-tmp\") pod \"insights-operator-68d9dd94cf-slh2k\" (UID: \"1e0e4204-98b9-48ae-b4c6-f0fba1e4d854\") " pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" Jul 15 22:33:45.478026 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477684 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e0e4204-98b9-48ae-b4c6-f0fba1e4d854-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-slh2k\" (UID: \"1e0e4204-98b9-48ae-b4c6-f0fba1e4d854\") " pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" Jul 15 22:33:45.478026 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477714 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d57dc934-8cdc-4f82-8ee8-527f9cc60a41-config\") pod \"console-operator-7866497494-5q8kf\" (UID: \"d57dc934-8cdc-4f82-8ee8-527f9cc60a41\") " pod="openshift-console-operator/console-operator-7866497494-5q8kf" Jul 15 22:33:45.478026 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477741 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e0e4204-98b9-48ae-b4c6-f0fba1e4d854-serving-cert\") pod \"insights-operator-68d9dd94cf-slh2k\" (UID: \"1e0e4204-98b9-48ae-b4c6-f0fba1e4d854\") " pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" Jul 15 22:33:45.478026 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477766 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hbv2\" (UniqueName: \"kubernetes.io/projected/1e0e4204-98b9-48ae-b4c6-f0fba1e4d854-kube-api-access-7hbv2\") pod \"insights-operator-68d9dd94cf-slh2k\" (UID: \"1e0e4204-98b9-48ae-b4c6-f0fba1e4d854\") " pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" Jul 15 22:33:45.478026 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477792 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfq8p\" (UniqueName: \"kubernetes.io/projected/6526d328-fec6-480f-a622-d418194e153f-kube-api-access-pfq8p\") pod \"service-ca-operator-7695fc6c8c-bgtv8\" (UID: \"6526d328-fec6-480f-a622-d418194e153f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgtv8" Jul 15 22:33:45.478026 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477825 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqrlf\" (UniqueName: \"kubernetes.io/projected/b16bdd28-7aff-4ac6-bcd9-914c5ba36272-kube-api-access-tqrlf\") pod \"cluster-samples-operator-65db858894-9559b\" (UID: \"b16bdd28-7aff-4ac6-bcd9-914c5ba36272\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9559b" Jul 15 22:33:45.478026 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477884 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6526d328-fec6-480f-a622-d418194e153f-serving-cert\") pod \"service-ca-operator-7695fc6c8c-bgtv8\" (UID: \"6526d328-fec6-480f-a622-d418194e153f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgtv8" Jul 15 22:33:45.478026 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:45.477914 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4c8e27d-68fe-4f3e-be10-c9995397ce75-service-ca-bundle podName:f4c8e27d-68fe-4f3e-be10-c9995397ce75 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:45.977895028 +0000 UTC m=+35.685692615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4c8e27d-68fe-4f3e-be10-c9995397ce75-service-ca-bundle") pod "router-default-648694dcdd-k656d" (UID: "f4c8e27d-68fe-4f3e-be10-c9995397ce75") : configmap references non-existent config key: service-ca.crt Jul 15 22:33:45.478026 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477936 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c52ad677-93ac-46bf-ab02-65226d1863a2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-qrbzd\" (UID: \"c52ad677-93ac-46bf-ab02-65226d1863a2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qrbzd" Jul 15 22:33:45.478026 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.477975 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/737eff29-32ba-455b-9797-2f28637bc394-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-h7fk8\" (UID: \"737eff29-32ba-455b-9797-2f28637bc394\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-h7fk8" Jul 15 22:33:45.478026 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.478000 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmh5l\" (UniqueName: \"kubernetes.io/projected/737eff29-32ba-455b-9797-2f28637bc394-kube-api-access-rmh5l\") pod \"cluster-monitoring-operator-5f7f494dd4-h7fk8\" (UID: \"737eff29-32ba-455b-9797-2f28637bc394\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-h7fk8" Jul 15 22:33:45.478682 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.478036 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1e0e4204-98b9-48ae-b4c6-f0fba1e4d854-snapshots\") pod \"insights-operator-68d9dd94cf-slh2k\" (UID: \"1e0e4204-98b9-48ae-b4c6-f0fba1e4d854\") " pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" Jul 15 22:33:45.478682 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:45.478281 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 22:33:45.478682 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:45.478323 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-metrics-certs podName:f4c8e27d-68fe-4f3e-be10-c9995397ce75 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:45.978309263 +0000 UTC m=+35.686106833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-metrics-certs") pod "router-default-648694dcdd-k656d" (UID: "f4c8e27d-68fe-4f3e-be10-c9995397ce75") : secret "router-metrics-certs-default" not found Jul 15 22:33:45.478682 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.478654 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1e0e4204-98b9-48ae-b4c6-f0fba1e4d854-snapshots\") pod \"insights-operator-68d9dd94cf-slh2k\" (UID: \"1e0e4204-98b9-48ae-b4c6-f0fba1e4d854\") " pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" Jul 15 22:33:45.479157 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.479122 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6526d328-fec6-480f-a622-d418194e153f-config\") pod \"service-ca-operator-7695fc6c8c-bgtv8\" (UID: \"6526d328-fec6-480f-a622-d418194e153f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgtv8" Jul 15 22:33:45.480461 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.479422 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c457296e-9f39-44cf-850d-f0c2de93e13a-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-rm49r\" (UID: \"c457296e-9f39-44cf-850d-f0c2de93e13a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rm49r" Jul 15 22:33:45.480461 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.479717 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e0e4204-98b9-48ae-b4c6-f0fba1e4d854-tmp\") pod \"insights-operator-68d9dd94cf-slh2k\" (UID: \"1e0e4204-98b9-48ae-b4c6-f0fba1e4d854\") " pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" Jul 15 22:33:45.480461 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.480328 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d57dc934-8cdc-4f82-8ee8-527f9cc60a41-config\") pod \"console-operator-7866497494-5q8kf\" (UID: \"d57dc934-8cdc-4f82-8ee8-527f9cc60a41\") " pod="openshift-console-operator/console-operator-7866497494-5q8kf" Jul 15 22:33:45.480670 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.480495 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d57dc934-8cdc-4f82-8ee8-527f9cc60a41-trusted-ca\") pod \"console-operator-7866497494-5q8kf\" (UID: \"d57dc934-8cdc-4f82-8ee8-527f9cc60a41\") " pod="openshift-console-operator/console-operator-7866497494-5q8kf" Jul 15 22:33:45.480670 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.480659 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6526d328-fec6-480f-a622-d418194e153f-serving-cert\") pod \"service-ca-operator-7695fc6c8c-bgtv8\" (UID: \"6526d328-fec6-480f-a622-d418194e153f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgtv8" Jul 15 22:33:45.481245 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.481200 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-default-certificate\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:33:45.481313 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.481255 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d57dc934-8cdc-4f82-8ee8-527f9cc60a41-serving-cert\") pod \"console-operator-7866497494-5q8kf\" (UID: \"d57dc934-8cdc-4f82-8ee8-527f9cc60a41\") " pod="openshift-console-operator/console-operator-7866497494-5q8kf" Jul 15 22:33:45.481313 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.481263 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c457296e-9f39-44cf-850d-f0c2de93e13a-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-rm49r\" (UID: \"c457296e-9f39-44cf-850d-f0c2de93e13a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rm49r" Jul 15 22:33:45.482254 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.482233 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-stats-auth\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:33:45.483339 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.483318 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e0e4204-98b9-48ae-b4c6-f0fba1e4d854-serving-cert\") pod \"insights-operator-68d9dd94cf-slh2k\" (UID: \"1e0e4204-98b9-48ae-b4c6-f0fba1e4d854\") " pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" Jul 15 22:33:45.486153 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.486130 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr29z\" (UniqueName: \"kubernetes.io/projected/d57dc934-8cdc-4f82-8ee8-527f9cc60a41-kube-api-access-jr29z\") pod \"console-operator-7866497494-5q8kf\" (UID: \"d57dc934-8cdc-4f82-8ee8-527f9cc60a41\") " pod="openshift-console-operator/console-operator-7866497494-5q8kf" Jul 15 22:33:45.487980 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.487958 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmngv\" (UniqueName: \"kubernetes.io/projected/c457296e-9f39-44cf-850d-f0c2de93e13a-kube-api-access-nmngv\") pod \"kube-storage-version-migrator-operator-799cb7f958-rm49r\" (UID: \"c457296e-9f39-44cf-850d-f0c2de93e13a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rm49r" Jul 15 22:33:45.488844 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.488822 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfq8p\" (UniqueName: \"kubernetes.io/projected/6526d328-fec6-480f-a622-d418194e153f-kube-api-access-pfq8p\") pod \"service-ca-operator-7695fc6c8c-bgtv8\" (UID: \"6526d328-fec6-480f-a622-d418194e153f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgtv8" Jul 15 22:33:45.492564 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.492541 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hbv2\" (UniqueName: \"kubernetes.io/projected/1e0e4204-98b9-48ae-b4c6-f0fba1e4d854-kube-api-access-7hbv2\") pod \"insights-operator-68d9dd94cf-slh2k\" (UID: \"1e0e4204-98b9-48ae-b4c6-f0fba1e4d854\") " pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" Jul 15 22:33:45.492656 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.492543 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssn6p\" (UniqueName: \"kubernetes.io/projected/f4c8e27d-68fe-4f3e-be10-c9995397ce75-kube-api-access-ssn6p\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:33:45.497421 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.497383 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ls6n\" (UniqueName: \"kubernetes.io/projected/8cf4b329-d324-41a2-8c29-455e212189df-kube-api-access-9ls6n\") pod \"volume-data-source-validator-78495597f6-9wb62\" (UID: \"8cf4b329-d324-41a2-8c29-455e212189df\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-9wb62" Jul 15 22:33:45.527284 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.527248 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-9wb62" Jul 15 22:33:45.540512 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.540472 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-5q8kf" Jul 15 22:33:45.557514 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.557487 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgtv8" Jul 15 22:33:45.577687 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.577659 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rm49r" Jul 15 22:33:45.578412 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.578381 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqrlf\" (UniqueName: \"kubernetes.io/projected/b16bdd28-7aff-4ac6-bcd9-914c5ba36272-kube-api-access-tqrlf\") pod \"cluster-samples-operator-65db858894-9559b\" (UID: \"b16bdd28-7aff-4ac6-bcd9-914c5ba36272\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9559b" Jul 15 22:33:45.578550 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.578422 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c52ad677-93ac-46bf-ab02-65226d1863a2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-qrbzd\" (UID: \"c52ad677-93ac-46bf-ab02-65226d1863a2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qrbzd" Jul 15 22:33:45.578550 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.578453 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/737eff29-32ba-455b-9797-2f28637bc394-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-h7fk8\" (UID: \"737eff29-32ba-455b-9797-2f28637bc394\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-h7fk8" Jul 15 22:33:45.578550 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.578479 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmh5l\" (UniqueName: \"kubernetes.io/projected/737eff29-32ba-455b-9797-2f28637bc394-kube-api-access-rmh5l\") pod \"cluster-monitoring-operator-5f7f494dd4-h7fk8\" (UID: \"737eff29-32ba-455b-9797-2f28637bc394\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-h7fk8" Jul 15 22:33:45.578550 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.578529 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-config-volume\") pod \"dns-default-kxgqn\" (UID: \"ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c\") " pod="openshift-dns/dns-default-kxgqn" Jul 15 22:33:45.578550 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.578551 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-tmp-dir\") pod \"dns-default-kxgqn\" (UID: \"ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c\") " pod="openshift-dns/dns-default-kxgqn" Jul 15 22:33:45.578989 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:45.578556 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 22:33:45.578989 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:45.578589 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 22:33:45.578989 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.578598 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/977c5892-fbf7-4dbe-9e69-7b084b7095bf-cert\") pod \"ingress-canary-jfckj\" (UID: \"977c5892-fbf7-4dbe-9e69-7b084b7095bf\") " pod="openshift-ingress-canary/ingress-canary-jfckj" Jul 15 22:33:45.578989 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:45.578628 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/737eff29-32ba-455b-9797-2f28637bc394-cluster-monitoring-operator-tls podName:737eff29-32ba-455b-9797-2f28637bc394 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:46.07860871 +0000 UTC m=+35.786406301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/737eff29-32ba-455b-9797-2f28637bc394-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-h7fk8" (UID: "737eff29-32ba-455b-9797-2f28637bc394") : secret "cluster-monitoring-operator-tls" not found Jul 15 22:33:45.578989 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:45.578657 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52ad677-93ac-46bf-ab02-65226d1863a2-networking-console-plugin-cert podName:c52ad677-93ac-46bf-ab02-65226d1863a2 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:46.078638961 +0000 UTC m=+35.786436551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c52ad677-93ac-46bf-ab02-65226d1863a2-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-qrbzd" (UID: "c52ad677-93ac-46bf-ab02-65226d1863a2") : secret "networking-console-plugin-cert" not found Jul 15 22:33:45.578989 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.578724 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rgm5\" (UniqueName: \"kubernetes.io/projected/977c5892-fbf7-4dbe-9e69-7b084b7095bf-kube-api-access-9rgm5\") pod \"ingress-canary-jfckj\" (UID: \"977c5892-fbf7-4dbe-9e69-7b084b7095bf\") " pod="openshift-ingress-canary/ingress-canary-jfckj" Jul 15 22:33:45.578989 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.578778 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-metrics-tls\") pod \"dns-default-kxgqn\" (UID: \"ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c\") " pod="openshift-dns/dns-default-kxgqn" Jul 15 22:33:45.578989 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.578816 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4bnj\" (UniqueName: \"kubernetes.io/projected/a9449068-86e9-4d65-b4bb-5e547dce7a53-kube-api-access-l4bnj\") pod \"network-check-source-869dcfcdcd-wslf7\" (UID: \"a9449068-86e9-4d65-b4bb-5e547dce7a53\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-wslf7" Jul 15 22:33:45.578989 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.578843 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/737eff29-32ba-455b-9797-2f28637bc394-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-h7fk8\" (UID: \"737eff29-32ba-455b-9797-2f28637bc394\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-h7fk8" Jul 15 22:33:45.578989 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.578893 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b16bdd28-7aff-4ac6-bcd9-914c5ba36272-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9559b\" (UID: \"b16bdd28-7aff-4ac6-bcd9-914c5ba36272\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9559b" Jul 15 22:33:45.578989 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.578916 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c52ad677-93ac-46bf-ab02-65226d1863a2-nginx-conf\") pod \"networking-console-plugin-6cf856758c-qrbzd\" (UID: \"c52ad677-93ac-46bf-ab02-65226d1863a2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qrbzd" Jul 15 22:33:45.578989 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.578964 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5bt8\" (UniqueName: \"kubernetes.io/projected/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-kube-api-access-z5bt8\") pod \"dns-default-kxgqn\" (UID: \"ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c\") " pod="openshift-dns/dns-default-kxgqn" Jul 15 22:33:45.579571 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.579028 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-tmp-dir\") pod \"dns-default-kxgqn\" (UID: \"ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c\") " pod="openshift-dns/dns-default-kxgqn" Jul 15 22:33:45.579571 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:45.579226 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 22:33:45.579571 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.579254 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-config-volume\") pod \"dns-default-kxgqn\" (UID: \"ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c\") " pod="openshift-dns/dns-default-kxgqn" Jul 15 22:33:45.579571 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:45.579277 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-metrics-tls podName:ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c nodeName:}" failed. No retries permitted until 2026-07-15 22:33:46.079263744 +0000 UTC m=+35.787061316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-metrics-tls") pod "dns-default-kxgqn" (UID: "ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c") : secret "dns-default-metrics-tls" not found Jul 15 22:33:45.579571 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:45.579332 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 22:33:45.579571 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:45.579367 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b16bdd28-7aff-4ac6-bcd9-914c5ba36272-samples-operator-tls podName:b16bdd28-7aff-4ac6-bcd9-914c5ba36272 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:46.07935702 +0000 UTC m=+35.787154605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b16bdd28-7aff-4ac6-bcd9-914c5ba36272-samples-operator-tls") pod "cluster-samples-operator-65db858894-9559b" (UID: "b16bdd28-7aff-4ac6-bcd9-914c5ba36272") : secret "samples-operator-tls" not found Jul 15 22:33:45.579890 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.579841 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c52ad677-93ac-46bf-ab02-65226d1863a2-nginx-conf\") pod \"networking-console-plugin-6cf856758c-qrbzd\" (UID: \"c52ad677-93ac-46bf-ab02-65226d1863a2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qrbzd" Jul 15 22:33:45.580266 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.580244 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/737eff29-32ba-455b-9797-2f28637bc394-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-h7fk8\" (UID: \"737eff29-32ba-455b-9797-2f28637bc394\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-h7fk8" Jul 15 22:33:45.589795 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.589762 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqrlf\" (UniqueName: \"kubernetes.io/projected/b16bdd28-7aff-4ac6-bcd9-914c5ba36272-kube-api-access-tqrlf\") pod \"cluster-samples-operator-65db858894-9559b\" (UID: \"b16bdd28-7aff-4ac6-bcd9-914c5ba36272\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9559b" Jul 15 22:33:45.590038 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.590015 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5bt8\" (UniqueName: \"kubernetes.io/projected/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-kube-api-access-z5bt8\") pod \"dns-default-kxgqn\" (UID: \"ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c\") " pod="openshift-dns/dns-default-kxgqn" Jul 15 22:33:45.590496 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.590465 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmh5l\" (UniqueName: \"kubernetes.io/projected/737eff29-32ba-455b-9797-2f28637bc394-kube-api-access-rmh5l\") pod \"cluster-monitoring-operator-5f7f494dd4-h7fk8\" (UID: \"737eff29-32ba-455b-9797-2f28637bc394\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-h7fk8" Jul 15 22:33:45.590596 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.590583 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4bnj\" (UniqueName: \"kubernetes.io/projected/a9449068-86e9-4d65-b4bb-5e547dce7a53-kube-api-access-l4bnj\") pod \"network-check-source-869dcfcdcd-wslf7\" (UID: \"a9449068-86e9-4d65-b4bb-5e547dce7a53\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-wslf7" Jul 15 22:33:45.611458 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.611270 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" Jul 15 22:33:45.684115 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.680107 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rgm5\" (UniqueName: \"kubernetes.io/projected/977c5892-fbf7-4dbe-9e69-7b084b7095bf-kube-api-access-9rgm5\") pod \"ingress-canary-jfckj\" (UID: \"977c5892-fbf7-4dbe-9e69-7b084b7095bf\") " pod="openshift-ingress-canary/ingress-canary-jfckj" Jul 15 22:33:45.684115 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.680613 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/977c5892-fbf7-4dbe-9e69-7b084b7095bf-cert\") pod \"ingress-canary-jfckj\" (UID: \"977c5892-fbf7-4dbe-9e69-7b084b7095bf\") " pod="openshift-ingress-canary/ingress-canary-jfckj" Jul 15 22:33:45.690279 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.690243 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/977c5892-fbf7-4dbe-9e69-7b084b7095bf-cert\") pod \"ingress-canary-jfckj\" (UID: \"977c5892-fbf7-4dbe-9e69-7b084b7095bf\") " pod="openshift-ingress-canary/ingress-canary-jfckj" Jul 15 22:33:45.693234 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.693175 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rgm5\" (UniqueName: \"kubernetes.io/projected/977c5892-fbf7-4dbe-9e69-7b084b7095bf-kube-api-access-9rgm5\") pod \"ingress-canary-jfckj\" (UID: \"977c5892-fbf7-4dbe-9e69-7b084b7095bf\") " pod="openshift-ingress-canary/ingress-canary-jfckj" Jul 15 22:33:45.704375 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.704335 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-wslf7" Jul 15 22:33:45.734237 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.733418 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jfckj" Jul 15 22:33:45.784743 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.784696 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-9wb62"] Jul 15 22:33:45.798574 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.798535 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-5q8kf"] Jul 15 22:33:45.809380 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.809343 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgtv8"] Jul 15 22:33:45.820801 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.820773 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rm49r"] Jul 15 22:33:45.834647 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.834602 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:33:45.834813 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.834723 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:33:45.834813 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.834759 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:33:45.837491 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.837459 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 22:33:45.837621 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.837494 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-84k7s\"" Jul 15 22:33:45.837621 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.837462 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qmq28\"" Jul 15 22:33:45.837787 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.837748 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 22:33:45.882986 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.882950 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-tls\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:45.883160 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:45.883130 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 22:33:45.883160 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:45.883152 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58549999b7-njxqg: secret "image-registry-tls" not found Jul 15 22:33:45.883269 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:45.883237 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-tls podName:9ccbed96-e66b-4d37-8d20-dbe2f78782ff nodeName:}" failed. No retries permitted until 2026-07-15 22:33:46.883216965 +0000 UTC m=+36.591014537 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-tls") pod "image-registry-58549999b7-njxqg" (UID: "9ccbed96-e66b-4d37-8d20-dbe2f78782ff") : secret "image-registry-tls" not found Jul 15 22:33:45.984732 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.984597 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4c8e27d-68fe-4f3e-be10-c9995397ce75-service-ca-bundle\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:33:45.984732 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:45.984648 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-metrics-certs\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:33:45.984975 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:45.984765 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 22:33:45.984975 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:45.984779 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4c8e27d-68fe-4f3e-be10-c9995397ce75-service-ca-bundle podName:f4c8e27d-68fe-4f3e-be10-c9995397ce75 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:46.984755078 +0000 UTC m=+36.692552662 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4c8e27d-68fe-4f3e-be10-c9995397ce75-service-ca-bundle") pod "router-default-648694dcdd-k656d" (UID: "f4c8e27d-68fe-4f3e-be10-c9995397ce75") : configmap references non-existent config key: service-ca.crt Jul 15 22:33:45.984975 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:45.984814 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-metrics-certs podName:f4c8e27d-68fe-4f3e-be10-c9995397ce75 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:46.984799106 +0000 UTC m=+36.692596680 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-metrics-certs") pod "router-default-648694dcdd-k656d" (UID: "f4c8e27d-68fe-4f3e-be10-c9995397ce75") : secret "router-metrics-certs-default" not found Jul 15 22:33:46.085150 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:46.085100 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c52ad677-93ac-46bf-ab02-65226d1863a2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-qrbzd\" (UID: \"c52ad677-93ac-46bf-ab02-65226d1863a2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qrbzd" Jul 15 22:33:46.085316 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:46.085158 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/737eff29-32ba-455b-9797-2f28637bc394-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-h7fk8\" (UID: \"737eff29-32ba-455b-9797-2f28637bc394\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-h7fk8" Jul 15 22:33:46.085316 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:46.085254 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-metrics-tls\") pod \"dns-default-kxgqn\" (UID: \"ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c\") " pod="openshift-dns/dns-default-kxgqn" Jul 15 22:33:46.085316 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:46.085267 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 22:33:46.085316 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:46.085294 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b16bdd28-7aff-4ac6-bcd9-914c5ba36272-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9559b\" (UID: \"b16bdd28-7aff-4ac6-bcd9-914c5ba36272\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9559b" Jul 15 22:33:46.085443 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:46.085324 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 22:33:46.085443 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:46.085367 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 22:33:46.085443 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:46.085338 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52ad677-93ac-46bf-ab02-65226d1863a2-networking-console-plugin-cert podName:c52ad677-93ac-46bf-ab02-65226d1863a2 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:47.085316358 +0000 UTC m=+36.793113954 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c52ad677-93ac-46bf-ab02-65226d1863a2-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-qrbzd" (UID: "c52ad677-93ac-46bf-ab02-65226d1863a2") : secret "networking-console-plugin-cert" not found Jul 15 22:33:46.085443 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:46.085400 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 22:33:46.085561 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:46.085402 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/737eff29-32ba-455b-9797-2f28637bc394-cluster-monitoring-operator-tls podName:737eff29-32ba-455b-9797-2f28637bc394 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:47.085384579 +0000 UTC m=+36.793182150 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/737eff29-32ba-455b-9797-2f28637bc394-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-h7fk8" (UID: "737eff29-32ba-455b-9797-2f28637bc394") : secret "cluster-monitoring-operator-tls" not found Jul 15 22:33:46.085561 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:46.085468 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b16bdd28-7aff-4ac6-bcd9-914c5ba36272-samples-operator-tls podName:b16bdd28-7aff-4ac6-bcd9-914c5ba36272 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:47.085457388 +0000 UTC m=+36.793254958 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b16bdd28-7aff-4ac6-bcd9-914c5ba36272-samples-operator-tls") pod "cluster-samples-operator-65db858894-9559b" (UID: "b16bdd28-7aff-4ac6-bcd9-914c5ba36272") : secret "samples-operator-tls" not found Jul 15 22:33:46.085561 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:46.085487 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-metrics-tls podName:ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c nodeName:}" failed. No retries permitted until 2026-07-15 22:33:47.085476996 +0000 UTC m=+36.793274566 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-metrics-tls") pod "dns-default-kxgqn" (UID: "ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c") : secret "dns-default-metrics-tls" not found Jul 15 22:33:46.894329 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:46.894295 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-tls\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:46.895157 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:46.894486 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 22:33:46.895157 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:46.894512 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58549999b7-njxqg: secret "image-registry-tls" not found Jul 15 22:33:46.895157 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:46.894588 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-tls podName:9ccbed96-e66b-4d37-8d20-dbe2f78782ff nodeName:}" failed. No retries permitted until 2026-07-15 22:33:48.894568527 +0000 UTC m=+38.602366098 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-tls") pod "image-registry-58549999b7-njxqg" (UID: "9ccbed96-e66b-4d37-8d20-dbe2f78782ff") : secret "image-registry-tls" not found Jul 15 22:33:46.995708 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:46.995664 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4c8e27d-68fe-4f3e-be10-c9995397ce75-service-ca-bundle\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:33:46.995708 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:46.995705 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-metrics-certs\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:33:46.995959 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:46.995875 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 22:33:46.995959 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:46.995898 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4c8e27d-68fe-4f3e-be10-c9995397ce75-service-ca-bundle podName:f4c8e27d-68fe-4f3e-be10-c9995397ce75 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:48.995877071 +0000 UTC m=+38.703674657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4c8e27d-68fe-4f3e-be10-c9995397ce75-service-ca-bundle") pod "router-default-648694dcdd-k656d" (UID: "f4c8e27d-68fe-4f3e-be10-c9995397ce75") : configmap references non-existent config key: service-ca.crt Jul 15 22:33:46.995959 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:46.995922 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-metrics-certs podName:f4c8e27d-68fe-4f3e-be10-c9995397ce75 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:48.995911429 +0000 UTC m=+38.703709000 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-metrics-certs") pod "router-default-648694dcdd-k656d" (UID: "f4c8e27d-68fe-4f3e-be10-c9995397ce75") : secret "router-metrics-certs-default" not found Jul 15 22:33:47.096453 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:47.096406 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c52ad677-93ac-46bf-ab02-65226d1863a2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-qrbzd\" (UID: \"c52ad677-93ac-46bf-ab02-65226d1863a2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qrbzd" Jul 15 22:33:47.096656 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:47.096471 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/737eff29-32ba-455b-9797-2f28637bc394-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-h7fk8\" (UID: \"737eff29-32ba-455b-9797-2f28637bc394\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-h7fk8" Jul 15 22:33:47.096656 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:47.096544 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-metrics-tls\") pod \"dns-default-kxgqn\" (UID: \"ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c\") " pod="openshift-dns/dns-default-kxgqn" Jul 15 22:33:47.096656 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:47.096571 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b16bdd28-7aff-4ac6-bcd9-914c5ba36272-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9559b\" (UID: \"b16bdd28-7aff-4ac6-bcd9-914c5ba36272\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9559b" Jul 15 22:33:47.096656 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:47.096579 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 22:33:47.096656 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:47.096618 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 22:33:47.096656 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:47.096652 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52ad677-93ac-46bf-ab02-65226d1863a2-networking-console-plugin-cert podName:c52ad677-93ac-46bf-ab02-65226d1863a2 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:49.096636153 +0000 UTC m=+38.804433727 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c52ad677-93ac-46bf-ab02-65226d1863a2-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-qrbzd" (UID: "c52ad677-93ac-46bf-ab02-65226d1863a2") : secret "networking-console-plugin-cert" not found Jul 15 22:33:47.096931 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:47.096682 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/737eff29-32ba-455b-9797-2f28637bc394-cluster-monitoring-operator-tls podName:737eff29-32ba-455b-9797-2f28637bc394 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:49.096663694 +0000 UTC m=+38.804461280 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/737eff29-32ba-455b-9797-2f28637bc394-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-h7fk8" (UID: "737eff29-32ba-455b-9797-2f28637bc394") : secret "cluster-monitoring-operator-tls" not found Jul 15 22:33:47.096931 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:47.096695 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 22:33:47.096931 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:47.096695 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 22:33:47.096931 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:47.096747 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b16bdd28-7aff-4ac6-bcd9-914c5ba36272-samples-operator-tls podName:b16bdd28-7aff-4ac6-bcd9-914c5ba36272 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:49.096734687 +0000 UTC m=+38.804532259 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b16bdd28-7aff-4ac6-bcd9-914c5ba36272-samples-operator-tls") pod "cluster-samples-operator-65db858894-9559b" (UID: "b16bdd28-7aff-4ac6-bcd9-914c5ba36272") : secret "samples-operator-tls" not found Jul 15 22:33:47.096931 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:47.096764 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-metrics-tls podName:ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c nodeName:}" failed. No retries permitted until 2026-07-15 22:33:49.096755329 +0000 UTC m=+38.804552899 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-metrics-tls") pod "dns-default-kxgqn" (UID: "ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c") : secret "dns-default-metrics-tls" not found Jul 15 22:33:47.308366 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:47.308288 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cf4b329_d324_41a2_8c29_455e212189df.slice/crio-bf04ebed73cef8d34e3190b20828bc2a0e23291f34fd71478bbcb83382ae715d WatchSource:0}: Error finding container bf04ebed73cef8d34e3190b20828bc2a0e23291f34fd71478bbcb83382ae715d: Status 404 returned error can't find the container with id bf04ebed73cef8d34e3190b20828bc2a0e23291f34fd71478bbcb83382ae715d Jul 15 22:33:47.309233 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:47.308891 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd57dc934_8cdc_4f82_8ee8_527f9cc60a41.slice/crio-92addcc4edcace7c5590c057d6b7acfa37708fa98cd3476150382c734c1aabef WatchSource:0}: Error finding container 92addcc4edcace7c5590c057d6b7acfa37708fa98cd3476150382c734c1aabef: Status 404 returned error can't find the container with id 92addcc4edcace7c5590c057d6b7acfa37708fa98cd3476150382c734c1aabef Jul 15 22:33:47.309648 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:47.309626 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc457296e_9f39_44cf_850d_f0c2de93e13a.slice/crio-2e83be2de05b373b322ee18945e5807a3f1bc8f9d0cbbed605ec354742bb6e85 WatchSource:0}: Error finding container 2e83be2de05b373b322ee18945e5807a3f1bc8f9d0cbbed605ec354742bb6e85: Status 404 returned error can't find the container with id 2e83be2de05b373b322ee18945e5807a3f1bc8f9d0cbbed605ec354742bb6e85 Jul 15 22:33:47.311178 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:47.311154 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6526d328_fec6_480f_a622_d418194e153f.slice/crio-d95734e9fcf77913f054f962f791fbf057ee0b2441abc642a8a86e1513597971 WatchSource:0}: Error finding container d95734e9fcf77913f054f962f791fbf057ee0b2441abc642a8a86e1513597971: Status 404 returned error can't find the container with id d95734e9fcf77913f054f962f791fbf057ee0b2441abc642a8a86e1513597971 Jul 15 22:33:47.460232 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:47.460199 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-slh2k"] Jul 15 22:33:47.464320 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:47.464290 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e0e4204_98b9_48ae_b4c6_f0fba1e4d854.slice/crio-f913017cc769be6cf2268872b819fd3ccaec9f1a2a475ad789a70f3974aa113b WatchSource:0}: Error finding container f913017cc769be6cf2268872b819fd3ccaec9f1a2a475ad789a70f3974aa113b: Status 404 returned error can't find the container with id f913017cc769be6cf2268872b819fd3ccaec9f1a2a475ad789a70f3974aa113b Jul 15 22:33:47.465080 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:47.465059 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-wslf7"] Jul 15 22:33:47.468099 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:47.468067 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9449068_86e9_4d65_b4bb_5e547dce7a53.slice/crio-67a58a924b39cd1b6632cddefbf975b9a05be00cfd73c4bcb9b11b7738cce349 WatchSource:0}: Error finding container 67a58a924b39cd1b6632cddefbf975b9a05be00cfd73c4bcb9b11b7738cce349: Status 404 returned error can't find the container with id 67a58a924b39cd1b6632cddefbf975b9a05be00cfd73c4bcb9b11b7738cce349 Jul 15 22:33:47.470667 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:47.470647 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jfckj"] Jul 15 22:33:47.474450 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:33:47.474418 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod977c5892_fbf7_4dbe_9e69_7b084b7095bf.slice/crio-5cc4713747462502070cba3926c2823477d175cc48b67f73af50b3af0d2e342e WatchSource:0}: Error finding container 5cc4713747462502070cba3926c2823477d175cc48b67f73af50b3af0d2e342e: Status 404 returned error can't find the container with id 5cc4713747462502070cba3926c2823477d175cc48b67f73af50b3af0d2e342e Jul 15 22:33:48.113771 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:48.113713 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-wslf7" event={"ID":"a9449068-86e9-4d65-b4bb-5e547dce7a53","Type":"ContainerStarted","Data":"67a58a924b39cd1b6632cddefbf975b9a05be00cfd73c4bcb9b11b7738cce349"} Jul 15 22:33:48.118777 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:48.118739 2560 generic.go:356] "Generic (PLEG): container finished" podID="163d94d1-6930-4f2d-9fdf-3414a8d0071e" containerID="e395a495109134ae4dd68878b7667c37a30677478e72803deb24b6410a5bd0df" exitCode=0 Jul 15 22:33:48.118973 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:48.118867 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6wpj" event={"ID":"163d94d1-6930-4f2d-9fdf-3414a8d0071e","Type":"ContainerDied","Data":"e395a495109134ae4dd68878b7667c37a30677478e72803deb24b6410a5bd0df"} Jul 15 22:33:48.123968 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:48.123930 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jfckj" event={"ID":"977c5892-fbf7-4dbe-9e69-7b084b7095bf","Type":"ContainerStarted","Data":"5cc4713747462502070cba3926c2823477d175cc48b67f73af50b3af0d2e342e"} Jul 15 22:33:48.127312 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:48.127279 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-9wb62" event={"ID":"8cf4b329-d324-41a2-8c29-455e212189df","Type":"ContainerStarted","Data":"bf04ebed73cef8d34e3190b20828bc2a0e23291f34fd71478bbcb83382ae715d"} Jul 15 22:33:48.130442 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:48.130401 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rm49r" event={"ID":"c457296e-9f39-44cf-850d-f0c2de93e13a","Type":"ContainerStarted","Data":"2e83be2de05b373b322ee18945e5807a3f1bc8f9d0cbbed605ec354742bb6e85"} Jul 15 22:33:48.132502 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:48.132471 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgtv8" event={"ID":"6526d328-fec6-480f-a622-d418194e153f","Type":"ContainerStarted","Data":"d95734e9fcf77913f054f962f791fbf057ee0b2441abc642a8a86e1513597971"} Jul 15 22:33:48.134671 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:48.134588 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" event={"ID":"1e0e4204-98b9-48ae-b4c6-f0fba1e4d854","Type":"ContainerStarted","Data":"f913017cc769be6cf2268872b819fd3ccaec9f1a2a475ad789a70f3974aa113b"} Jul 15 22:33:48.136845 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:48.136814 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-5q8kf" event={"ID":"d57dc934-8cdc-4f82-8ee8-527f9cc60a41","Type":"ContainerStarted","Data":"92addcc4edcace7c5590c057d6b7acfa37708fa98cd3476150382c734c1aabef"} Jul 15 22:33:48.916716 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:48.916526 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-tls\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:48.916939 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:48.916821 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 22:33:48.916939 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:48.916838 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58549999b7-njxqg: secret "image-registry-tls" not found Jul 15 22:33:48.916939 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:48.916921 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-tls podName:9ccbed96-e66b-4d37-8d20-dbe2f78782ff nodeName:}" failed. No retries permitted until 2026-07-15 22:33:52.916893892 +0000 UTC m=+42.624691464 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-tls") pod "image-registry-58549999b7-njxqg" (UID: "9ccbed96-e66b-4d37-8d20-dbe2f78782ff") : secret "image-registry-tls" not found Jul 15 22:33:49.018697 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:49.018096 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4c8e27d-68fe-4f3e-be10-c9995397ce75-service-ca-bundle\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:33:49.018697 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:49.018145 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-metrics-certs\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:33:49.018697 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:49.018268 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 22:33:49.018697 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:49.018314 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-metrics-certs podName:f4c8e27d-68fe-4f3e-be10-c9995397ce75 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:53.018302431 +0000 UTC m=+42.726100001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-metrics-certs") pod "router-default-648694dcdd-k656d" (UID: "f4c8e27d-68fe-4f3e-be10-c9995397ce75") : secret "router-metrics-certs-default" not found Jul 15 22:33:49.018697 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:49.018650 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4c8e27d-68fe-4f3e-be10-c9995397ce75-service-ca-bundle podName:f4c8e27d-68fe-4f3e-be10-c9995397ce75 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:53.018639033 +0000 UTC m=+42.726436602 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4c8e27d-68fe-4f3e-be10-c9995397ce75-service-ca-bundle") pod "router-default-648694dcdd-k656d" (UID: "f4c8e27d-68fe-4f3e-be10-c9995397ce75") : configmap references non-existent config key: service-ca.crt Jul 15 22:33:49.119214 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:49.119156 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c52ad677-93ac-46bf-ab02-65226d1863a2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-qrbzd\" (UID: \"c52ad677-93ac-46bf-ab02-65226d1863a2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qrbzd" Jul 15 22:33:49.119214 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:49.119220 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/737eff29-32ba-455b-9797-2f28637bc394-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-h7fk8\" (UID: \"737eff29-32ba-455b-9797-2f28637bc394\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-h7fk8" Jul 15 22:33:49.119820 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:49.119334 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-metrics-tls\") pod \"dns-default-kxgqn\" (UID: \"ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c\") " pod="openshift-dns/dns-default-kxgqn" Jul 15 22:33:49.119820 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:49.119355 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 22:33:49.119820 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:49.119452 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52ad677-93ac-46bf-ab02-65226d1863a2-networking-console-plugin-cert podName:c52ad677-93ac-46bf-ab02-65226d1863a2 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:53.119430925 +0000 UTC m=+42.827228496 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c52ad677-93ac-46bf-ab02-65226d1863a2-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-qrbzd" (UID: "c52ad677-93ac-46bf-ab02-65226d1863a2") : secret "networking-console-plugin-cert" not found Jul 15 22:33:49.119820 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:49.119470 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 22:33:49.119820 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:49.119488 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 22:33:49.119820 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:49.119355 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 22:33:49.119820 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:49.119380 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b16bdd28-7aff-4ac6-bcd9-914c5ba36272-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9559b\" (UID: \"b16bdd28-7aff-4ac6-bcd9-914c5ba36272\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9559b" Jul 15 22:33:49.119820 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:49.119524 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b16bdd28-7aff-4ac6-bcd9-914c5ba36272-samples-operator-tls podName:b16bdd28-7aff-4ac6-bcd9-914c5ba36272 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:53.119508974 +0000 UTC m=+42.827306547 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b16bdd28-7aff-4ac6-bcd9-914c5ba36272-samples-operator-tls") pod "cluster-samples-operator-65db858894-9559b" (UID: "b16bdd28-7aff-4ac6-bcd9-914c5ba36272") : secret "samples-operator-tls" not found Jul 15 22:33:49.119820 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:49.119577 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-metrics-tls podName:ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c nodeName:}" failed. No retries permitted until 2026-07-15 22:33:53.119564573 +0000 UTC m=+42.827362150 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-metrics-tls") pod "dns-default-kxgqn" (UID: "ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c") : secret "dns-default-metrics-tls" not found Jul 15 22:33:49.119820 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:49.119595 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/737eff29-32ba-455b-9797-2f28637bc394-cluster-monitoring-operator-tls podName:737eff29-32ba-455b-9797-2f28637bc394 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:53.119585964 +0000 UTC m=+42.827383536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/737eff29-32ba-455b-9797-2f28637bc394-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-h7fk8" (UID: "737eff29-32ba-455b-9797-2f28637bc394") : secret "cluster-monitoring-operator-tls" not found Jul 15 22:33:49.152712 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:49.152672 2560 generic.go:356] "Generic (PLEG): container finished" podID="163d94d1-6930-4f2d-9fdf-3414a8d0071e" containerID="69539d9b1642a74d2a65c0da57d138062961aa1b5a79dcb27d4928078daabcf0" exitCode=0 Jul 15 22:33:49.152920 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:49.152745 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6wpj" event={"ID":"163d94d1-6930-4f2d-9fdf-3414a8d0071e","Type":"ContainerDied","Data":"69539d9b1642a74d2a65c0da57d138062961aa1b5a79dcb27d4928078daabcf0"} Jul 15 22:33:50.161514 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:50.161430 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6wpj" event={"ID":"163d94d1-6930-4f2d-9fdf-3414a8d0071e","Type":"ContainerStarted","Data":"a9db9012805dd054566c3d49b03e5f372dba881f32061c867248b4b74e9591e9"} Jul 15 22:33:50.164772 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:50.164710 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-9wb62" event={"ID":"8cf4b329-d324-41a2-8c29-455e212189df","Type":"ContainerStarted","Data":"3cafce8cb954f352a32d2b30cf5f198ecb8d49f4706163497d0d661cad7d46ee"} Jul 15 22:33:50.188422 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:50.188368 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h6wpj" podStartSLOduration=6.9751611780000005 podStartE2EDuration="39.188350988s" totalImagesPullingTime="32.21318981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:33:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:50.187697883 +0000 UTC m=+39.895495477" watchObservedRunningTime="2026-07-15 22:33:50.188350988 +0000 UTC m=+39.896148571" Jul 15 22:33:50.208694 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:50.208641 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-9wb62" podStartSLOduration=31.160155165 podStartE2EDuration="33.208623635s" totalImagesPullingTime="2.04846847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:33:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:50.207681282 +0000 UTC m=+39.915478875" watchObservedRunningTime="2026-07-15 22:33:50.208623635 +0000 UTC m=+39.916421227" Jul 15 22:33:52.960746 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:52.960701 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-tls\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:33:52.961324 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:52.960880 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 22:33:52.961324 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:52.960901 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58549999b7-njxqg: secret "image-registry-tls" not found Jul 15 22:33:52.961324 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:52.960969 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-tls podName:9ccbed96-e66b-4d37-8d20-dbe2f78782ff nodeName:}" failed. No retries permitted until 2026-07-15 22:34:00.960951872 +0000 UTC m=+50.668749445 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-tls") pod "image-registry-58549999b7-njxqg" (UID: "9ccbed96-e66b-4d37-8d20-dbe2f78782ff") : secret "image-registry-tls" not found Jul 15 22:33:53.061709 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:53.061668 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4c8e27d-68fe-4f3e-be10-c9995397ce75-service-ca-bundle\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:33:53.061709 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:53.061712 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-metrics-certs\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:33:53.061997 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:53.061871 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4c8e27d-68fe-4f3e-be10-c9995397ce75-service-ca-bundle podName:f4c8e27d-68fe-4f3e-be10-c9995397ce75 nodeName:}" failed. No retries permitted until 2026-07-15 22:34:01.061831723 +0000 UTC m=+50.769629299 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4c8e27d-68fe-4f3e-be10-c9995397ce75-service-ca-bundle") pod "router-default-648694dcdd-k656d" (UID: "f4c8e27d-68fe-4f3e-be10-c9995397ce75") : configmap references non-existent config key: service-ca.crt Jul 15 22:33:53.061997 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:53.061881 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 22:33:53.061997 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:53.061928 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-metrics-certs podName:f4c8e27d-68fe-4f3e-be10-c9995397ce75 nodeName:}" failed. No retries permitted until 2026-07-15 22:34:01.061917076 +0000 UTC m=+50.769714653 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-metrics-certs") pod "router-default-648694dcdd-k656d" (UID: "f4c8e27d-68fe-4f3e-be10-c9995397ce75") : secret "router-metrics-certs-default" not found Jul 15 22:33:53.162477 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:53.162425 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c52ad677-93ac-46bf-ab02-65226d1863a2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-qrbzd\" (UID: \"c52ad677-93ac-46bf-ab02-65226d1863a2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qrbzd" Jul 15 22:33:53.162682 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:53.162492 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/737eff29-32ba-455b-9797-2f28637bc394-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-h7fk8\" (UID: \"737eff29-32ba-455b-9797-2f28637bc394\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-h7fk8" Jul 15 22:33:53.162682 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:53.162593 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-metrics-tls\") pod \"dns-default-kxgqn\" (UID: \"ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c\") " pod="openshift-dns/dns-default-kxgqn" Jul 15 22:33:53.162682 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:53.162637 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b16bdd28-7aff-4ac6-bcd9-914c5ba36272-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9559b\" (UID: \"b16bdd28-7aff-4ac6-bcd9-914c5ba36272\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9559b" Jul 15 22:33:53.162881 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:53.162637 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 22:33:53.162881 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:53.162751 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 22:33:53.162881 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:53.162779 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52ad677-93ac-46bf-ab02-65226d1863a2-networking-console-plugin-cert podName:c52ad677-93ac-46bf-ab02-65226d1863a2 nodeName:}" failed. No retries permitted until 2026-07-15 22:34:01.162759842 +0000 UTC m=+50.870557418 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c52ad677-93ac-46bf-ab02-65226d1863a2-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-qrbzd" (UID: "c52ad677-93ac-46bf-ab02-65226d1863a2") : secret "networking-console-plugin-cert" not found Jul 15 22:33:53.162881 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:53.162823 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-metrics-tls podName:ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c nodeName:}" failed. No retries permitted until 2026-07-15 22:34:01.162804265 +0000 UTC m=+50.870601857 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-metrics-tls") pod "dns-default-kxgqn" (UID: "ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c") : secret "dns-default-metrics-tls" not found Jul 15 22:33:53.162881 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:53.162692 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 22:33:53.163120 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:53.162888 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/737eff29-32ba-455b-9797-2f28637bc394-cluster-monitoring-operator-tls podName:737eff29-32ba-455b-9797-2f28637bc394 nodeName:}" failed. No retries permitted until 2026-07-15 22:34:01.16287782 +0000 UTC m=+50.870675404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/737eff29-32ba-455b-9797-2f28637bc394-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-h7fk8" (UID: "737eff29-32ba-455b-9797-2f28637bc394") : secret "cluster-monitoring-operator-tls" not found Jul 15 22:33:53.163120 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:53.162955 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 22:33:53.163120 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:53.162990 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b16bdd28-7aff-4ac6-bcd9-914c5ba36272-samples-operator-tls podName:b16bdd28-7aff-4ac6-bcd9-914c5ba36272 nodeName:}" failed. No retries permitted until 2026-07-15 22:34:01.162979414 +0000 UTC m=+50.870777000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b16bdd28-7aff-4ac6-bcd9-914c5ba36272-samples-operator-tls") pod "cluster-samples-operator-65db858894-9559b" (UID: "b16bdd28-7aff-4ac6-bcd9-914c5ba36272") : secret "samples-operator-tls" not found Jul 15 22:33:56.184508 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.184478 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5q8kf_d57dc934-8cdc-4f82-8ee8-527f9cc60a41/console-operator/0.log" Jul 15 22:33:56.184968 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.184527 2560 generic.go:356] "Generic (PLEG): container finished" podID="d57dc934-8cdc-4f82-8ee8-527f9cc60a41" containerID="7d8ad882ff99e6fef84f7ccc196c65218fe4298abe454678b6221cb3332a6914" exitCode=255 Jul 15 22:33:56.184968 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.184628 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-5q8kf" event={"ID":"d57dc934-8cdc-4f82-8ee8-527f9cc60a41","Type":"ContainerDied","Data":"7d8ad882ff99e6fef84f7ccc196c65218fe4298abe454678b6221cb3332a6914"} Jul 15 22:33:56.184968 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.184834 2560 scope.go:117] "RemoveContainer" containerID="7d8ad882ff99e6fef84f7ccc196c65218fe4298abe454678b6221cb3332a6914" Jul 15 22:33:56.186707 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.186630 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-wslf7" event={"ID":"a9449068-86e9-4d65-b4bb-5e547dce7a53","Type":"ContainerStarted","Data":"a47af875a4a350179f489cb8cbd9542435a59ec904ef2f16ed9fd87b5e7b6ba2"} Jul 15 22:33:56.188308 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.188283 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jfckj" event={"ID":"977c5892-fbf7-4dbe-9e69-7b084b7095bf","Type":"ContainerStarted","Data":"056e30dbdcd666936101156cfc3709655a0e6974cf238e1038cd8172c1964082"} Jul 15 22:33:56.189952 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.189887 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rm49r" event={"ID":"c457296e-9f39-44cf-850d-f0c2de93e13a","Type":"ContainerStarted","Data":"ae98e615009642dcb125e0e904c66fc0a87de07020c7090bfebef0710f5ede8a"} Jul 15 22:33:56.191542 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.191497 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgtv8" event={"ID":"6526d328-fec6-480f-a622-d418194e153f","Type":"ContainerStarted","Data":"04af1f664f85e94acbd3027a8aab68e553272bbe03a853351d49126bf088d8cb"} Jul 15 22:33:56.199310 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.198963 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" event={"ID":"1e0e4204-98b9-48ae-b4c6-f0fba1e4d854","Type":"ContainerStarted","Data":"ee4e8aa38cc65846f2029293f3e56a819fb95894609eff58e26d02433c785b5b"} Jul 15 22:33:56.219513 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.219264 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rm49r" podStartSLOduration=31.328297821 podStartE2EDuration="39.219248384s" totalImagesPullingTime="7.890950563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:33:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:56.218708688 +0000 UTC m=+45.926506281" watchObservedRunningTime="2026-07-15 22:33:56.219248384 +0000 UTC m=+45.927045975" Jul 15 22:33:56.251029 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.248846 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" podStartSLOduration=31.504290355 podStartE2EDuration="39.248827292s" totalImagesPullingTime="7.744536937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:33:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:56.234346144 +0000 UTC m=+45.942143737" watchObservedRunningTime="2026-07-15 22:33:56.248827292 +0000 UTC m=+45.956624888" Jul 15 22:33:56.267876 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.266282 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jfckj" podStartSLOduration=3.53347664 podStartE2EDuration="11.266264519s" totalImagesPullingTime="7.732787879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:33:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:56.250659395 +0000 UTC m=+45.958456971" watchObservedRunningTime="2026-07-15 22:33:56.266264519 +0000 UTC m=+45.974062112" Jul 15 22:33:56.288307 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.288264 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgtv8" podStartSLOduration=31.397350717 podStartE2EDuration="39.288249582s" totalImagesPullingTime="7.890898865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:33:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:56.268003244 +0000 UTC m=+45.975800835" watchObservedRunningTime="2026-07-15 22:33:56.288249582 +0000 UTC m=+45.996047178" Jul 15 22:33:56.288512 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.288483 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-wslf7" podStartSLOduration=31.540186754 podStartE2EDuration="39.288474085s" totalImagesPullingTime="7.748287331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:33:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:56.287686744 +0000 UTC m=+45.995484337" watchObservedRunningTime="2026-07-15 22:33:56.288474085 +0000 UTC m=+45.996271678" Jul 15 22:33:56.604742 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.604669 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h6hhv"] Jul 15 22:33:56.626446 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.626403 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h6hhv"] Jul 15 22:33:56.626609 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.626532 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:33:56.629036 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.629013 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 22:33:56.629178 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.629076 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tkr96\"" Jul 15 22:33:56.629262 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.629246 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 22:33:56.794845 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.794808 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-data-volume\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:33:56.795057 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.794955 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-crio-socket\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:33:56.795123 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.795064 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:33:56.795176 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.795127 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5lxz\" (UniqueName: \"kubernetes.io/projected/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-kube-api-access-z5lxz\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:33:56.795227 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.795214 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:33:56.896525 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.896448 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5lxz\" (UniqueName: \"kubernetes.io/projected/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-kube-api-access-z5lxz\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:33:56.896525 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.896517 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:33:56.896720 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.896550 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-data-volume\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:33:56.896720 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.896586 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-crio-socket\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:33:56.896720 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:56.896683 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 22:33:56.896895 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:56.896741 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-insights-runtime-extractor-tls podName:abd7af7a-164e-4d37-a0d5-9c19c66ac07c nodeName:}" failed. No retries permitted until 2026-07-15 22:33:57.396721072 +0000 UTC m=+47.104518656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h6hhv" (UID: "abd7af7a-164e-4d37-a0d5-9c19c66ac07c") : secret "insights-runtime-extractor-tls" not found Jul 15 22:33:56.896895 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.896799 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-crio-socket\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:33:56.896895 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.896865 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:33:56.897050 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:56.896971 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 22:33:56.897050 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.896984 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-data-volume\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:33:56.897050 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:56.897015 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-kube-rbac-proxy-cm podName:abd7af7a-164e-4d37-a0d5-9c19c66ac07c nodeName:}" failed. No retries permitted until 2026-07-15 22:33:57.39700277 +0000 UTC m=+47.104800340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h6hhv" (UID: "abd7af7a-164e-4d37-a0d5-9c19c66ac07c") : configmap "kube-rbac-proxy" not found Jul 15 22:33:56.908719 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:56.908689 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5lxz\" (UniqueName: \"kubernetes.io/projected/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-kube-api-access-z5lxz\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:33:57.205407 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:57.205357 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5q8kf_d57dc934-8cdc-4f82-8ee8-527f9cc60a41/console-operator/1.log" Jul 15 22:33:57.205819 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:57.205787 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5q8kf_d57dc934-8cdc-4f82-8ee8-527f9cc60a41/console-operator/0.log" Jul 15 22:33:57.205907 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:57.205828 2560 generic.go:356] "Generic (PLEG): container finished" podID="d57dc934-8cdc-4f82-8ee8-527f9cc60a41" containerID="7bb60cba4f168b50add46699255a3805079f533f9241009d4d4d366f3f4bd595" exitCode=255 Jul 15 22:33:57.205907 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:57.205878 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-5q8kf" event={"ID":"d57dc934-8cdc-4f82-8ee8-527f9cc60a41","Type":"ContainerDied","Data":"7bb60cba4f168b50add46699255a3805079f533f9241009d4d4d366f3f4bd595"} Jul 15 22:33:57.206010 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:57.205947 2560 scope.go:117] "RemoveContainer" containerID="7d8ad882ff99e6fef84f7ccc196c65218fe4298abe454678b6221cb3332a6914" Jul 15 22:33:57.206563 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:57.206170 2560 scope.go:117] "RemoveContainer" containerID="7bb60cba4f168b50add46699255a3805079f533f9241009d4d4d366f3f4bd595" Jul 15 22:33:57.206563 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:57.206352 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-5q8kf_openshift-console-operator(d57dc934-8cdc-4f82-8ee8-527f9cc60a41)\"" pod="openshift-console-operator/console-operator-7866497494-5q8kf" podUID="d57dc934-8cdc-4f82-8ee8-527f9cc60a41" Jul 15 22:33:57.401339 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:57.401307 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:33:57.401499 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:57.401416 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 22:33:57.401499 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:57.401482 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-kube-rbac-proxy-cm podName:abd7af7a-164e-4d37-a0d5-9c19c66ac07c nodeName:}" failed. No retries permitted until 2026-07-15 22:33:58.401461817 +0000 UTC m=+48.109259386 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h6hhv" (UID: "abd7af7a-164e-4d37-a0d5-9c19c66ac07c") : configmap "kube-rbac-proxy" not found Jul 15 22:33:57.401754 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:57.401730 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:33:57.401872 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:57.401805 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 22:33:57.401938 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:57.401873 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-insights-runtime-extractor-tls podName:abd7af7a-164e-4d37-a0d5-9c19c66ac07c nodeName:}" failed. No retries permitted until 2026-07-15 22:33:58.401836205 +0000 UTC m=+48.109633775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h6hhv" (UID: "abd7af7a-164e-4d37-a0d5-9c19c66ac07c") : secret "insights-runtime-extractor-tls" not found Jul 15 22:33:58.214924 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:58.214893 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5q8kf_d57dc934-8cdc-4f82-8ee8-527f9cc60a41/console-operator/1.log" Jul 15 22:33:58.215401 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:58.215299 2560 scope.go:117] "RemoveContainer" containerID="7bb60cba4f168b50add46699255a3805079f533f9241009d4d4d366f3f4bd595" Jul 15 22:33:58.215513 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:58.215490 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-5q8kf_openshift-console-operator(d57dc934-8cdc-4f82-8ee8-527f9cc60a41)\"" pod="openshift-console-operator/console-operator-7866497494-5q8kf" podUID="d57dc934-8cdc-4f82-8ee8-527f9cc60a41" Jul 15 22:33:58.386301 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:58.386275 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vnktr_2909cc24-d826-42da-9d30-14a4ec63267d/dns-node-resolver/0.log" Jul 15 22:33:58.414684 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:58.414643 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:33:58.414842 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:58.414743 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:33:58.414842 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:58.414767 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 22:33:58.414937 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:58.414842 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-kube-rbac-proxy-cm podName:abd7af7a-164e-4d37-a0d5-9c19c66ac07c nodeName:}" failed. No retries permitted until 2026-07-15 22:34:00.414826256 +0000 UTC m=+50.122623825 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h6hhv" (UID: "abd7af7a-164e-4d37-a0d5-9c19c66ac07c") : configmap "kube-rbac-proxy" not found Jul 15 22:33:58.414937 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:58.414915 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 22:33:58.415002 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:33:58.414982 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-insights-runtime-extractor-tls podName:abd7af7a-164e-4d37-a0d5-9c19c66ac07c nodeName:}" failed. No retries permitted until 2026-07-15 22:34:00.414966386 +0000 UTC m=+50.122763970 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h6hhv" (UID: "abd7af7a-164e-4d37-a0d5-9c19c66ac07c") : secret "insights-runtime-extractor-tls" not found Jul 15 22:33:59.385782 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:59.385755 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jgsqh_ad4d4e81-c00a-4d74-b409-2c7ec97c3002/node-ca/0.log" Jul 15 22:33:59.986159 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:33:59.986122 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jfckj_977c5892-fbf7-4dbe-9e69-7b084b7095bf/serve-healthcheck-canary/0.log" Jul 15 22:34:00.429346 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:00.429323 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:34:00.429699 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:00.429420 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:34:00.429699 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:00.429491 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 22:34:00.429699 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:00.429496 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 22:34:00.429699 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:00.429544 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-kube-rbac-proxy-cm podName:abd7af7a-164e-4d37-a0d5-9c19c66ac07c nodeName:}" failed. No retries permitted until 2026-07-15 22:34:04.429530064 +0000 UTC m=+54.137327634 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h6hhv" (UID: "abd7af7a-164e-4d37-a0d5-9c19c66ac07c") : configmap "kube-rbac-proxy" not found Jul 15 22:34:00.429699 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:00.429557 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-insights-runtime-extractor-tls podName:abd7af7a-164e-4d37-a0d5-9c19c66ac07c nodeName:}" failed. No retries permitted until 2026-07-15 22:34:04.429551453 +0000 UTC m=+54.137349023 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h6hhv" (UID: "abd7af7a-164e-4d37-a0d5-9c19c66ac07c") : secret "insights-runtime-extractor-tls" not found Jul 15 22:34:01.034294 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:01.034260 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-tls\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:34:01.034456 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:01.034408 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 22:34:01.034456 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:01.034427 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58549999b7-njxqg: secret "image-registry-tls" not found Jul 15 22:34:01.034526 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:01.034486 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-tls podName:9ccbed96-e66b-4d37-8d20-dbe2f78782ff nodeName:}" failed. No retries permitted until 2026-07-15 22:34:17.034472932 +0000 UTC m=+66.742270536 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-tls") pod "image-registry-58549999b7-njxqg" (UID: "9ccbed96-e66b-4d37-8d20-dbe2f78782ff") : secret "image-registry-tls" not found Jul 15 22:34:01.135303 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:01.135271 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4c8e27d-68fe-4f3e-be10-c9995397ce75-service-ca-bundle\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:34:01.135303 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:01.135302 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-metrics-certs\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:34:01.135475 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:01.135432 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4c8e27d-68fe-4f3e-be10-c9995397ce75-service-ca-bundle podName:f4c8e27d-68fe-4f3e-be10-c9995397ce75 nodeName:}" failed. No retries permitted until 2026-07-15 22:34:17.135415262 +0000 UTC m=+66.843212831 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4c8e27d-68fe-4f3e-be10-c9995397ce75-service-ca-bundle") pod "router-default-648694dcdd-k656d" (UID: "f4c8e27d-68fe-4f3e-be10-c9995397ce75") : configmap references non-existent config key: service-ca.crt Jul 15 22:34:01.135475 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:01.135443 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 22:34:01.135546 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:01.135484 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-metrics-certs podName:f4c8e27d-68fe-4f3e-be10-c9995397ce75 nodeName:}" failed. No retries permitted until 2026-07-15 22:34:17.135469859 +0000 UTC m=+66.843267428 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-metrics-certs") pod "router-default-648694dcdd-k656d" (UID: "f4c8e27d-68fe-4f3e-be10-c9995397ce75") : secret "router-metrics-certs-default" not found Jul 15 22:34:01.236368 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:01.236341 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b16bdd28-7aff-4ac6-bcd9-914c5ba36272-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9559b\" (UID: \"b16bdd28-7aff-4ac6-bcd9-914c5ba36272\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9559b" Jul 15 22:34:01.236507 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:01.236399 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c52ad677-93ac-46bf-ab02-65226d1863a2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-qrbzd\" (UID: \"c52ad677-93ac-46bf-ab02-65226d1863a2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qrbzd" Jul 15 22:34:01.236507 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:01.236421 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/737eff29-32ba-455b-9797-2f28637bc394-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-h7fk8\" (UID: \"737eff29-32ba-455b-9797-2f28637bc394\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-h7fk8" Jul 15 22:34:01.236507 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:01.236485 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 22:34:01.236600 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:01.236522 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 22:34:01.236600 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:01.236539 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b16bdd28-7aff-4ac6-bcd9-914c5ba36272-samples-operator-tls podName:b16bdd28-7aff-4ac6-bcd9-914c5ba36272 nodeName:}" failed. No retries permitted until 2026-07-15 22:34:17.236519548 +0000 UTC m=+66.944317118 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b16bdd28-7aff-4ac6-bcd9-914c5ba36272-samples-operator-tls") pod "cluster-samples-operator-65db858894-9559b" (UID: "b16bdd28-7aff-4ac6-bcd9-914c5ba36272") : secret "samples-operator-tls" not found Jul 15 22:34:01.236600 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:01.236558 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/737eff29-32ba-455b-9797-2f28637bc394-cluster-monitoring-operator-tls podName:737eff29-32ba-455b-9797-2f28637bc394 nodeName:}" failed. No retries permitted until 2026-07-15 22:34:17.23654714 +0000 UTC m=+66.944344710 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/737eff29-32ba-455b-9797-2f28637bc394-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-h7fk8" (UID: "737eff29-32ba-455b-9797-2f28637bc394") : secret "cluster-monitoring-operator-tls" not found Jul 15 22:34:01.236600 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:01.236579 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-metrics-tls\") pod \"dns-default-kxgqn\" (UID: \"ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c\") " pod="openshift-dns/dns-default-kxgqn" Jul 15 22:34:01.236600 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:01.236521 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 22:34:01.236752 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:01.236635 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52ad677-93ac-46bf-ab02-65226d1863a2-networking-console-plugin-cert podName:c52ad677-93ac-46bf-ab02-65226d1863a2 nodeName:}" failed. No retries permitted until 2026-07-15 22:34:17.236624242 +0000 UTC m=+66.944421812 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c52ad677-93ac-46bf-ab02-65226d1863a2-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-qrbzd" (UID: "c52ad677-93ac-46bf-ab02-65226d1863a2") : secret "networking-console-plugin-cert" not found Jul 15 22:34:01.236752 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:01.236647 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 22:34:01.236752 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:01.236668 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-metrics-tls podName:ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c nodeName:}" failed. No retries permitted until 2026-07-15 22:34:17.236661189 +0000 UTC m=+66.944458758 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-metrics-tls") pod "dns-default-kxgqn" (UID: "ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c") : secret "dns-default-metrics-tls" not found Jul 15 22:34:04.465672 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:04.465642 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:34:04.466238 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:04.465727 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:34:04.466238 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:04.465767 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 22:34:04.466238 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:04.465833 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 22:34:04.466238 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:04.465836 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-kube-rbac-proxy-cm podName:abd7af7a-164e-4d37-a0d5-9c19c66ac07c nodeName:}" failed. No retries permitted until 2026-07-15 22:34:12.465818624 +0000 UTC m=+62.173616195 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h6hhv" (UID: "abd7af7a-164e-4d37-a0d5-9c19c66ac07c") : configmap "kube-rbac-proxy" not found Jul 15 22:34:04.466238 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:04.465917 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-insights-runtime-extractor-tls podName:abd7af7a-164e-4d37-a0d5-9c19c66ac07c nodeName:}" failed. No retries permitted until 2026-07-15 22:34:12.465897472 +0000 UTC m=+62.173695045 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h6hhv" (UID: "abd7af7a-164e-4d37-a0d5-9c19c66ac07c") : secret "insights-runtime-extractor-tls" not found Jul 15 22:34:05.540664 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:05.540633 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-5q8kf" Jul 15 22:34:05.541057 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:05.540685 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-5q8kf" Jul 15 22:34:05.541057 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:05.541017 2560 scope.go:117] "RemoveContainer" containerID="7bb60cba4f168b50add46699255a3805079f533f9241009d4d4d366f3f4bd595" Jul 15 22:34:05.541174 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:05.541155 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-5q8kf_openshift-console-operator(d57dc934-8cdc-4f82-8ee8-527f9cc60a41)\"" pod="openshift-console-operator/console-operator-7866497494-5q8kf" podUID="d57dc934-8cdc-4f82-8ee8-527f9cc60a41" Jul 15 22:34:12.102398 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:12.102372 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f7fk4" Jul 15 22:34:12.539379 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:12.539336 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:34:12.539567 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:12.539434 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:34:12.539567 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:12.539561 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 22:34:12.539661 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:34:12.539616 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-insights-runtime-extractor-tls podName:abd7af7a-164e-4d37-a0d5-9c19c66ac07c nodeName:}" failed. No retries permitted until 2026-07-15 22:34:28.539603666 +0000 UTC m=+78.247401235 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h6hhv" (UID: "abd7af7a-164e-4d37-a0d5-9c19c66ac07c") : secret "insights-runtime-extractor-tls" not found Jul 15 22:34:12.539824 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:12.539804 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:34:15.563802 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:15.563760 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6wvs\" (UniqueName: \"kubernetes.io/projected/6fe341c4-845e-4412-a026-ea8463d7191c-kube-api-access-m6wvs\") pod \"network-check-target-x64tv\" (UID: \"6fe341c4-845e-4412-a026-ea8463d7191c\") " pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:34:15.564302 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:15.563811 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff68c09e-7343-4947-8750-7fa6e793287c-metrics-certs\") pod \"network-metrics-daemon-qmvbm\" (UID: \"ff68c09e-7343-4947-8750-7fa6e793287c\") " pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:34:15.564302 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:15.563923 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23a965f4-47c0-432e-9676-53861bba6186-original-pull-secret\") pod \"global-pull-secret-syncer-dvf88\" (UID: \"23a965f4-47c0-432e-9676-53861bba6186\") " pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:34:15.565862 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:15.565831 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 22:34:15.565923 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:15.565877 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 22:34:15.566566 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:15.566544 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6wvs\" (UniqueName: \"kubernetes.io/projected/6fe341c4-845e-4412-a026-ea8463d7191c-kube-api-access-m6wvs\") pod \"network-check-target-x64tv\" (UID: \"6fe341c4-845e-4412-a026-ea8463d7191c\") " pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:34:15.576613 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:15.576593 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23a965f4-47c0-432e-9676-53861bba6186-original-pull-secret\") pod \"global-pull-secret-syncer-dvf88\" (UID: \"23a965f4-47c0-432e-9676-53861bba6186\") " pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:34:15.576696 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:15.576627 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff68c09e-7343-4947-8750-7fa6e793287c-metrics-certs\") pod \"network-metrics-daemon-qmvbm\" (UID: \"ff68c09e-7343-4947-8750-7fa6e793287c\") " pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:34:15.847384 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:15.847300 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvf88" Jul 15 22:34:15.857463 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:15.857268 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qmq28\"" Jul 15 22:34:15.862892 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:15.862869 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-84k7s\"" Jul 15 22:34:15.865648 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:15.865625 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmvbm" Jul 15 22:34:15.871064 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:15.871042 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:34:15.995753 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:15.995718 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dvf88"] Jul 15 22:34:15.999153 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:34:15.999129 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23a965f4_47c0_432e_9676_53861bba6186.slice/crio-c549b9d5ec4295fbe8ac2b2fa2602d473bde2d3c7d2d38c3e1f35411b5f355ec WatchSource:0}: Error finding container c549b9d5ec4295fbe8ac2b2fa2602d473bde2d3c7d2d38c3e1f35411b5f355ec: Status 404 returned error can't find the container with id c549b9d5ec4295fbe8ac2b2fa2602d473bde2d3c7d2d38c3e1f35411b5f355ec Jul 15 22:34:16.214738 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:16.214715 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qmvbm"] Jul 15 22:34:16.217719 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:34:16.217691 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff68c09e_7343_4947_8750_7fa6e793287c.slice/crio-b34a01005bb7fbbecdea9be0148ff6e5a1f1b9791faba3567b51dbaf9dfbeccf WatchSource:0}: Error finding container b34a01005bb7fbbecdea9be0148ff6e5a1f1b9791faba3567b51dbaf9dfbeccf: Status 404 returned error can't find the container with id b34a01005bb7fbbecdea9be0148ff6e5a1f1b9791faba3567b51dbaf9dfbeccf Jul 15 22:34:16.217847 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:16.217793 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x64tv"] Jul 15 22:34:16.221186 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:34:16.221165 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fe341c4_845e_4412_a026_ea8463d7191c.slice/crio-d4ec1bd525f6fa509299c55d7892f11f9a71d05c8977c68b6549c621f2e6a21d WatchSource:0}: Error finding container d4ec1bd525f6fa509299c55d7892f11f9a71d05c8977c68b6549c621f2e6a21d: Status 404 returned error can't find the container with id d4ec1bd525f6fa509299c55d7892f11f9a71d05c8977c68b6549c621f2e6a21d Jul 15 22:34:16.272686 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:16.272659 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x64tv" event={"ID":"6fe341c4-845e-4412-a026-ea8463d7191c","Type":"ContainerStarted","Data":"33c52bf859c71fba904f7774fb2b6d4c1e21d5ff48125f9b1eeb45d74d046e48"} Jul 15 22:34:16.272824 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:16.272804 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:34:16.272917 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:16.272870 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x64tv" event={"ID":"6fe341c4-845e-4412-a026-ea8463d7191c","Type":"ContainerStarted","Data":"d4ec1bd525f6fa509299c55d7892f11f9a71d05c8977c68b6549c621f2e6a21d"} Jul 15 22:34:16.273969 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:16.273943 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qmvbm" event={"ID":"ff68c09e-7343-4947-8750-7fa6e793287c","Type":"ContainerStarted","Data":"b34a01005bb7fbbecdea9be0148ff6e5a1f1b9791faba3567b51dbaf9dfbeccf"} Jul 15 22:34:16.275012 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:16.274977 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dvf88" event={"ID":"23a965f4-47c0-432e-9676-53861bba6186","Type":"ContainerStarted","Data":"c549b9d5ec4295fbe8ac2b2fa2602d473bde2d3c7d2d38c3e1f35411b5f355ec"} Jul 15 22:34:16.290730 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:16.290691 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-x64tv" podStartSLOduration=65.290679824 podStartE2EDuration="1m5.290679824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:33:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:16.28939395 +0000 UTC m=+65.997191542" watchObservedRunningTime="2026-07-15 22:34:16.290679824 +0000 UTC m=+65.998477417" Jul 15 22:34:17.076737 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.076573 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-tls\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:34:17.079615 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.079585 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-tls\") pod \"image-registry-58549999b7-njxqg\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:34:17.177624 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.177584 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4c8e27d-68fe-4f3e-be10-c9995397ce75-service-ca-bundle\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:34:17.177764 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.177634 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-metrics-certs\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:34:17.178346 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.178313 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4c8e27d-68fe-4f3e-be10-c9995397ce75-service-ca-bundle\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:34:17.180644 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.180617 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4c8e27d-68fe-4f3e-be10-c9995397ce75-metrics-certs\") pod \"router-default-648694dcdd-k656d\" (UID: \"f4c8e27d-68fe-4f3e-be10-c9995397ce75\") " pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:34:17.278685 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.278654 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b16bdd28-7aff-4ac6-bcd9-914c5ba36272-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9559b\" (UID: \"b16bdd28-7aff-4ac6-bcd9-914c5ba36272\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9559b" Jul 15 22:34:17.278808 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.278752 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c52ad677-93ac-46bf-ab02-65226d1863a2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-qrbzd\" (UID: \"c52ad677-93ac-46bf-ab02-65226d1863a2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qrbzd" Jul 15 22:34:17.278808 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.278788 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/737eff29-32ba-455b-9797-2f28637bc394-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-h7fk8\" (UID: \"737eff29-32ba-455b-9797-2f28637bc394\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-h7fk8" Jul 15 22:34:17.278942 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.278870 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-metrics-tls\") pod \"dns-default-kxgqn\" (UID: \"ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c\") " pod="openshift-dns/dns-default-kxgqn" Jul 15 22:34:17.281869 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.281823 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c-metrics-tls\") pod \"dns-default-kxgqn\" (UID: \"ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c\") " pod="openshift-dns/dns-default-kxgqn" Jul 15 22:34:17.282083 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.282059 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c52ad677-93ac-46bf-ab02-65226d1863a2-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-qrbzd\" (UID: \"c52ad677-93ac-46bf-ab02-65226d1863a2\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-qrbzd" Jul 15 22:34:17.282588 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.282564 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b16bdd28-7aff-4ac6-bcd9-914c5ba36272-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9559b\" (UID: \"b16bdd28-7aff-4ac6-bcd9-914c5ba36272\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9559b" Jul 15 22:34:17.282685 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.282619 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/737eff29-32ba-455b-9797-2f28637bc394-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-h7fk8\" (UID: \"737eff29-32ba-455b-9797-2f28637bc394\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-h7fk8" Jul 15 22:34:17.317231 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.317206 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7pd8h\"" Jul 15 22:34:17.325503 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.325484 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:34:17.398272 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.398063 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-k7ftt\"" Jul 15 22:34:17.406972 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.406928 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:34:17.434010 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.433826 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-k2gdm\"" Jul 15 22:34:17.438520 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.438496 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9559b" Jul 15 22:34:17.460362 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.460161 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bzpvv\"" Jul 15 22:34:17.468318 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.468261 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-qrbzd" Jul 15 22:34:17.474748 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.474535 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b5wsh\"" Jul 15 22:34:17.485193 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.483467 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-h7fk8" Jul 15 22:34:17.485193 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.484356 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58549999b7-njxqg"] Jul 15 22:34:17.491203 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:34:17.491169 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ccbed96_e66b_4d37_8d20_dbe2f78782ff.slice/crio-3b4b08a82661ddfc674bde7c2caaefba1485fd138937dc0005958ab9e21746a1 WatchSource:0}: Error finding container 3b4b08a82661ddfc674bde7c2caaefba1485fd138937dc0005958ab9e21746a1: Status 404 returned error can't find the container with id 3b4b08a82661ddfc674bde7c2caaefba1485fd138937dc0005958ab9e21746a1 Jul 15 22:34:17.516532 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.515778 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-trnq4\"" Jul 15 22:34:17.525566 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.525535 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kxgqn" Jul 15 22:34:17.597259 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.597204 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-648694dcdd-k656d"] Jul 15 22:34:17.687432 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.687401 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9559b"] Jul 15 22:34:17.718671 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.718619 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-qrbzd"] Jul 15 22:34:17.725112 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.723650 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-h7fk8"] Jul 15 22:34:17.783493 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:17.783469 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kxgqn"] Jul 15 22:34:17.787137 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:34:17.787108 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca0fceae_7b24_4c57_b6cd_5f9ce395ea6c.slice/crio-e2d8fd06b5e12737c116ddfc086630b75cb07d8475a1389dff7acc75177137f8 WatchSource:0}: Error finding container e2d8fd06b5e12737c116ddfc086630b75cb07d8475a1389dff7acc75177137f8: Status 404 returned error can't find the container with id e2d8fd06b5e12737c116ddfc086630b75cb07d8475a1389dff7acc75177137f8 Jul 15 22:34:18.285771 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:18.285735 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9559b" event={"ID":"b16bdd28-7aff-4ac6-bcd9-914c5ba36272","Type":"ContainerStarted","Data":"a6fa747a04bc9bb0876b0c27a4988bd313bd3eeff13c621ad89c153ab9b74476"} Jul 15 22:34:18.287388 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:18.287361 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-648694dcdd-k656d" event={"ID":"f4c8e27d-68fe-4f3e-be10-c9995397ce75","Type":"ContainerStarted","Data":"edd3ed5b9cfdbfd9ec92ac1390847a58b8ad56d40e59c6aedc63f67d45394546"} Jul 15 22:34:18.287532 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:18.287406 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-648694dcdd-k656d" event={"ID":"f4c8e27d-68fe-4f3e-be10-c9995397ce75","Type":"ContainerStarted","Data":"56730c272ecd940968bcd6be5ce4de80129f4d5981c0bbaa55dbe7f3eee18656"} Jul 15 22:34:18.289272 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:18.289248 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qmvbm" event={"ID":"ff68c09e-7343-4947-8750-7fa6e793287c","Type":"ContainerStarted","Data":"205bdb60d5770a7fe31cc8806fd79f9e8d056c2b01b621f720748c10b5f149b4"} Jul 15 22:34:18.289372 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:18.289294 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qmvbm" event={"ID":"ff68c09e-7343-4947-8750-7fa6e793287c","Type":"ContainerStarted","Data":"3b5ae03f11b462fd38bc453a32fe1834d32ded4a0ae3dd38ff5d9f180d9aaa22"} Jul 15 22:34:18.290408 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:18.290385 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kxgqn" event={"ID":"ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c","Type":"ContainerStarted","Data":"e2d8fd06b5e12737c116ddfc086630b75cb07d8475a1389dff7acc75177137f8"} Jul 15 22:34:18.291619 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:18.291593 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-h7fk8" event={"ID":"737eff29-32ba-455b-9797-2f28637bc394","Type":"ContainerStarted","Data":"469620bae0a569e3e43462298d31c9a744287438f0036b665ea1a8009a07502f"} Jul 15 22:34:18.292704 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:18.292677 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-qrbzd" event={"ID":"c52ad677-93ac-46bf-ab02-65226d1863a2","Type":"ContainerStarted","Data":"29256727e3b5ef51bf67488b404d1126eaf30797088db4186bc8b9015f1e2f31"} Jul 15 22:34:18.294247 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:18.294224 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58549999b7-njxqg" event={"ID":"9ccbed96-e66b-4d37-8d20-dbe2f78782ff","Type":"ContainerStarted","Data":"2894fcc683bebd0c34cded744745daea1990e3cf9e8d826afd69489b6a093426"} Jul 15 22:34:18.294334 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:18.294266 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58549999b7-njxqg" event={"ID":"9ccbed96-e66b-4d37-8d20-dbe2f78782ff","Type":"ContainerStarted","Data":"3b4b08a82661ddfc674bde7c2caaefba1485fd138937dc0005958ab9e21746a1"} Jul 15 22:34:18.294334 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:18.294292 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:34:18.307842 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:18.307794 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-648694dcdd-k656d" podStartSLOduration=61.307779692 podStartE2EDuration="1m1.307779692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:33:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:18.307032813 +0000 UTC m=+68.014830402" watchObservedRunningTime="2026-07-15 22:34:18.307779692 +0000 UTC m=+68.015577283" Jul 15 22:34:18.349662 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:18.349616 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qmvbm" podStartSLOduration=66.315927825 podStartE2EDuration="1m7.349596473s" totalImagesPullingTime="1.033668648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:18.323784167 +0000 UTC m=+68.031581760" watchObservedRunningTime="2026-07-15 22:34:18.349596473 +0000 UTC m=+68.057394066" Jul 15 22:34:18.408082 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:18.407948 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:34:18.410941 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:18.410919 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:34:18.433591 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:18.433415 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58549999b7-njxqg" podStartSLOduration=68.43339866 podStartE2EDuration="1m8.43339866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:33:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:18.349664683 +0000 UTC m=+68.057462306" watchObservedRunningTime="2026-07-15 22:34:18.43339866 +0000 UTC m=+68.141196280" Jul 15 22:34:19.301093 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:19.300505 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:34:19.303098 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:19.302924 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-648694dcdd-k656d" Jul 15 22:34:19.835646 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:19.835607 2560 scope.go:117] "RemoveContainer" containerID="7bb60cba4f168b50add46699255a3805079f533f9241009d4d4d366f3f4bd595" Jul 15 22:34:22.040619 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:22.040586 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-596c7f7bb8-xxkc8"] Jul 15 22:34:22.049999 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:22.049972 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-596c7f7bb8-xxkc8" Jul 15 22:34:22.052603 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:22.052582 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-692nr\"" Jul 15 22:34:22.053398 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:22.053371 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 15 22:34:22.053521 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:22.053435 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 15 22:34:22.053593 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:22.053385 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 15 22:34:22.053702 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:22.053677 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 15 22:34:22.059075 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:22.059052 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-596c7f7bb8-xxkc8"] Jul 15 22:34:22.128598 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:22.128570 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/320f2f1e-fd89-4e13-b213-3a7f66835d28-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-596c7f7bb8-xxkc8\" (UID: \"320f2f1e-fd89-4e13-b213-3a7f66835d28\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-596c7f7bb8-xxkc8" Jul 15 22:34:22.128736 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:22.128609 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdmvw\" (UniqueName: \"kubernetes.io/projected/320f2f1e-fd89-4e13-b213-3a7f66835d28-kube-api-access-bdmvw\") pod \"managed-serviceaccount-addon-agent-596c7f7bb8-xxkc8\" (UID: \"320f2f1e-fd89-4e13-b213-3a7f66835d28\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-596c7f7bb8-xxkc8" Jul 15 22:34:22.229989 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:22.229954 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/320f2f1e-fd89-4e13-b213-3a7f66835d28-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-596c7f7bb8-xxkc8\" (UID: \"320f2f1e-fd89-4e13-b213-3a7f66835d28\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-596c7f7bb8-xxkc8" Jul 15 22:34:22.229989 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:22.229990 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdmvw\" (UniqueName: \"kubernetes.io/projected/320f2f1e-fd89-4e13-b213-3a7f66835d28-kube-api-access-bdmvw\") pod \"managed-serviceaccount-addon-agent-596c7f7bb8-xxkc8\" (UID: \"320f2f1e-fd89-4e13-b213-3a7f66835d28\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-596c7f7bb8-xxkc8" Jul 15 22:34:22.232464 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:22.232439 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/320f2f1e-fd89-4e13-b213-3a7f66835d28-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-596c7f7bb8-xxkc8\" (UID: \"320f2f1e-fd89-4e13-b213-3a7f66835d28\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-596c7f7bb8-xxkc8" Jul 15 22:34:22.247569 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:22.247537 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdmvw\" (UniqueName: \"kubernetes.io/projected/320f2f1e-fd89-4e13-b213-3a7f66835d28-kube-api-access-bdmvw\") pod \"managed-serviceaccount-addon-agent-596c7f7bb8-xxkc8\" (UID: \"320f2f1e-fd89-4e13-b213-3a7f66835d28\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-596c7f7bb8-xxkc8" Jul 15 22:34:22.369328 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:22.369246 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-596c7f7bb8-xxkc8" Jul 15 22:34:23.506817 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:23.505618 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-596c7f7bb8-xxkc8"] Jul 15 22:34:23.511034 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:34:23.510994 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod320f2f1e_fd89_4e13_b213_3a7f66835d28.slice/crio-af6189c5891d0c6eb91082f98f2709acbcb1e6d31713f5d0cb08e9c1c61d9c77 WatchSource:0}: Error finding container af6189c5891d0c6eb91082f98f2709acbcb1e6d31713f5d0cb08e9c1c61d9c77: Status 404 returned error can't find the container with id af6189c5891d0c6eb91082f98f2709acbcb1e6d31713f5d0cb08e9c1c61d9c77 Jul 15 22:34:24.319331 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:24.319293 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dvf88" event={"ID":"23a965f4-47c0-432e-9676-53861bba6186","Type":"ContainerStarted","Data":"f892946c0899d26ace34695261a885d468d1c547804eb6f8280ba2d081d3ab6f"} Jul 15 22:34:24.321053 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:24.321025 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9559b" event={"ID":"b16bdd28-7aff-4ac6-bcd9-914c5ba36272","Type":"ContainerStarted","Data":"82cec3b62fc69c0950e900317b4e99d82107dafbdc32510a291a23cd2124a5e8"} Jul 15 22:34:24.321180 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:24.321082 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9559b" event={"ID":"b16bdd28-7aff-4ac6-bcd9-914c5ba36272","Type":"ContainerStarted","Data":"cac9df770bafea4e46797d2ba4c5da5cbb9bd4eeb81222e9708301fd8a28e269"} Jul 15 22:34:24.323090 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:24.323073 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5q8kf_d57dc934-8cdc-4f82-8ee8-527f9cc60a41/console-operator/1.log" Jul 15 22:34:24.323189 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:24.323172 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-5q8kf" event={"ID":"d57dc934-8cdc-4f82-8ee8-527f9cc60a41","Type":"ContainerStarted","Data":"2db11d019e76ff552f0e58fb4456773e7e288695455e09689b2e63fdbab5302c"} Jul 15 22:34:24.323487 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:24.323465 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-5q8kf" Jul 15 22:34:24.325508 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:24.325477 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kxgqn" event={"ID":"ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c","Type":"ContainerStarted","Data":"888d0bb3dd94348329a19ada87bb737bb5ceecbddd37d1a20d6479c15ab10f5b"} Jul 15 22:34:24.325609 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:24.325527 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kxgqn" event={"ID":"ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c","Type":"ContainerStarted","Data":"21c938cd9e105688ebc670d4e9363dcc2203563e2beb9152d220569eb5835023"} Jul 15 22:34:24.325609 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:24.325549 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kxgqn" Jul 15 22:34:24.327175 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:24.327144 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-h7fk8" event={"ID":"737eff29-32ba-455b-9797-2f28637bc394","Type":"ContainerStarted","Data":"33c73d448038eb4980e6699f6f76be3b85f3c535975f2e13a4c2e748a01db2e3"} Jul 15 22:34:24.328733 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:24.328710 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-qrbzd" event={"ID":"c52ad677-93ac-46bf-ab02-65226d1863a2","Type":"ContainerStarted","Data":"be66177ae4656d945c0c71ea46646a47236d9c39c0ad5faa9bb2979e63e766f0"} Jul 15 22:34:24.329669 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:24.329651 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-5q8kf" Jul 15 22:34:24.330221 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:24.330205 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-596c7f7bb8-xxkc8" event={"ID":"320f2f1e-fd89-4e13-b213-3a7f66835d28","Type":"ContainerStarted","Data":"af6189c5891d0c6eb91082f98f2709acbcb1e6d31713f5d0cb08e9c1c61d9c77"} Jul 15 22:34:24.345451 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:24.345411 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dvf88" podStartSLOduration=65.997398847 podStartE2EDuration="1m13.345398286s" totalImagesPullingTime="7.347999439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:24.343733323 +0000 UTC m=+74.051530914" watchObservedRunningTime="2026-07-15 22:34:24.345398286 +0000 UTC m=+74.053195877" Jul 15 22:34:24.364542 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:24.364492 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-h7fk8" podStartSLOduration=61.774838385 podStartE2EDuration="1m7.364477406s" totalImagesPullingTime="5.589639021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:33:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:24.364316442 +0000 UTC m=+74.072114035" watchObservedRunningTime="2026-07-15 22:34:24.364477406 +0000 UTC m=+74.072275002" Jul 15 22:34:24.397152 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:24.397108 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-5q8kf" podStartSLOduration=59.498239919 podStartE2EDuration="1m7.397094408s" totalImagesPullingTime="7.898854489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:33:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:24.396088999 +0000 UTC m=+74.103886615" watchObservedRunningTime="2026-07-15 22:34:24.397094408 +0000 UTC m=+74.104892037" Jul 15 22:34:24.419924 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:24.419882 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-qrbzd" podStartSLOduration=57.837756079 podStartE2EDuration="1m3.419843763s" totalImagesPullingTime="5.582087684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:33:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:24.419619447 +0000 UTC m=+74.127417041" watchObservedRunningTime="2026-07-15 22:34:24.419843763 +0000 UTC m=+74.127641355" Jul 15 22:34:24.443026 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:24.442982 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9559b" podStartSLOduration=61.866763527 podStartE2EDuration="1m7.442973836s" totalImagesPullingTime="5.576210309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:33:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:24.442713885 +0000 UTC m=+74.150511479" watchObservedRunningTime="2026-07-15 22:34:24.442973836 +0000 UTC m=+74.150771427" Jul 15 22:34:24.466697 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:24.466645 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kxgqn" podStartSLOduration=33.906727857999996 podStartE2EDuration="39.4666253s" totalImagesPullingTime="5.559897442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:33:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:24.464336733 +0000 UTC m=+74.172134326" watchObservedRunningTime="2026-07-15 22:34:24.4666253 +0000 UTC m=+74.174422893" Jul 15 22:34:28.347135 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:28.347092 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-596c7f7bb8-xxkc8" event={"ID":"320f2f1e-fd89-4e13-b213-3a7f66835d28","Type":"ContainerStarted","Data":"45fc1c9dabac5f0187949e9692c2b47396c282f78388bc237c0bbb581a04c044"} Jul 15 22:34:28.363045 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:28.362993 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-596c7f7bb8-xxkc8" podStartSLOduration=2.345760031 podStartE2EDuration="6.362977444s" totalImagesPullingTime="4.017217413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:28.362071204 +0000 UTC m=+78.069868807" watchObservedRunningTime="2026-07-15 22:34:28.362977444 +0000 UTC m=+78.070775035" Jul 15 22:34:28.585154 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:28.585120 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:34:28.587588 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:28.587554 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abd7af7a-164e-4d37-a0d5-9c19c66ac07c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6hhv\" (UID: \"abd7af7a-164e-4d37-a0d5-9c19c66ac07c\") " pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:34:28.738803 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:28.738772 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tkr96\"" Jul 15 22:34:28.747713 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:28.747681 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h6hhv" Jul 15 22:34:28.893218 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:28.893195 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h6hhv"] Jul 15 22:34:28.895679 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:34:28.895653 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabd7af7a_164e_4d37_a0d5_9c19c66ac07c.slice/crio-9b361e50bf315b2a8ef8429e16495a5cf7bec6c1213e730ff29c404a37fd5d4d WatchSource:0}: Error finding container 9b361e50bf315b2a8ef8429e16495a5cf7bec6c1213e730ff29c404a37fd5d4d: Status 404 returned error can't find the container with id 9b361e50bf315b2a8ef8429e16495a5cf7bec6c1213e730ff29c404a37fd5d4d Jul 15 22:34:29.351213 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:29.351183 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6hhv" event={"ID":"abd7af7a-164e-4d37-a0d5-9c19c66ac07c","Type":"ContainerStarted","Data":"9b361e50bf315b2a8ef8429e16495a5cf7bec6c1213e730ff29c404a37fd5d4d"} Jul 15 22:34:34.337544 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:34.336815 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kxgqn" Jul 15 22:34:35.383728 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:35.383683 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6hhv" event={"ID":"abd7af7a-164e-4d37-a0d5-9c19c66ac07c","Type":"ContainerStarted","Data":"61446b8bae8f312de0265657c9f24c3d9de3aace56d1faddba54b5adbbf9dbe4"} Jul 15 22:34:37.330899 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:37.330837 2560 patch_prober.go:28] interesting pod/image-registry-58549999b7-njxqg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 22:34:37.331395 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:37.330931 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-58549999b7-njxqg" podUID="9ccbed96-e66b-4d37-8d20-dbe2f78782ff" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 22:34:38.401983 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:38.401947 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6hhv" event={"ID":"abd7af7a-164e-4d37-a0d5-9c19c66ac07c","Type":"ContainerStarted","Data":"55ef7cd2a20c3056f9d74afbe4427320ed7b000a55752c2632e9cabf38f9e1db"} Jul 15 22:34:39.305935 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:39.305907 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:34:41.416036 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:41.415996 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6hhv" event={"ID":"abd7af7a-164e-4d37-a0d5-9c19c66ac07c","Type":"ContainerStarted","Data":"7d6b1bb982f6c8a09212e204a9d751e577c96f3c28b49c6e2471f124b4ff2e1c"} Jul 15 22:34:41.439595 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:41.439530 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h6hhv" podStartSLOduration=33.235882382 podStartE2EDuration="45.439511852s" totalImagesPullingTime="12.20362947s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:33:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:41.437894041 +0000 UTC m=+91.145691633" watchObservedRunningTime="2026-07-15 22:34:41.439511852 +0000 UTC m=+91.147309444" Jul 15 22:34:43.996746 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:43.996708 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58549999b7-njxqg"] Jul 15 22:34:47.281010 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:47.280976 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-x64tv" Jul 15 22:34:53.129186 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.129155 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ql8wq"] Jul 15 22:34:53.164424 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.164396 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.167361 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.167337 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 22:34:53.167361 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.167355 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 22:34:53.167567 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.167340 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 22:34:53.167971 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.167954 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j6k2f\"" Jul 15 22:34:53.169749 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.169732 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 22:34:53.184479 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.184457 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3e897562-13f1-476a-aca0-2f505457e71e-node-exporter-wtmp\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.184586 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.184493 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3e897562-13f1-476a-aca0-2f505457e71e-node-exporter-textfile\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.184586 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.184522 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3e897562-13f1-476a-aca0-2f505457e71e-root\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.184586 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.184543 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3e897562-13f1-476a-aca0-2f505457e71e-node-exporter-tls\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.184586 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.184561 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3e897562-13f1-476a-aca0-2f505457e71e-node-exporter-accelerators-collector-config\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.184586 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.184578 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e897562-13f1-476a-aca0-2f505457e71e-metrics-client-ca\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.184776 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.184597 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e897562-13f1-476a-aca0-2f505457e71e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.184776 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.184615 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk7zd\" (UniqueName: \"kubernetes.io/projected/3e897562-13f1-476a-aca0-2f505457e71e-kube-api-access-mk7zd\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.184776 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.184659 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e897562-13f1-476a-aca0-2f505457e71e-sys\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.285747 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.285708 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e897562-13f1-476a-aca0-2f505457e71e-sys\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.285927 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.285758 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3e897562-13f1-476a-aca0-2f505457e71e-node-exporter-wtmp\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.285927 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.285777 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e897562-13f1-476a-aca0-2f505457e71e-sys\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.285927 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.285795 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3e897562-13f1-476a-aca0-2f505457e71e-node-exporter-textfile\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.285927 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.285836 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3e897562-13f1-476a-aca0-2f505457e71e-root\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.285927 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.285894 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3e897562-13f1-476a-aca0-2f505457e71e-node-exporter-tls\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.285927 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.285926 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3e897562-13f1-476a-aca0-2f505457e71e-node-exporter-accelerators-collector-config\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.286262 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.285951 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e897562-13f1-476a-aca0-2f505457e71e-metrics-client-ca\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.286262 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.285963 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3e897562-13f1-476a-aca0-2f505457e71e-root\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.286262 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.285968 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3e897562-13f1-476a-aca0-2f505457e71e-node-exporter-wtmp\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.286262 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.285993 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e897562-13f1-476a-aca0-2f505457e71e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.286262 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.286028 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk7zd\" (UniqueName: \"kubernetes.io/projected/3e897562-13f1-476a-aca0-2f505457e71e-kube-api-access-mk7zd\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.286262 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.286207 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3e897562-13f1-476a-aca0-2f505457e71e-node-exporter-textfile\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.286610 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.286579 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e897562-13f1-476a-aca0-2f505457e71e-metrics-client-ca\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.286610 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.286589 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3e897562-13f1-476a-aca0-2f505457e71e-node-exporter-accelerators-collector-config\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.289078 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.289055 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e897562-13f1-476a-aca0-2f505457e71e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.289193 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.289134 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3e897562-13f1-476a-aca0-2f505457e71e-node-exporter-tls\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.308137 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.308114 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk7zd\" (UniqueName: \"kubernetes.io/projected/3e897562-13f1-476a-aca0-2f505457e71e-kube-api-access-mk7zd\") pod \"node-exporter-ql8wq\" (UID: \"3e897562-13f1-476a-aca0-2f505457e71e\") " pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.473988 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:53.473956 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ql8wq" Jul 15 22:34:53.498780 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:34:53.498755 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e897562_13f1_476a_aca0_2f505457e71e.slice/crio-ce30ba03adbf607df23f26814e9d2cf0e3c1e47b011d25955a39824ceddb9997 WatchSource:0}: Error finding container ce30ba03adbf607df23f26814e9d2cf0e3c1e47b011d25955a39824ceddb9997: Status 404 returned error can't find the container with id ce30ba03adbf607df23f26814e9d2cf0e3c1e47b011d25955a39824ceddb9997 Jul 15 22:34:54.464237 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:54.464188 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ql8wq" event={"ID":"3e897562-13f1-476a-aca0-2f505457e71e","Type":"ContainerStarted","Data":"ce30ba03adbf607df23f26814e9d2cf0e3c1e47b011d25955a39824ceddb9997"} Jul 15 22:34:55.474481 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:55.474402 2560 generic.go:356] "Generic (PLEG): container finished" podID="3e897562-13f1-476a-aca0-2f505457e71e" containerID="28067083d9195ce4e128830d484c53c28f73437a685ecc44f9c26942fe9bb0f9" exitCode=0 Jul 15 22:34:55.474481 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:55.474461 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ql8wq" event={"ID":"3e897562-13f1-476a-aca0-2f505457e71e","Type":"ContainerDied","Data":"28067083d9195ce4e128830d484c53c28f73437a685ecc44f9c26942fe9bb0f9"} Jul 15 22:34:56.480090 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:56.480053 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ql8wq" event={"ID":"3e897562-13f1-476a-aca0-2f505457e71e","Type":"ContainerStarted","Data":"10dd306c03eb93efc55a7e9a676879a4ba072b924278d453933603d79b66ab21"} Jul 15 22:34:56.480462 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:56.480104 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ql8wq" event={"ID":"3e897562-13f1-476a-aca0-2f505457e71e","Type":"ContainerStarted","Data":"22017d4fe97edb22f303c41dcae4a0adbcaca97d8dd216e90bb424bb14af6506"} Jul 15 22:34:56.515528 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:34:56.515479 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ql8wq" podStartSLOduration=1.9809892740000001 podStartE2EDuration="3.515464625s" totalImagesPullingTime="1.430978381s" totalInitContainerRuntime="103.49697ms" isStatefulPod=true podCreationTimestamp="2026-07-15 22:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:56.514047039 +0000 UTC m=+106.221844631" watchObservedRunningTime="2026-07-15 22:34:56.515464625 +0000 UTC m=+106.223262216" Jul 15 22:35:05.955069 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:05.955036 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cdc5455d8-xb9dw"] Jul 15 22:35:05.959690 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:05.959668 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:05.963310 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:05.963276 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 15 22:35:05.963310 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:05.963301 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 15 22:35:05.964076 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:05.964053 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 22:35:05.964542 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:05.964521 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 15 22:35:05.965213 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:05.965186 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 22:35:05.965468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:05.965447 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 15 22:35:05.965704 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:05.965681 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zxb9h\"" Jul 15 22:35:05.970261 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:05.970239 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 15 22:35:05.971889 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:05.971867 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 15 22:35:05.979497 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:05.979475 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cdc5455d8-xb9dw"] Jul 15 22:35:06.078194 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.078160 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1733c849-3155-4645-81be-00813a414b9b-oauth-serving-cert\") pod \"console-7cdc5455d8-xb9dw\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:06.078361 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.078202 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1733c849-3155-4645-81be-00813a414b9b-console-oauth-config\") pod \"console-7cdc5455d8-xb9dw\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:06.078361 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.078233 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1733c849-3155-4645-81be-00813a414b9b-console-serving-cert\") pod \"console-7cdc5455d8-xb9dw\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:06.078361 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.078269 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1733c849-3155-4645-81be-00813a414b9b-trusted-ca-bundle\") pod \"console-7cdc5455d8-xb9dw\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:06.078361 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.078289 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1733c849-3155-4645-81be-00813a414b9b-console-config\") pod \"console-7cdc5455d8-xb9dw\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:06.078361 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.078313 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1733c849-3155-4645-81be-00813a414b9b-service-ca\") pod \"console-7cdc5455d8-xb9dw\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:06.078579 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.078398 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w8mb\" (UniqueName: \"kubernetes.io/projected/1733c849-3155-4645-81be-00813a414b9b-kube-api-access-8w8mb\") pod \"console-7cdc5455d8-xb9dw\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:06.179034 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.179002 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1733c849-3155-4645-81be-00813a414b9b-trusted-ca-bundle\") pod \"console-7cdc5455d8-xb9dw\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:06.179205 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.179040 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1733c849-3155-4645-81be-00813a414b9b-console-config\") pod \"console-7cdc5455d8-xb9dw\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:06.179205 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.179062 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1733c849-3155-4645-81be-00813a414b9b-service-ca\") pod \"console-7cdc5455d8-xb9dw\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:06.179205 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.179094 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w8mb\" (UniqueName: \"kubernetes.io/projected/1733c849-3155-4645-81be-00813a414b9b-kube-api-access-8w8mb\") pod \"console-7cdc5455d8-xb9dw\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:06.179205 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.179126 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1733c849-3155-4645-81be-00813a414b9b-oauth-serving-cert\") pod \"console-7cdc5455d8-xb9dw\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:06.179205 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.179149 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1733c849-3155-4645-81be-00813a414b9b-console-oauth-config\") pod \"console-7cdc5455d8-xb9dw\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:06.179205 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.179177 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1733c849-3155-4645-81be-00813a414b9b-console-serving-cert\") pod \"console-7cdc5455d8-xb9dw\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:06.179945 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.179918 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1733c849-3155-4645-81be-00813a414b9b-service-ca\") pod \"console-7cdc5455d8-xb9dw\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:06.179945 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.179936 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1733c849-3155-4645-81be-00813a414b9b-trusted-ca-bundle\") pod \"console-7cdc5455d8-xb9dw\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:06.180084 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.179956 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1733c849-3155-4645-81be-00813a414b9b-console-config\") pod \"console-7cdc5455d8-xb9dw\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:06.180146 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.180126 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1733c849-3155-4645-81be-00813a414b9b-oauth-serving-cert\") pod \"console-7cdc5455d8-xb9dw\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:06.181642 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.181611 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1733c849-3155-4645-81be-00813a414b9b-console-serving-cert\") pod \"console-7cdc5455d8-xb9dw\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:06.181756 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.181738 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1733c849-3155-4645-81be-00813a414b9b-console-oauth-config\") pod \"console-7cdc5455d8-xb9dw\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:06.194656 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.194626 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w8mb\" (UniqueName: \"kubernetes.io/projected/1733c849-3155-4645-81be-00813a414b9b-kube-api-access-8w8mb\") pod \"console-7cdc5455d8-xb9dw\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:06.273691 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.273639 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:06.417111 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.417081 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cdc5455d8-xb9dw"] Jul 15 22:35:06.419969 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:35:06.419936 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1733c849_3155_4645_81be_00813a414b9b.slice/crio-b14f381c0c92cfb6826e02a4252923fb0c1ec7fc78f2a43227d936125d3e9129 WatchSource:0}: Error finding container b14f381c0c92cfb6826e02a4252923fb0c1ec7fc78f2a43227d936125d3e9129: Status 404 returned error can't find the container with id b14f381c0c92cfb6826e02a4252923fb0c1ec7fc78f2a43227d936125d3e9129 Jul 15 22:35:06.515440 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.515412 2560 generic.go:356] "Generic (PLEG): container finished" podID="6526d328-fec6-480f-a622-d418194e153f" containerID="04af1f664f85e94acbd3027a8aab68e553272bbe03a853351d49126bf088d8cb" exitCode=0 Jul 15 22:35:06.515534 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.515488 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgtv8" event={"ID":"6526d328-fec6-480f-a622-d418194e153f","Type":"ContainerDied","Data":"04af1f664f85e94acbd3027a8aab68e553272bbe03a853351d49126bf088d8cb"} Jul 15 22:35:06.515882 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.515840 2560 scope.go:117] "RemoveContainer" containerID="04af1f664f85e94acbd3027a8aab68e553272bbe03a853351d49126bf088d8cb" Jul 15 22:35:06.516716 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:06.516690 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cdc5455d8-xb9dw" event={"ID":"1733c849-3155-4645-81be-00813a414b9b","Type":"ContainerStarted","Data":"b14f381c0c92cfb6826e02a4252923fb0c1ec7fc78f2a43227d936125d3e9129"} Jul 15 22:35:07.523035 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:07.523001 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgtv8" event={"ID":"6526d328-fec6-480f-a622-d418194e153f","Type":"ContainerStarted","Data":"fdc9af45c38e23564f60b4465cda92257bca039d021c667f38a5371c3e630966"} Jul 15 22:35:09.017649 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.017597 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-58549999b7-njxqg" podUID="9ccbed96-e66b-4d37-8d20-dbe2f78782ff" containerName="registry" containerID="cri-o://2894fcc683bebd0c34cded744745daea1990e3cf9e8d826afd69489b6a093426" gracePeriod=30 Jul 15 22:35:09.301438 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.301348 2560 patch_prober.go:28] interesting pod/image-registry-58549999b7-njxqg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.133.0.6:5000/healthz\": dial tcp 10.133.0.6:5000: connect: connection refused" start-of-body= Jul 15 22:35:09.301438 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.301412 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-58549999b7-njxqg" podUID="9ccbed96-e66b-4d37-8d20-dbe2f78782ff" containerName="registry" probeResult="failure" output="Get \"https://10.133.0.6:5000/healthz\": dial tcp 10.133.0.6:5000: connect: connection refused" Jul 15 22:35:09.532812 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.532776 2560 generic.go:356] "Generic (PLEG): container finished" podID="9ccbed96-e66b-4d37-8d20-dbe2f78782ff" containerID="2894fcc683bebd0c34cded744745daea1990e3cf9e8d826afd69489b6a093426" exitCode=0 Jul 15 22:35:09.532936 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.532844 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58549999b7-njxqg" event={"ID":"9ccbed96-e66b-4d37-8d20-dbe2f78782ff","Type":"ContainerDied","Data":"2894fcc683bebd0c34cded744745daea1990e3cf9e8d826afd69489b6a093426"} Jul 15 22:35:09.740226 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.740203 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:35:09.811569 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.811544 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dhlq\" (UniqueName: \"kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-kube-api-access-8dhlq\") pod \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " Jul 15 22:35:09.811685 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.811583 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-ca-trust-extracted\") pod \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " Jul 15 22:35:09.811685 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.811600 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-trusted-ca\") pod \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " Jul 15 22:35:09.811685 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.811663 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-certificates\") pod \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " Jul 15 22:35:09.811836 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.811689 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-image-registry-private-configuration\") pod \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " Jul 15 22:35:09.811836 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.811707 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-installation-pull-secrets\") pod \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " Jul 15 22:35:09.811836 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.811722 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-bound-sa-token\") pod \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " Jul 15 22:35:09.812156 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.812055 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9ccbed96-e66b-4d37-8d20-dbe2f78782ff" (UID: "9ccbed96-e66b-4d37-8d20-dbe2f78782ff"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:35:09.812156 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.812119 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9ccbed96-e66b-4d37-8d20-dbe2f78782ff" (UID: "9ccbed96-e66b-4d37-8d20-dbe2f78782ff"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:35:09.812156 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.812132 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-tls\") pod \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\" (UID: \"9ccbed96-e66b-4d37-8d20-dbe2f78782ff\") " Jul 15 22:35:09.812587 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.812567 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-trusted-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:35:09.812648 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.812596 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-certificates\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:35:09.814310 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.814154 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-kube-api-access-8dhlq" (OuterVolumeSpecName: "kube-api-access-8dhlq") pod "9ccbed96-e66b-4d37-8d20-dbe2f78782ff" (UID: "9ccbed96-e66b-4d37-8d20-dbe2f78782ff"). InnerVolumeSpecName "kube-api-access-8dhlq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:35:09.814810 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.814752 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9ccbed96-e66b-4d37-8d20-dbe2f78782ff" (UID: "9ccbed96-e66b-4d37-8d20-dbe2f78782ff"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:35:09.814971 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.814833 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9ccbed96-e66b-4d37-8d20-dbe2f78782ff" (UID: "9ccbed96-e66b-4d37-8d20-dbe2f78782ff"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:35:09.815138 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.815105 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9ccbed96-e66b-4d37-8d20-dbe2f78782ff" (UID: "9ccbed96-e66b-4d37-8d20-dbe2f78782ff"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:35:09.815218 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.815170 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9ccbed96-e66b-4d37-8d20-dbe2f78782ff" (UID: "9ccbed96-e66b-4d37-8d20-dbe2f78782ff"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:35:09.821592 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.821569 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9ccbed96-e66b-4d37-8d20-dbe2f78782ff" (UID: "9ccbed96-e66b-4d37-8d20-dbe2f78782ff"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:35:09.913954 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.913920 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dhlq\" (UniqueName: \"kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-kube-api-access-8dhlq\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:35:09.913954 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.913956 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-ca-trust-extracted\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:35:09.914127 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.913973 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-image-registry-private-configuration\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:35:09.914127 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.913988 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-installation-pull-secrets\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:35:09.914127 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.914002 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-bound-sa-token\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:35:09.914127 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:09.914016 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ccbed96-e66b-4d37-8d20-dbe2f78782ff-registry-tls\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:35:10.537439 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:10.537411 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58549999b7-njxqg" Jul 15 22:35:10.537841 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:10.537461 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58549999b7-njxqg" event={"ID":"9ccbed96-e66b-4d37-8d20-dbe2f78782ff","Type":"ContainerDied","Data":"3b4b08a82661ddfc674bde7c2caaefba1485fd138937dc0005958ab9e21746a1"} Jul 15 22:35:10.537841 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:10.537533 2560 scope.go:117] "RemoveContainer" containerID="2894fcc683bebd0c34cded744745daea1990e3cf9e8d826afd69489b6a093426" Jul 15 22:35:10.539231 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:10.539205 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cdc5455d8-xb9dw" event={"ID":"1733c849-3155-4645-81be-00813a414b9b","Type":"ContainerStarted","Data":"3fabe91480edfca185193d38b3be832fecb0571fd5867b21fb953af0c14b9976"} Jul 15 22:35:10.595195 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:10.595151 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cdc5455d8-xb9dw" podStartSLOduration=2.285228932 podStartE2EDuration="5.595136495s" totalImagesPullingTime="3.309907563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:35:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:35:10.57096188 +0000 UTC m=+120.278759471" watchObservedRunningTime="2026-07-15 22:35:10.595136495 +0000 UTC m=+120.302934087" Jul 15 22:35:10.595411 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:10.595396 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58549999b7-njxqg"] Jul 15 22:35:10.603411 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:10.603384 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-58549999b7-njxqg"] Jul 15 22:35:10.841523 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:10.841455 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ccbed96-e66b-4d37-8d20-dbe2f78782ff" path="/var/lib/kubelet/pods/9ccbed96-e66b-4d37-8d20-dbe2f78782ff/volumes" Jul 15 22:35:12.547985 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:12.547949 2560 generic.go:356] "Generic (PLEG): container finished" podID="c457296e-9f39-44cf-850d-f0c2de93e13a" containerID="ae98e615009642dcb125e0e904c66fc0a87de07020c7090bfebef0710f5ede8a" exitCode=0 Jul 15 22:35:12.548395 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:12.548026 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rm49r" event={"ID":"c457296e-9f39-44cf-850d-f0c2de93e13a","Type":"ContainerDied","Data":"ae98e615009642dcb125e0e904c66fc0a87de07020c7090bfebef0710f5ede8a"} Jul 15 22:35:12.548395 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:12.548373 2560 scope.go:117] "RemoveContainer" containerID="ae98e615009642dcb125e0e904c66fc0a87de07020c7090bfebef0710f5ede8a" Jul 15 22:35:13.553914 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:13.553880 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rm49r" event={"ID":"c457296e-9f39-44cf-850d-f0c2de93e13a","Type":"ContainerStarted","Data":"06655cdb8c597505ea02242c63c1da8f5b6b39226b065714cc43f51e191914ff"} Jul 15 22:35:16.274824 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:16.274775 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:16.274824 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:16.274840 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:16.280482 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:16.280459 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:16.566566 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:16.566481 2560 generic.go:356] "Generic (PLEG): container finished" podID="1e0e4204-98b9-48ae-b4c6-f0fba1e4d854" containerID="ee4e8aa38cc65846f2029293f3e56a819fb95894609eff58e26d02433c785b5b" exitCode=0 Jul 15 22:35:16.566697 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:16.566560 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" event={"ID":"1e0e4204-98b9-48ae-b4c6-f0fba1e4d854","Type":"ContainerDied","Data":"ee4e8aa38cc65846f2029293f3e56a819fb95894609eff58e26d02433c785b5b"} Jul 15 22:35:16.567003 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:16.566986 2560 scope.go:117] "RemoveContainer" containerID="ee4e8aa38cc65846f2029293f3e56a819fb95894609eff58e26d02433c785b5b" Jul 15 22:35:16.571208 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:16.571192 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:35:17.572006 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:35:17.571970 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-slh2k" event={"ID":"1e0e4204-98b9-48ae-b4c6-f0fba1e4d854","Type":"ContainerStarted","Data":"ee04932edec2cc855150967185469b247d50044194eb54cbd925f822553b824c"} Jul 15 22:36:12.789456 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.789248 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54494dc84c-2ccr7"] Jul 15 22:36:12.790382 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.790360 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ccbed96-e66b-4d37-8d20-dbe2f78782ff" containerName="registry" Jul 15 22:36:12.790506 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.790487 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ccbed96-e66b-4d37-8d20-dbe2f78782ff" containerName="registry" Jul 15 22:36:12.790636 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.790606 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ccbed96-e66b-4d37-8d20-dbe2f78782ff" containerName="registry" Jul 15 22:36:12.793042 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.793022 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:12.804798 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.804772 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54494dc84c-2ccr7"] Jul 15 22:36:12.883029 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.882995 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-service-ca\") pod \"console-54494dc84c-2ccr7\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:12.883146 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.883128 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-console-config\") pod \"console-54494dc84c-2ccr7\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:12.883186 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.883170 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-console-serving-cert\") pod \"console-54494dc84c-2ccr7\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:12.883222 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.883203 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-trusted-ca-bundle\") pod \"console-54494dc84c-2ccr7\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:12.883265 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.883249 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-console-oauth-config\") pod \"console-54494dc84c-2ccr7\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:12.883342 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.883322 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98rbw\" (UniqueName: \"kubernetes.io/projected/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-kube-api-access-98rbw\") pod \"console-54494dc84c-2ccr7\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:12.883378 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.883353 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-oauth-serving-cert\") pod \"console-54494dc84c-2ccr7\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:12.984537 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.984498 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-service-ca\") pod \"console-54494dc84c-2ccr7\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:12.984537 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.984540 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-console-config\") pod \"console-54494dc84c-2ccr7\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:12.984753 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.984562 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-console-serving-cert\") pod \"console-54494dc84c-2ccr7\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:12.984753 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.984578 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-trusted-ca-bundle\") pod \"console-54494dc84c-2ccr7\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:12.984753 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.984710 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-console-oauth-config\") pod \"console-54494dc84c-2ccr7\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:12.984957 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.984777 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98rbw\" (UniqueName: \"kubernetes.io/projected/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-kube-api-access-98rbw\") pod \"console-54494dc84c-2ccr7\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:12.984957 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.984811 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-oauth-serving-cert\") pod \"console-54494dc84c-2ccr7\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:12.985458 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.985417 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-console-config\") pod \"console-54494dc84c-2ccr7\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:12.985624 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.985598 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-service-ca\") pod \"console-54494dc84c-2ccr7\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:12.986689 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.986661 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-oauth-serving-cert\") pod \"console-54494dc84c-2ccr7\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:12.986964 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.986946 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-trusted-ca-bundle\") pod \"console-54494dc84c-2ccr7\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:12.987512 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.987491 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-console-serving-cert\") pod \"console-54494dc84c-2ccr7\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:12.987953 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.987938 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-console-oauth-config\") pod \"console-54494dc84c-2ccr7\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:12.995763 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:12.995737 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98rbw\" (UniqueName: \"kubernetes.io/projected/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-kube-api-access-98rbw\") pod \"console-54494dc84c-2ccr7\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:13.103295 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:13.103207 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:13.236708 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:13.236684 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54494dc84c-2ccr7"] Jul 15 22:36:13.238419 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:36:13.238389 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod255eb49c_23c0_46dd_ade2_504dc0c8a5d6.slice/crio-8fc41acb270c57067f90853ed63adae80889607e71f35ef0c30ce5e45305cdae WatchSource:0}: Error finding container 8fc41acb270c57067f90853ed63adae80889607e71f35ef0c30ce5e45305cdae: Status 404 returned error can't find the container with id 8fc41acb270c57067f90853ed63adae80889607e71f35ef0c30ce5e45305cdae Jul 15 22:36:13.781674 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:13.781635 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54494dc84c-2ccr7" event={"ID":"255eb49c-23c0-46dd-ade2-504dc0c8a5d6","Type":"ContainerStarted","Data":"28cd823507c2236a0d68a92679544dbe08d9011c731862d1802e486707b821ed"} Jul 15 22:36:13.781871 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:13.781695 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54494dc84c-2ccr7" event={"ID":"255eb49c-23c0-46dd-ade2-504dc0c8a5d6","Type":"ContainerStarted","Data":"8fc41acb270c57067f90853ed63adae80889607e71f35ef0c30ce5e45305cdae"} Jul 15 22:36:13.805229 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:13.805174 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54494dc84c-2ccr7" podStartSLOduration=1.8051576969999998 podStartE2EDuration="1.805157697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:36:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:36:13.804336385 +0000 UTC m=+183.512133978" watchObservedRunningTime="2026-07-15 22:36:13.805157697 +0000 UTC m=+183.512955289" Jul 15 22:36:23.103949 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:23.103910 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:23.104437 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:23.104006 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:23.108546 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:23.108525 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:23.821375 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:23.821346 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:36:23.866217 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:23.866184 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cdc5455d8-xb9dw"] Jul 15 22:36:48.892754 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:48.892698 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7cdc5455d8-xb9dw" podUID="1733c849-3155-4645-81be-00813a414b9b" containerName="console" containerID="cri-o://3fabe91480edfca185193d38b3be832fecb0571fd5867b21fb953af0c14b9976" gracePeriod=15 Jul 15 22:36:49.140400 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.140378 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:36:49.266765 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.266734 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8w8mb\" (UniqueName: \"kubernetes.io/projected/1733c849-3155-4645-81be-00813a414b9b-kube-api-access-8w8mb\") pod \"1733c849-3155-4645-81be-00813a414b9b\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " Jul 15 22:36:49.266975 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.266774 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1733c849-3155-4645-81be-00813a414b9b-console-serving-cert\") pod \"1733c849-3155-4645-81be-00813a414b9b\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " Jul 15 22:36:49.266975 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.266793 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1733c849-3155-4645-81be-00813a414b9b-oauth-serving-cert\") pod \"1733c849-3155-4645-81be-00813a414b9b\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " Jul 15 22:36:49.266975 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.266811 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1733c849-3155-4645-81be-00813a414b9b-trusted-ca-bundle\") pod \"1733c849-3155-4645-81be-00813a414b9b\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " Jul 15 22:36:49.266975 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.266926 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1733c849-3155-4645-81be-00813a414b9b-service-ca\") pod \"1733c849-3155-4645-81be-00813a414b9b\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " Jul 15 22:36:49.266975 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.266955 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1733c849-3155-4645-81be-00813a414b9b-console-config\") pod \"1733c849-3155-4645-81be-00813a414b9b\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " Jul 15 22:36:49.267234 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.266979 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1733c849-3155-4645-81be-00813a414b9b-console-oauth-config\") pod \"1733c849-3155-4645-81be-00813a414b9b\" (UID: \"1733c849-3155-4645-81be-00813a414b9b\") " Jul 15 22:36:49.267317 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.267291 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1733c849-3155-4645-81be-00813a414b9b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1733c849-3155-4645-81be-00813a414b9b" (UID: "1733c849-3155-4645-81be-00813a414b9b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:36:49.267376 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.267325 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1733c849-3155-4645-81be-00813a414b9b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1733c849-3155-4645-81be-00813a414b9b" (UID: "1733c849-3155-4645-81be-00813a414b9b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:36:49.267450 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.267422 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1733c849-3155-4645-81be-00813a414b9b-service-ca" (OuterVolumeSpecName: "service-ca") pod "1733c849-3155-4645-81be-00813a414b9b" (UID: "1733c849-3155-4645-81be-00813a414b9b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:36:49.267575 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.267431 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1733c849-3155-4645-81be-00813a414b9b-console-config" (OuterVolumeSpecName: "console-config") pod "1733c849-3155-4645-81be-00813a414b9b" (UID: "1733c849-3155-4645-81be-00813a414b9b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:36:49.269120 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.269091 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1733c849-3155-4645-81be-00813a414b9b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1733c849-3155-4645-81be-00813a414b9b" (UID: "1733c849-3155-4645-81be-00813a414b9b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:36:49.269225 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.269145 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1733c849-3155-4645-81be-00813a414b9b-kube-api-access-8w8mb" (OuterVolumeSpecName: "kube-api-access-8w8mb") pod "1733c849-3155-4645-81be-00813a414b9b" (UID: "1733c849-3155-4645-81be-00813a414b9b"). InnerVolumeSpecName "kube-api-access-8w8mb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:36:49.269263 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.269220 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1733c849-3155-4645-81be-00813a414b9b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1733c849-3155-4645-81be-00813a414b9b" (UID: "1733c849-3155-4645-81be-00813a414b9b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:36:49.368083 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.368042 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1733c849-3155-4645-81be-00813a414b9b-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:36:49.368083 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.368078 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1733c849-3155-4645-81be-00813a414b9b-console-config\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:36:49.368227 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.368091 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1733c849-3155-4645-81be-00813a414b9b-console-oauth-config\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:36:49.368227 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.368104 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w8mb\" (UniqueName: \"kubernetes.io/projected/1733c849-3155-4645-81be-00813a414b9b-kube-api-access-8w8mb\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:36:49.368227 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.368116 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1733c849-3155-4645-81be-00813a414b9b-console-serving-cert\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:36:49.368227 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.368127 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1733c849-3155-4645-81be-00813a414b9b-oauth-serving-cert\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:36:49.368227 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.368139 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1733c849-3155-4645-81be-00813a414b9b-trusted-ca-bundle\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:36:49.906670 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.906633 2560 generic.go:356] "Generic (PLEG): container finished" podID="1733c849-3155-4645-81be-00813a414b9b" containerID="3fabe91480edfca185193d38b3be832fecb0571fd5867b21fb953af0c14b9976" exitCode=0 Jul 15 22:36:49.907047 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.906676 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cdc5455d8-xb9dw" event={"ID":"1733c849-3155-4645-81be-00813a414b9b","Type":"ContainerDied","Data":"3fabe91480edfca185193d38b3be832fecb0571fd5867b21fb953af0c14b9976"} Jul 15 22:36:49.907047 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.906725 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cdc5455d8-xb9dw" event={"ID":"1733c849-3155-4645-81be-00813a414b9b","Type":"ContainerDied","Data":"b14f381c0c92cfb6826e02a4252923fb0c1ec7fc78f2a43227d936125d3e9129"} Jul 15 22:36:49.907047 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.906745 2560 scope.go:117] "RemoveContainer" containerID="3fabe91480edfca185193d38b3be832fecb0571fd5867b21fb953af0c14b9976" Jul 15 22:36:49.907047 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.906686 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cdc5455d8-xb9dw" Jul 15 22:36:49.915012 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.914998 2560 scope.go:117] "RemoveContainer" containerID="3fabe91480edfca185193d38b3be832fecb0571fd5867b21fb953af0c14b9976" Jul 15 22:36:49.915257 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:36:49.915238 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fabe91480edfca185193d38b3be832fecb0571fd5867b21fb953af0c14b9976\": container with ID starting with 3fabe91480edfca185193d38b3be832fecb0571fd5867b21fb953af0c14b9976 not found: ID does not exist" containerID="3fabe91480edfca185193d38b3be832fecb0571fd5867b21fb953af0c14b9976" Jul 15 22:36:49.915327 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.915269 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fabe91480edfca185193d38b3be832fecb0571fd5867b21fb953af0c14b9976"} err="failed to get container status \"3fabe91480edfca185193d38b3be832fecb0571fd5867b21fb953af0c14b9976\": rpc error: code = NotFound desc = could not find container \"3fabe91480edfca185193d38b3be832fecb0571fd5867b21fb953af0c14b9976\": container with ID starting with 3fabe91480edfca185193d38b3be832fecb0571fd5867b21fb953af0c14b9976 not found: ID does not exist" Jul 15 22:36:49.927338 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.927310 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cdc5455d8-xb9dw"] Jul 15 22:36:49.930329 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:49.930309 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cdc5455d8-xb9dw"] Jul 15 22:36:50.839669 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:36:50.839637 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1733c849-3155-4645-81be-00813a414b9b" path="/var/lib/kubelet/pods/1733c849-3155-4645-81be-00813a414b9b/volumes" Jul 15 22:37:11.216551 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:11.216516 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b"] Jul 15 22:37:11.216945 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:11.216812 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1733c849-3155-4645-81be-00813a414b9b" containerName="console" Jul 15 22:37:11.216945 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:11.216825 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1733c849-3155-4645-81be-00813a414b9b" containerName="console" Jul 15 22:37:11.216945 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:11.216915 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1733c849-3155-4645-81be-00813a414b9b" containerName="console" Jul 15 22:37:11.219655 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:11.219638 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b" Jul 15 22:37:11.222095 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:11.222072 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 22:37:11.222211 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:11.222152 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 22:37:11.222869 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:11.222835 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s4mf4\"" Jul 15 22:37:11.229797 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:11.229776 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b"] Jul 15 22:37:11.323404 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:11.323373 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s6cl\" (UniqueName: \"kubernetes.io/projected/2ec59316-24cf-4ba2-aba0-586063527e91-kube-api-access-9s6cl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b\" (UID: \"2ec59316-24cf-4ba2-aba0-586063527e91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b" Jul 15 22:37:11.323527 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:11.323409 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ec59316-24cf-4ba2-aba0-586063527e91-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b\" (UID: \"2ec59316-24cf-4ba2-aba0-586063527e91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b" Jul 15 22:37:11.323527 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:11.323430 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ec59316-24cf-4ba2-aba0-586063527e91-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b\" (UID: \"2ec59316-24cf-4ba2-aba0-586063527e91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b" Jul 15 22:37:11.424335 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:11.424308 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s6cl\" (UniqueName: \"kubernetes.io/projected/2ec59316-24cf-4ba2-aba0-586063527e91-kube-api-access-9s6cl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b\" (UID: \"2ec59316-24cf-4ba2-aba0-586063527e91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b" Jul 15 22:37:11.424445 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:11.424339 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ec59316-24cf-4ba2-aba0-586063527e91-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b\" (UID: \"2ec59316-24cf-4ba2-aba0-586063527e91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b" Jul 15 22:37:11.424445 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:11.424358 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ec59316-24cf-4ba2-aba0-586063527e91-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b\" (UID: \"2ec59316-24cf-4ba2-aba0-586063527e91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b" Jul 15 22:37:11.424673 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:11.424656 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ec59316-24cf-4ba2-aba0-586063527e91-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b\" (UID: \"2ec59316-24cf-4ba2-aba0-586063527e91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b" Jul 15 22:37:11.424709 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:11.424677 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ec59316-24cf-4ba2-aba0-586063527e91-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b\" (UID: \"2ec59316-24cf-4ba2-aba0-586063527e91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b" Jul 15 22:37:11.432568 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:11.432539 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s6cl\" (UniqueName: \"kubernetes.io/projected/2ec59316-24cf-4ba2-aba0-586063527e91-kube-api-access-9s6cl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b\" (UID: \"2ec59316-24cf-4ba2-aba0-586063527e91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b" Jul 15 22:37:11.528246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:11.528183 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b" Jul 15 22:37:11.668145 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:11.668117 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b"] Jul 15 22:37:11.669454 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:37:11.669392 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec59316_24cf_4ba2_aba0_586063527e91.slice/crio-41b8dff738dddde4eb9b106a85e08a2745c67e195f5c581a60a42efb30c3101f WatchSource:0}: Error finding container 41b8dff738dddde4eb9b106a85e08a2745c67e195f5c581a60a42efb30c3101f: Status 404 returned error can't find the container with id 41b8dff738dddde4eb9b106a85e08a2745c67e195f5c581a60a42efb30c3101f Jul 15 22:37:11.991322 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:11.991285 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b" event={"ID":"2ec59316-24cf-4ba2-aba0-586063527e91","Type":"ContainerStarted","Data":"41b8dff738dddde4eb9b106a85e08a2745c67e195f5c581a60a42efb30c3101f"} Jul 15 22:37:18.017345 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:18.017310 2560 generic.go:356] "Generic (PLEG): container finished" podID="2ec59316-24cf-4ba2-aba0-586063527e91" containerID="0c17c0e679f453c3726ea726a42b89ff5c22a9a23d3ccba97b252618ed8d9d66" exitCode=0 Jul 15 22:37:18.017653 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:18.017370 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b" event={"ID":"2ec59316-24cf-4ba2-aba0-586063527e91","Type":"ContainerDied","Data":"0c17c0e679f453c3726ea726a42b89ff5c22a9a23d3ccba97b252618ed8d9d66"} Jul 15 22:37:21.029684 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:21.029643 2560 generic.go:356] "Generic (PLEG): container finished" podID="2ec59316-24cf-4ba2-aba0-586063527e91" containerID="6d348fa3b46950fc2586413a8d7c31acfeb4783d843bbb874e262867619e2888" exitCode=0 Jul 15 22:37:21.030071 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:21.029688 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b" event={"ID":"2ec59316-24cf-4ba2-aba0-586063527e91","Type":"ContainerDied","Data":"6d348fa3b46950fc2586413a8d7c31acfeb4783d843bbb874e262867619e2888"} Jul 15 22:37:28.067457 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:28.067364 2560 generic.go:356] "Generic (PLEG): container finished" podID="2ec59316-24cf-4ba2-aba0-586063527e91" containerID="13f16d0bb25595845fbdb8c88d40044452e29191ab423723fdf1ae498f6bf10a" exitCode=0 Jul 15 22:37:28.067457 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:28.067432 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b" event={"ID":"2ec59316-24cf-4ba2-aba0-586063527e91","Type":"ContainerDied","Data":"13f16d0bb25595845fbdb8c88d40044452e29191ab423723fdf1ae498f6bf10a"} Jul 15 22:37:29.196923 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:29.196898 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b" Jul 15 22:37:29.285693 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:29.285659 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9s6cl\" (UniqueName: \"kubernetes.io/projected/2ec59316-24cf-4ba2-aba0-586063527e91-kube-api-access-9s6cl\") pod \"2ec59316-24cf-4ba2-aba0-586063527e91\" (UID: \"2ec59316-24cf-4ba2-aba0-586063527e91\") " Jul 15 22:37:29.285693 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:29.285705 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ec59316-24cf-4ba2-aba0-586063527e91-bundle\") pod \"2ec59316-24cf-4ba2-aba0-586063527e91\" (UID: \"2ec59316-24cf-4ba2-aba0-586063527e91\") " Jul 15 22:37:29.285985 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:29.285768 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ec59316-24cf-4ba2-aba0-586063527e91-util\") pod \"2ec59316-24cf-4ba2-aba0-586063527e91\" (UID: \"2ec59316-24cf-4ba2-aba0-586063527e91\") " Jul 15 22:37:29.286475 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:29.286445 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ec59316-24cf-4ba2-aba0-586063527e91-bundle" (OuterVolumeSpecName: "bundle") pod "2ec59316-24cf-4ba2-aba0-586063527e91" (UID: "2ec59316-24cf-4ba2-aba0-586063527e91"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:37:29.288110 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:29.288083 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ec59316-24cf-4ba2-aba0-586063527e91-kube-api-access-9s6cl" (OuterVolumeSpecName: "kube-api-access-9s6cl") pod "2ec59316-24cf-4ba2-aba0-586063527e91" (UID: "2ec59316-24cf-4ba2-aba0-586063527e91"). InnerVolumeSpecName "kube-api-access-9s6cl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:37:29.290687 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:29.290661 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ec59316-24cf-4ba2-aba0-586063527e91-util" (OuterVolumeSpecName: "util") pod "2ec59316-24cf-4ba2-aba0-586063527e91" (UID: "2ec59316-24cf-4ba2-aba0-586063527e91"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:37:29.387236 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:29.387143 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9s6cl\" (UniqueName: \"kubernetes.io/projected/2ec59316-24cf-4ba2-aba0-586063527e91-kube-api-access-9s6cl\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:37:29.387236 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:29.387178 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ec59316-24cf-4ba2-aba0-586063527e91-bundle\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:37:29.387236 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:29.387189 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ec59316-24cf-4ba2-aba0-586063527e91-util\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:37:30.077374 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:30.077336 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b" event={"ID":"2ec59316-24cf-4ba2-aba0-586063527e91","Type":"ContainerDied","Data":"41b8dff738dddde4eb9b106a85e08a2745c67e195f5c581a60a42efb30c3101f"} Jul 15 22:37:30.077374 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:30.077376 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409mn2b" Jul 15 22:37:30.077579 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:30.077389 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41b8dff738dddde4eb9b106a85e08a2745c67e195f5c581a60a42efb30c3101f" Jul 15 22:37:34.125168 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:34.125095 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vg47l"] Jul 15 22:37:34.125496 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:34.125355 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ec59316-24cf-4ba2-aba0-586063527e91" containerName="extract" Jul 15 22:37:34.125496 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:34.125365 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ec59316-24cf-4ba2-aba0-586063527e91" containerName="extract" Jul 15 22:37:34.125496 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:34.125376 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ec59316-24cf-4ba2-aba0-586063527e91" containerName="pull" Jul 15 22:37:34.125496 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:34.125382 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ec59316-24cf-4ba2-aba0-586063527e91" containerName="pull" Jul 15 22:37:34.125496 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:34.125389 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ec59316-24cf-4ba2-aba0-586063527e91" containerName="util" Jul 15 22:37:34.125496 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:34.125395 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ec59316-24cf-4ba2-aba0-586063527e91" containerName="util" Jul 15 22:37:34.125496 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:34.125458 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ec59316-24cf-4ba2-aba0-586063527e91" containerName="extract" Jul 15 22:37:34.169481 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:34.169452 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vg47l"] Jul 15 22:37:34.169610 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:34.169536 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vg47l" Jul 15 22:37:34.171844 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:34.171814 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 15 22:37:34.171987 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:34.171814 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-wpkjv\"" Jul 15 22:37:34.171987 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:34.171914 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 15 22:37:34.227434 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:34.227405 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8cv2\" (UniqueName: \"kubernetes.io/projected/823b9123-4b44-4b55-b6bd-97a2cad95cb9-kube-api-access-h8cv2\") pod \"cert-manager-operator-controller-manager-55c444bf86-vg47l\" (UID: \"823b9123-4b44-4b55-b6bd-97a2cad95cb9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vg47l" Jul 15 22:37:34.227523 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:34.227438 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/823b9123-4b44-4b55-b6bd-97a2cad95cb9-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vg47l\" (UID: \"823b9123-4b44-4b55-b6bd-97a2cad95cb9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vg47l" Jul 15 22:37:34.328499 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:34.328473 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8cv2\" (UniqueName: \"kubernetes.io/projected/823b9123-4b44-4b55-b6bd-97a2cad95cb9-kube-api-access-h8cv2\") pod \"cert-manager-operator-controller-manager-55c444bf86-vg47l\" (UID: \"823b9123-4b44-4b55-b6bd-97a2cad95cb9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vg47l" Jul 15 22:37:34.328593 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:34.328504 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/823b9123-4b44-4b55-b6bd-97a2cad95cb9-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vg47l\" (UID: \"823b9123-4b44-4b55-b6bd-97a2cad95cb9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vg47l" Jul 15 22:37:34.328792 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:34.328777 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/823b9123-4b44-4b55-b6bd-97a2cad95cb9-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vg47l\" (UID: \"823b9123-4b44-4b55-b6bd-97a2cad95cb9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vg47l" Jul 15 22:37:34.340101 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:34.340072 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8cv2\" (UniqueName: \"kubernetes.io/projected/823b9123-4b44-4b55-b6bd-97a2cad95cb9-kube-api-access-h8cv2\") pod \"cert-manager-operator-controller-manager-55c444bf86-vg47l\" (UID: \"823b9123-4b44-4b55-b6bd-97a2cad95cb9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vg47l" Jul 15 22:37:34.479066 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:34.479043 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vg47l" Jul 15 22:37:34.633826 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:34.633793 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vg47l"] Jul 15 22:37:34.638233 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:37:34.638206 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod823b9123_4b44_4b55_b6bd_97a2cad95cb9.slice/crio-8c1d40c4e192c8fccb3ad34a809c2491a3801947bfb180664f765cf7b419e39a WatchSource:0}: Error finding container 8c1d40c4e192c8fccb3ad34a809c2491a3801947bfb180664f765cf7b419e39a: Status 404 returned error can't find the container with id 8c1d40c4e192c8fccb3ad34a809c2491a3801947bfb180664f765cf7b419e39a Jul 15 22:37:35.097616 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:35.097581 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vg47l" event={"ID":"823b9123-4b44-4b55-b6bd-97a2cad95cb9","Type":"ContainerStarted","Data":"8c1d40c4e192c8fccb3ad34a809c2491a3801947bfb180664f765cf7b419e39a"} Jul 15 22:37:37.109529 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:37.109488 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vg47l" event={"ID":"823b9123-4b44-4b55-b6bd-97a2cad95cb9","Type":"ContainerStarted","Data":"06dc90dbcd8a6d8d3e48f0a1a7659fb49e2ce90005ca3b9becdfff5cac664428"} Jul 15 22:37:37.129669 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:37.129619 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vg47l" podStartSLOduration=0.876655695 podStartE2EDuration="3.129603867s" totalImagesPullingTime="2.252948172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:37:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:37:37.128109641 +0000 UTC m=+266.835907247" watchObservedRunningTime="2026-07-15 22:37:37.129603867 +0000 UTC m=+266.837401463" Jul 15 22:37:38.090151 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.090111 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq"] Jul 15 22:37:38.092601 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.092579 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq" Jul 15 22:37:38.095238 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.095214 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 22:37:38.095357 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.095215 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 22:37:38.095903 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.095885 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s4mf4\"" Jul 15 22:37:38.105353 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.105327 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq"] Jul 15 22:37:38.156949 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.156911 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzhvm\" (UniqueName: \"kubernetes.io/projected/d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f-kube-api-access-hzhvm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq\" (UID: \"d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq" Jul 15 22:37:38.157353 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.156999 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq\" (UID: \"d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq" Jul 15 22:37:38.157353 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.157028 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq\" (UID: \"d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq" Jul 15 22:37:38.255640 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.255602 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-47gcs"] Jul 15 22:37:38.257866 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.257834 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-47gcs" Jul 15 22:37:38.258131 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.258107 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq\" (UID: \"d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq" Jul 15 22:37:38.258202 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.258148 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq\" (UID: \"d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq" Jul 15 22:37:38.258245 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.258223 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzhvm\" (UniqueName: \"kubernetes.io/projected/d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f-kube-api-access-hzhvm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq\" (UID: \"d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq" Jul 15 22:37:38.258633 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.258543 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq\" (UID: \"d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq" Jul 15 22:37:38.258680 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.258569 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq\" (UID: \"d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq" Jul 15 22:37:38.260166 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.260148 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-c5jqp\"" Jul 15 22:37:38.260424 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.260404 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 15 22:37:38.260497 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.260409 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 15 22:37:38.268373 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.268343 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzhvm\" (UniqueName: \"kubernetes.io/projected/d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f-kube-api-access-hzhvm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq\" (UID: \"d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq" Jul 15 22:37:38.269338 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.269316 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-47gcs"] Jul 15 22:37:38.359709 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.359602 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6gpm\" (UniqueName: \"kubernetes.io/projected/c8498d97-f79e-4a43-9dff-a56afb4fe83a-kube-api-access-x6gpm\") pod \"cert-manager-webhook-6486ffd997-47gcs\" (UID: \"c8498d97-f79e-4a43-9dff-a56afb4fe83a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-47gcs" Jul 15 22:37:38.359709 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.359643 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8498d97-f79e-4a43-9dff-a56afb4fe83a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-47gcs\" (UID: \"c8498d97-f79e-4a43-9dff-a56afb4fe83a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-47gcs" Jul 15 22:37:38.402596 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.402563 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq" Jul 15 22:37:38.460941 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.460910 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6gpm\" (UniqueName: \"kubernetes.io/projected/c8498d97-f79e-4a43-9dff-a56afb4fe83a-kube-api-access-x6gpm\") pod \"cert-manager-webhook-6486ffd997-47gcs\" (UID: \"c8498d97-f79e-4a43-9dff-a56afb4fe83a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-47gcs" Jul 15 22:37:38.461078 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.460948 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8498d97-f79e-4a43-9dff-a56afb4fe83a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-47gcs\" (UID: \"c8498d97-f79e-4a43-9dff-a56afb4fe83a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-47gcs" Jul 15 22:37:38.470689 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.470650 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8498d97-f79e-4a43-9dff-a56afb4fe83a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-47gcs\" (UID: \"c8498d97-f79e-4a43-9dff-a56afb4fe83a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-47gcs" Jul 15 22:37:38.470689 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.470683 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6gpm\" (UniqueName: \"kubernetes.io/projected/c8498d97-f79e-4a43-9dff-a56afb4fe83a-kube-api-access-x6gpm\") pod \"cert-manager-webhook-6486ffd997-47gcs\" (UID: \"c8498d97-f79e-4a43-9dff-a56afb4fe83a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-47gcs" Jul 15 22:37:38.543210 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.543184 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq"] Jul 15 22:37:38.545280 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:37:38.545251 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8ff286a_dfb0_49fb_a232_d6d7e7d59d6f.slice/crio-0cd6d84d5913c890b132e31048555951e80e1ab392c193e4f80b8efe96cd1a37 WatchSource:0}: Error finding container 0cd6d84d5913c890b132e31048555951e80e1ab392c193e4f80b8efe96cd1a37: Status 404 returned error can't find the container with id 0cd6d84d5913c890b132e31048555951e80e1ab392c193e4f80b8efe96cd1a37 Jul 15 22:37:38.566565 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.566542 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-47gcs" Jul 15 22:37:38.704879 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:38.704824 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-47gcs"] Jul 15 22:37:38.710706 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:37:38.710678 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8498d97_f79e_4a43_9dff_a56afb4fe83a.slice/crio-bb77c8edb2d1b56db6327ed4994d4692d6d6aa70eb64a81730b4047932224c90 WatchSource:0}: Error finding container bb77c8edb2d1b56db6327ed4994d4692d6d6aa70eb64a81730b4047932224c90: Status 404 returned error can't find the container with id bb77c8edb2d1b56db6327ed4994d4692d6d6aa70eb64a81730b4047932224c90 Jul 15 22:37:39.118717 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:39.118679 2560 generic.go:356] "Generic (PLEG): container finished" podID="d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f" containerID="cfac05dcfd75095fb34c9dad8ea511bb3aacb7feebe1ca69e95a634e30623ac7" exitCode=0 Jul 15 22:37:39.118893 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:39.118738 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq" event={"ID":"d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f","Type":"ContainerDied","Data":"cfac05dcfd75095fb34c9dad8ea511bb3aacb7feebe1ca69e95a634e30623ac7"} Jul 15 22:37:39.118893 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:39.118791 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq" event={"ID":"d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f","Type":"ContainerStarted","Data":"0cd6d84d5913c890b132e31048555951e80e1ab392c193e4f80b8efe96cd1a37"} Jul 15 22:37:39.120114 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:39.120087 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-47gcs" event={"ID":"c8498d97-f79e-4a43-9dff-a56afb4fe83a","Type":"ContainerStarted","Data":"bb77c8edb2d1b56db6327ed4994d4692d6d6aa70eb64a81730b4047932224c90"} Jul 15 22:37:43.142040 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:43.142009 2560 generic.go:356] "Generic (PLEG): container finished" podID="d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f" containerID="debddff8f45765b006d87d2100f3cbdf9f2138b5f93928ab58232363cb90c210" exitCode=0 Jul 15 22:37:43.142468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:43.142095 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq" event={"ID":"d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f","Type":"ContainerDied","Data":"debddff8f45765b006d87d2100f3cbdf9f2138b5f93928ab58232363cb90c210"} Jul 15 22:37:43.143727 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:43.143703 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-47gcs" event={"ID":"c8498d97-f79e-4a43-9dff-a56afb4fe83a","Type":"ContainerStarted","Data":"c594b394a6f09b71952cb277b0fa403965fdf3ad09bf6eaa3ee96e01c863cc72"} Jul 15 22:37:43.143898 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:43.143878 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-47gcs" Jul 15 22:37:43.174918 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:43.174876 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-47gcs" podStartSLOduration=1.6256642829999999 podStartE2EDuration="5.17483789s" totalImagesPullingTime="3.549173607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:37:43.174128099 +0000 UTC m=+272.881925691" watchObservedRunningTime="2026-07-15 22:37:43.17483789 +0000 UTC m=+272.882635482" Jul 15 22:37:44.150028 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:44.149993 2560 generic.go:356] "Generic (PLEG): container finished" podID="d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f" containerID="e7517fd3bc29a52fcea0dc9f0ae7cca25b9c2a32f1d57d316a362c0d129d3fd1" exitCode=0 Jul 15 22:37:44.150454 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:44.150075 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq" event={"ID":"d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f","Type":"ContainerDied","Data":"e7517fd3bc29a52fcea0dc9f0ae7cca25b9c2a32f1d57d316a362c0d129d3fd1"} Jul 15 22:37:45.283766 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:45.283739 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq" Jul 15 22:37:45.425029 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:45.425003 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f-bundle\") pod \"d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f\" (UID: \"d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f\") " Jul 15 22:37:45.425179 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:45.425059 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f-util\") pod \"d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f\" (UID: \"d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f\") " Jul 15 22:37:45.425179 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:45.425091 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzhvm\" (UniqueName: \"kubernetes.io/projected/d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f-kube-api-access-hzhvm\") pod \"d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f\" (UID: \"d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f\") " Jul 15 22:37:45.425477 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:45.425441 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f-bundle" (OuterVolumeSpecName: "bundle") pod "d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f" (UID: "d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:37:45.427328 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:45.427304 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f-kube-api-access-hzhvm" (OuterVolumeSpecName: "kube-api-access-hzhvm") pod "d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f" (UID: "d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f"). InnerVolumeSpecName "kube-api-access-hzhvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:37:45.429488 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:45.429465 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f-util" (OuterVolumeSpecName: "util") pod "d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f" (UID: "d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:37:45.525804 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:45.525778 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f-bundle\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:37:45.525804 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:45.525800 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f-util\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:37:45.525962 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:45.525810 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzhvm\" (UniqueName: \"kubernetes.io/projected/d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f-kube-api-access-hzhvm\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:37:46.160157 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:46.160118 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq" event={"ID":"d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f","Type":"ContainerDied","Data":"0cd6d84d5913c890b132e31048555951e80e1ab392c193e4f80b8efe96cd1a37"} Jul 15 22:37:46.160157 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:46.160155 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffwjbq" Jul 15 22:37:46.160157 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:46.160166 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0cd6d84d5913c890b132e31048555951e80e1ab392c193e4f80b8efe96cd1a37" Jul 15 22:37:49.152798 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:37:49.152764 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-47gcs" Jul 15 22:38:01.097358 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:01.097323 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs"] Jul 15 22:38:01.097782 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:01.097581 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f" containerName="extract" Jul 15 22:38:01.097782 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:01.097592 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f" containerName="extract" Jul 15 22:38:01.097782 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:01.097608 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f" containerName="pull" Jul 15 22:38:01.097782 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:01.097613 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f" containerName="pull" Jul 15 22:38:01.097782 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:01.097626 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f" containerName="util" Jul 15 22:38:01.097782 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:01.097631 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f" containerName="util" Jul 15 22:38:01.097782 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:01.097676 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8ff286a-dfb0-49fb-a232-d6d7e7d59d6f" containerName="extract" Jul 15 22:38:01.101139 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:01.101119 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs" Jul 15 22:38:01.103373 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:01.103350 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 22:38:01.103373 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:01.103365 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 22:38:01.103976 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:01.103961 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s4mf4\"" Jul 15 22:38:01.109045 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:01.109024 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs"] Jul 15 22:38:01.254013 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:01.253981 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/077ca52d-8365-4389-85ea-12ae550bc67a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs\" (UID: \"077ca52d-8365-4389-85ea-12ae550bc67a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs" Jul 15 22:38:01.254158 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:01.254030 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2ds6\" (UniqueName: \"kubernetes.io/projected/077ca52d-8365-4389-85ea-12ae550bc67a-kube-api-access-z2ds6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs\" (UID: \"077ca52d-8365-4389-85ea-12ae550bc67a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs" Jul 15 22:38:01.254158 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:01.254099 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/077ca52d-8365-4389-85ea-12ae550bc67a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs\" (UID: \"077ca52d-8365-4389-85ea-12ae550bc67a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs" Jul 15 22:38:01.354771 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:01.354707 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/077ca52d-8365-4389-85ea-12ae550bc67a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs\" (UID: \"077ca52d-8365-4389-85ea-12ae550bc67a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs" Jul 15 22:38:01.354771 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:01.354759 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/077ca52d-8365-4389-85ea-12ae550bc67a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs\" (UID: \"077ca52d-8365-4389-85ea-12ae550bc67a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs" Jul 15 22:38:01.354937 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:01.354789 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2ds6\" (UniqueName: \"kubernetes.io/projected/077ca52d-8365-4389-85ea-12ae550bc67a-kube-api-access-z2ds6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs\" (UID: \"077ca52d-8365-4389-85ea-12ae550bc67a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs" Jul 15 22:38:01.355175 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:01.355152 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/077ca52d-8365-4389-85ea-12ae550bc67a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs\" (UID: \"077ca52d-8365-4389-85ea-12ae550bc67a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs" Jul 15 22:38:01.355210 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:01.355177 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/077ca52d-8365-4389-85ea-12ae550bc67a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs\" (UID: \"077ca52d-8365-4389-85ea-12ae550bc67a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs" Jul 15 22:38:01.364058 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:01.364031 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2ds6\" (UniqueName: \"kubernetes.io/projected/077ca52d-8365-4389-85ea-12ae550bc67a-kube-api-access-z2ds6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs\" (UID: \"077ca52d-8365-4389-85ea-12ae550bc67a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs" Jul 15 22:38:01.411405 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:01.411382 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs" Jul 15 22:38:01.545512 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:01.545467 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs"] Jul 15 22:38:01.547475 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:38:01.547444 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod077ca52d_8365_4389_85ea_12ae550bc67a.slice/crio-b1c47f26c7abb0a1f145af62d970a25514cdc947cf37a6334d81104b63a6cf42 WatchSource:0}: Error finding container b1c47f26c7abb0a1f145af62d970a25514cdc947cf37a6334d81104b63a6cf42: Status 404 returned error can't find the container with id b1c47f26c7abb0a1f145af62d970a25514cdc947cf37a6334d81104b63a6cf42 Jul 15 22:38:02.232914 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:02.232881 2560 generic.go:356] "Generic (PLEG): container finished" podID="077ca52d-8365-4389-85ea-12ae550bc67a" containerID="d789958e160631e39e209bd05d07f3dbdb1cb9b2aadbfe53085375647d8dd7cf" exitCode=0 Jul 15 22:38:02.233270 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:02.233021 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs" event={"ID":"077ca52d-8365-4389-85ea-12ae550bc67a","Type":"ContainerDied","Data":"d789958e160631e39e209bd05d07f3dbdb1cb9b2aadbfe53085375647d8dd7cf"} Jul 15 22:38:02.233270 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:02.233069 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs" event={"ID":"077ca52d-8365-4389-85ea-12ae550bc67a","Type":"ContainerStarted","Data":"b1c47f26c7abb0a1f145af62d970a25514cdc947cf37a6334d81104b63a6cf42"} Jul 15 22:38:03.239262 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:03.239229 2560 generic.go:356] "Generic (PLEG): container finished" podID="077ca52d-8365-4389-85ea-12ae550bc67a" containerID="65ab42844da26e20b5ebf530967f9a95bafb66d3181be52f23396312b7d455d5" exitCode=0 Jul 15 22:38:03.239621 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:03.239286 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs" event={"ID":"077ca52d-8365-4389-85ea-12ae550bc67a","Type":"ContainerDied","Data":"65ab42844da26e20b5ebf530967f9a95bafb66d3181be52f23396312b7d455d5"} Jul 15 22:38:04.245921 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:04.245887 2560 generic.go:356] "Generic (PLEG): container finished" podID="077ca52d-8365-4389-85ea-12ae550bc67a" containerID="08a296a06284094132d8a57a84b547bb772177d8a69e9faa9f3ca13f3f81e5b9" exitCode=0 Jul 15 22:38:04.246285 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:04.245977 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs" event={"ID":"077ca52d-8365-4389-85ea-12ae550bc67a","Type":"ContainerDied","Data":"08a296a06284094132d8a57a84b547bb772177d8a69e9faa9f3ca13f3f81e5b9"} Jul 15 22:38:05.377246 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:05.377216 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs" Jul 15 22:38:05.489088 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:05.489060 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/077ca52d-8365-4389-85ea-12ae550bc67a-bundle\") pod \"077ca52d-8365-4389-85ea-12ae550bc67a\" (UID: \"077ca52d-8365-4389-85ea-12ae550bc67a\") " Jul 15 22:38:05.489237 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:05.489142 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/077ca52d-8365-4389-85ea-12ae550bc67a-util\") pod \"077ca52d-8365-4389-85ea-12ae550bc67a\" (UID: \"077ca52d-8365-4389-85ea-12ae550bc67a\") " Jul 15 22:38:05.489237 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:05.489184 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2ds6\" (UniqueName: \"kubernetes.io/projected/077ca52d-8365-4389-85ea-12ae550bc67a-kube-api-access-z2ds6\") pod \"077ca52d-8365-4389-85ea-12ae550bc67a\" (UID: \"077ca52d-8365-4389-85ea-12ae550bc67a\") " Jul 15 22:38:05.489753 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:05.489715 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/077ca52d-8365-4389-85ea-12ae550bc67a-bundle" (OuterVolumeSpecName: "bundle") pod "077ca52d-8365-4389-85ea-12ae550bc67a" (UID: "077ca52d-8365-4389-85ea-12ae550bc67a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:38:05.491372 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:05.491350 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/077ca52d-8365-4389-85ea-12ae550bc67a-kube-api-access-z2ds6" (OuterVolumeSpecName: "kube-api-access-z2ds6") pod "077ca52d-8365-4389-85ea-12ae550bc67a" (UID: "077ca52d-8365-4389-85ea-12ae550bc67a"). InnerVolumeSpecName "kube-api-access-z2ds6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:38:05.497745 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:05.497719 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/077ca52d-8365-4389-85ea-12ae550bc67a-util" (OuterVolumeSpecName: "util") pod "077ca52d-8365-4389-85ea-12ae550bc67a" (UID: "077ca52d-8365-4389-85ea-12ae550bc67a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:38:05.590544 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:05.590482 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/077ca52d-8365-4389-85ea-12ae550bc67a-util\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:38:05.590544 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:05.590513 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2ds6\" (UniqueName: \"kubernetes.io/projected/077ca52d-8365-4389-85ea-12ae550bc67a-kube-api-access-z2ds6\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:38:05.590544 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:05.590524 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/077ca52d-8365-4389-85ea-12ae550bc67a-bundle\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:38:06.260042 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:06.260018 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs" Jul 15 22:38:06.260042 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:06.260031 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzmfvs" event={"ID":"077ca52d-8365-4389-85ea-12ae550bc67a","Type":"ContainerDied","Data":"b1c47f26c7abb0a1f145af62d970a25514cdc947cf37a6334d81104b63a6cf42"} Jul 15 22:38:06.260243 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:06.260072 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1c47f26c7abb0a1f145af62d970a25514cdc947cf37a6334d81104b63a6cf42" Jul 15 22:38:10.720171 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:10.720138 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5q8kf_d57dc934-8cdc-4f82-8ee8-527f9cc60a41/console-operator/1.log" Jul 15 22:38:10.725148 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:10.725124 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/ovn-acl-logging/0.log" Jul 15 22:38:10.726297 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:10.726276 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5q8kf_d57dc934-8cdc-4f82-8ee8-527f9cc60a41/console-operator/1.log" Jul 15 22:38:10.730831 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:10.730809 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/ovn-acl-logging/0.log" Jul 15 22:38:10.731475 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:10.731457 2560 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 22:38:13.751712 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.751681 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cf7bf55db-gl6gk"] Jul 15 22:38:13.754146 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.751974 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="077ca52d-8365-4389-85ea-12ae550bc67a" containerName="pull" Jul 15 22:38:13.754146 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.751985 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="077ca52d-8365-4389-85ea-12ae550bc67a" containerName="pull" Jul 15 22:38:13.754146 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.751993 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="077ca52d-8365-4389-85ea-12ae550bc67a" containerName="util" Jul 15 22:38:13.754146 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.751998 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="077ca52d-8365-4389-85ea-12ae550bc67a" containerName="util" Jul 15 22:38:13.754146 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.752015 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="077ca52d-8365-4389-85ea-12ae550bc67a" containerName="extract" Jul 15 22:38:13.754146 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.752020 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="077ca52d-8365-4389-85ea-12ae550bc67a" containerName="extract" Jul 15 22:38:13.754146 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.752086 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="077ca52d-8365-4389-85ea-12ae550bc67a" containerName="extract" Jul 15 22:38:13.755044 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.755028 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-gl6gk" Jul 15 22:38:13.759207 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.759188 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 15 22:38:13.760057 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.760038 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 15 22:38:13.760141 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.760065 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 15 22:38:13.760357 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.760339 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 15 22:38:13.763008 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.762986 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zhsgl\"" Jul 15 22:38:13.763008 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.763004 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 15 22:38:13.823953 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.823928 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cf7bf55db-gl6gk"] Jul 15 22:38:13.852185 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.852157 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7dc3722-9db7-4478-97db-5f5763140b16-metrics-cert\") pod \"lws-controller-manager-5cf7bf55db-gl6gk\" (UID: \"e7dc3722-9db7-4478-97db-5f5763140b16\") " pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-gl6gk" Jul 15 22:38:13.852311 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.852211 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7dc3722-9db7-4478-97db-5f5763140b16-cert\") pod \"lws-controller-manager-5cf7bf55db-gl6gk\" (UID: \"e7dc3722-9db7-4478-97db-5f5763140b16\") " pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-gl6gk" Jul 15 22:38:13.852311 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.852229 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqb4t\" (UniqueName: \"kubernetes.io/projected/e7dc3722-9db7-4478-97db-5f5763140b16-kube-api-access-fqb4t\") pod \"lws-controller-manager-5cf7bf55db-gl6gk\" (UID: \"e7dc3722-9db7-4478-97db-5f5763140b16\") " pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-gl6gk" Jul 15 22:38:13.852311 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.852286 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e7dc3722-9db7-4478-97db-5f5763140b16-manager-config\") pod \"lws-controller-manager-5cf7bf55db-gl6gk\" (UID: \"e7dc3722-9db7-4478-97db-5f5763140b16\") " pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-gl6gk" Jul 15 22:38:13.953426 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.953378 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7dc3722-9db7-4478-97db-5f5763140b16-cert\") pod \"lws-controller-manager-5cf7bf55db-gl6gk\" (UID: \"e7dc3722-9db7-4478-97db-5f5763140b16\") " pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-gl6gk" Jul 15 22:38:13.953426 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.953430 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqb4t\" (UniqueName: \"kubernetes.io/projected/e7dc3722-9db7-4478-97db-5f5763140b16-kube-api-access-fqb4t\") pod \"lws-controller-manager-5cf7bf55db-gl6gk\" (UID: \"e7dc3722-9db7-4478-97db-5f5763140b16\") " pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-gl6gk" Jul 15 22:38:13.953702 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.953480 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e7dc3722-9db7-4478-97db-5f5763140b16-manager-config\") pod \"lws-controller-manager-5cf7bf55db-gl6gk\" (UID: \"e7dc3722-9db7-4478-97db-5f5763140b16\") " pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-gl6gk" Jul 15 22:38:13.953702 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.953539 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7dc3722-9db7-4478-97db-5f5763140b16-metrics-cert\") pod \"lws-controller-manager-5cf7bf55db-gl6gk\" (UID: \"e7dc3722-9db7-4478-97db-5f5763140b16\") " pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-gl6gk" Jul 15 22:38:13.954150 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.954129 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e7dc3722-9db7-4478-97db-5f5763140b16-manager-config\") pod \"lws-controller-manager-5cf7bf55db-gl6gk\" (UID: \"e7dc3722-9db7-4478-97db-5f5763140b16\") " pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-gl6gk" Jul 15 22:38:13.955947 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.955927 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7dc3722-9db7-4478-97db-5f5763140b16-cert\") pod \"lws-controller-manager-5cf7bf55db-gl6gk\" (UID: \"e7dc3722-9db7-4478-97db-5f5763140b16\") " pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-gl6gk" Jul 15 22:38:13.956017 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.955967 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7dc3722-9db7-4478-97db-5f5763140b16-metrics-cert\") pod \"lws-controller-manager-5cf7bf55db-gl6gk\" (UID: \"e7dc3722-9db7-4478-97db-5f5763140b16\") " pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-gl6gk" Jul 15 22:38:13.970254 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:13.970231 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqb4t\" (UniqueName: \"kubernetes.io/projected/e7dc3722-9db7-4478-97db-5f5763140b16-kube-api-access-fqb4t\") pod \"lws-controller-manager-5cf7bf55db-gl6gk\" (UID: \"e7dc3722-9db7-4478-97db-5f5763140b16\") " pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-gl6gk" Jul 15 22:38:14.064366 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:14.064303 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-gl6gk" Jul 15 22:38:14.238678 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:14.238556 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cf7bf55db-gl6gk"] Jul 15 22:38:14.241131 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:38:14.241104 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7dc3722_9db7_4478_97db_5f5763140b16.slice/crio-c277c4c6280a0c9c34b6c098cf04587c8dc2a21629b549bc3604b3c72066f54c WatchSource:0}: Error finding container c277c4c6280a0c9c34b6c098cf04587c8dc2a21629b549bc3604b3c72066f54c: Status 404 returned error can't find the container with id c277c4c6280a0c9c34b6c098cf04587c8dc2a21629b549bc3604b3c72066f54c Jul 15 22:38:14.242940 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:14.242925 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 22:38:14.293313 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:14.293289 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-gl6gk" event={"ID":"e7dc3722-9db7-4478-97db-5f5763140b16","Type":"ContainerStarted","Data":"c277c4c6280a0c9c34b6c098cf04587c8dc2a21629b549bc3604b3c72066f54c"} Jul 15 22:38:16.308417 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:16.308374 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-gl6gk" event={"ID":"e7dc3722-9db7-4478-97db-5f5763140b16","Type":"ContainerStarted","Data":"52354e07db0eb03f0f44a3df25d0aa10c73a17540045f4226239b76ff5462d83"} Jul 15 22:38:16.308763 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:16.308470 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-gl6gk" Jul 15 22:38:16.325196 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:16.325153 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-gl6gk" podStartSLOduration=1.478101779 podStartE2EDuration="3.325138429s" totalImagesPullingTime="1.84703665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:38:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:38:16.323767113 +0000 UTC m=+306.031564707" watchObservedRunningTime="2026-07-15 22:38:16.325138429 +0000 UTC m=+306.032936021" Jul 15 22:38:17.921442 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:17.921411 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49"] Jul 15 22:38:17.923822 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:17.923804 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49" Jul 15 22:38:17.927916 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:17.927890 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 22:38:17.928260 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:17.928243 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vzbsj\"" Jul 15 22:38:17.928334 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:17.928311 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 22:38:17.928398 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:17.928378 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 22:38:17.928671 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:17.928658 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 22:38:17.951468 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:17.951445 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49"] Jul 15 22:38:17.986457 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:17.986429 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kls5\" (UniqueName: \"kubernetes.io/projected/769689a2-3327-4fee-8cc4-e2315eb39c97-kube-api-access-9kls5\") pod \"opendatahub-operator-controller-manager-7db6597b7c-2kg49\" (UID: \"769689a2-3327-4fee-8cc4-e2315eb39c97\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49" Jul 15 22:38:17.986561 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:17.986471 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/769689a2-3327-4fee-8cc4-e2315eb39c97-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7db6597b7c-2kg49\" (UID: \"769689a2-3327-4fee-8cc4-e2315eb39c97\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49" Jul 15 22:38:17.986561 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:17.986507 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/769689a2-3327-4fee-8cc4-e2315eb39c97-manifests\") pod \"opendatahub-operator-controller-manager-7db6597b7c-2kg49\" (UID: \"769689a2-3327-4fee-8cc4-e2315eb39c97\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49" Jul 15 22:38:17.986561 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:17.986532 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/769689a2-3327-4fee-8cc4-e2315eb39c97-webhook-cert\") pod \"opendatahub-operator-controller-manager-7db6597b7c-2kg49\" (UID: \"769689a2-3327-4fee-8cc4-e2315eb39c97\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49" Jul 15 22:38:17.986673 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:17.986574 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/769689a2-3327-4fee-8cc4-e2315eb39c97-tmp\") pod \"opendatahub-operator-controller-manager-7db6597b7c-2kg49\" (UID: \"769689a2-3327-4fee-8cc4-e2315eb39c97\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49" Jul 15 22:38:18.087823 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:18.087778 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kls5\" (UniqueName: \"kubernetes.io/projected/769689a2-3327-4fee-8cc4-e2315eb39c97-kube-api-access-9kls5\") pod \"opendatahub-operator-controller-manager-7db6597b7c-2kg49\" (UID: \"769689a2-3327-4fee-8cc4-e2315eb39c97\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49" Jul 15 22:38:18.087952 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:18.087837 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/769689a2-3327-4fee-8cc4-e2315eb39c97-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7db6597b7c-2kg49\" (UID: \"769689a2-3327-4fee-8cc4-e2315eb39c97\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49" Jul 15 22:38:18.087952 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:18.087879 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/769689a2-3327-4fee-8cc4-e2315eb39c97-manifests\") pod \"opendatahub-operator-controller-manager-7db6597b7c-2kg49\" (UID: \"769689a2-3327-4fee-8cc4-e2315eb39c97\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49" Jul 15 22:38:18.087952 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:18.087894 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/769689a2-3327-4fee-8cc4-e2315eb39c97-webhook-cert\") pod \"opendatahub-operator-controller-manager-7db6597b7c-2kg49\" (UID: \"769689a2-3327-4fee-8cc4-e2315eb39c97\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49" Jul 15 22:38:18.087952 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:18.087931 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/769689a2-3327-4fee-8cc4-e2315eb39c97-tmp\") pod \"opendatahub-operator-controller-manager-7db6597b7c-2kg49\" (UID: \"769689a2-3327-4fee-8cc4-e2315eb39c97\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49" Jul 15 22:38:18.088285 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:18.088267 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/769689a2-3327-4fee-8cc4-e2315eb39c97-manifests\") pod \"opendatahub-operator-controller-manager-7db6597b7c-2kg49\" (UID: \"769689a2-3327-4fee-8cc4-e2315eb39c97\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49" Jul 15 22:38:18.090309 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:18.090286 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/769689a2-3327-4fee-8cc4-e2315eb39c97-tmp\") pod \"opendatahub-operator-controller-manager-7db6597b7c-2kg49\" (UID: \"769689a2-3327-4fee-8cc4-e2315eb39c97\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49" Jul 15 22:38:18.090519 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:18.090502 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/769689a2-3327-4fee-8cc4-e2315eb39c97-webhook-cert\") pod \"opendatahub-operator-controller-manager-7db6597b7c-2kg49\" (UID: \"769689a2-3327-4fee-8cc4-e2315eb39c97\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49" Jul 15 22:38:18.090677 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:18.090658 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/769689a2-3327-4fee-8cc4-e2315eb39c97-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7db6597b7c-2kg49\" (UID: \"769689a2-3327-4fee-8cc4-e2315eb39c97\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49" Jul 15 22:38:18.096432 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:18.096413 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kls5\" (UniqueName: \"kubernetes.io/projected/769689a2-3327-4fee-8cc4-e2315eb39c97-kube-api-access-9kls5\") pod \"opendatahub-operator-controller-manager-7db6597b7c-2kg49\" (UID: \"769689a2-3327-4fee-8cc4-e2315eb39c97\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49" Jul 15 22:38:18.233887 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:18.233794 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49" Jul 15 22:38:18.370716 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:18.370692 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49"] Jul 15 22:38:18.372726 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:38:18.372696 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod769689a2_3327_4fee_8cc4_e2315eb39c97.slice/crio-25296ac6f1083bbc9cf3264b54fd5e257c3a4ce3f177bba506868672fe25a282 WatchSource:0}: Error finding container 25296ac6f1083bbc9cf3264b54fd5e257c3a4ce3f177bba506868672fe25a282: Status 404 returned error can't find the container with id 25296ac6f1083bbc9cf3264b54fd5e257c3a4ce3f177bba506868672fe25a282 Jul 15 22:38:19.327694 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:19.327656 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49" event={"ID":"769689a2-3327-4fee-8cc4-e2315eb39c97","Type":"ContainerStarted","Data":"25296ac6f1083bbc9cf3264b54fd5e257c3a4ce3f177bba506868672fe25a282"} Jul 15 22:38:22.343070 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:22.343027 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49" event={"ID":"769689a2-3327-4fee-8cc4-e2315eb39c97","Type":"ContainerStarted","Data":"9816189d60366f79cc6098ff7a168af1a3372be69c4d12524b6613945bb1a36c"} Jul 15 22:38:23.349025 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:23.348992 2560 generic.go:356] "Generic (PLEG): container finished" podID="769689a2-3327-4fee-8cc4-e2315eb39c97" containerID="9816189d60366f79cc6098ff7a168af1a3372be69c4d12524b6613945bb1a36c" exitCode=0 Jul 15 22:38:23.349025 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:23.349028 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49" event={"ID":"769689a2-3327-4fee-8cc4-e2315eb39c97","Type":"ContainerDied","Data":"9816189d60366f79cc6098ff7a168af1a3372be69c4d12524b6613945bb1a36c"} Jul 15 22:38:24.356374 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:24.356341 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49" event={"ID":"769689a2-3327-4fee-8cc4-e2315eb39c97","Type":"ContainerStarted","Data":"a6a808d100dc46ab70f6f2a6e9a82acfd01d32603ad3b662f8337a2efdb97a7d"} Jul 15 22:38:24.356739 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:24.356410 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49" Jul 15 22:38:24.384252 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:24.384206 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49" podStartSLOduration=3.034596518 podStartE2EDuration="7.384192005s" totalImagesPullingTime="3.271630548s" totalInitContainerRuntime="1.077964939s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:38:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:38:24.382057154 +0000 UTC m=+314.089854745" watchObservedRunningTime="2026-07-15 22:38:24.384192005 +0000 UTC m=+314.091989597" Jul 15 22:38:27.315076 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:27.315044 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-gl6gk" Jul 15 22:38:35.369038 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:35.369003 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-2kg49" Jul 15 22:38:45.755159 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:45.755124 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn"] Jul 15 22:38:45.759505 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:45.759488 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:45.761768 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:45.761738 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-b758k\"" Jul 15 22:38:45.762049 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:45.762032 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 15 22:38:45.784931 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:45.784908 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn"] Jul 15 22:38:45.909801 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:45.909766 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg9c4\" (UniqueName: \"kubernetes.io/projected/7b953d31-cbb1-44e8-99bd-4d41029dd395-kube-api-access-mg9c4\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:45.909801 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:45.909802 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b953d31-cbb1-44e8-99bd-4d41029dd395-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:45.909999 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:45.909819 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b953d31-cbb1-44e8-99bd-4d41029dd395-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:45.909999 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:45.909835 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b953d31-cbb1-44e8-99bd-4d41029dd395-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:45.909999 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:45.909931 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b953d31-cbb1-44e8-99bd-4d41029dd395-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:45.909999 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:45.909977 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b953d31-cbb1-44e8-99bd-4d41029dd395-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:45.910171 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:45.910032 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b953d31-cbb1-44e8-99bd-4d41029dd395-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:45.910171 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:45.910060 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b953d31-cbb1-44e8-99bd-4d41029dd395-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:45.910171 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:45.910144 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b953d31-cbb1-44e8-99bd-4d41029dd395-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:46.011126 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:46.011054 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b953d31-cbb1-44e8-99bd-4d41029dd395-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:46.011126 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:46.011096 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b953d31-cbb1-44e8-99bd-4d41029dd395-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:46.011126 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:46.011119 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b953d31-cbb1-44e8-99bd-4d41029dd395-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:46.011353 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:46.011144 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b953d31-cbb1-44e8-99bd-4d41029dd395-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:46.011353 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:46.011169 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg9c4\" (UniqueName: \"kubernetes.io/projected/7b953d31-cbb1-44e8-99bd-4d41029dd395-kube-api-access-mg9c4\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:46.011353 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:46.011191 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b953d31-cbb1-44e8-99bd-4d41029dd395-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:46.011353 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:46.011206 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b953d31-cbb1-44e8-99bd-4d41029dd395-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:46.011353 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:46.011223 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b953d31-cbb1-44e8-99bd-4d41029dd395-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:46.011353 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:46.011256 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b953d31-cbb1-44e8-99bd-4d41029dd395-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:46.011641 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:46.011620 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b953d31-cbb1-44e8-99bd-4d41029dd395-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:46.011699 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:46.011677 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b953d31-cbb1-44e8-99bd-4d41029dd395-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:46.011740 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:46.011717 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b953d31-cbb1-44e8-99bd-4d41029dd395-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:46.011928 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:46.011899 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b953d31-cbb1-44e8-99bd-4d41029dd395-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:46.012025 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:46.011930 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b953d31-cbb1-44e8-99bd-4d41029dd395-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:46.013828 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:46.013805 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b953d31-cbb1-44e8-99bd-4d41029dd395-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:46.014041 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:46.014018 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b953d31-cbb1-44e8-99bd-4d41029dd395-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:46.019236 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:46.019215 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b953d31-cbb1-44e8-99bd-4d41029dd395-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:46.020941 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:46.020914 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg9c4\" (UniqueName: \"kubernetes.io/projected/7b953d31-cbb1-44e8-99bd-4d41029dd395-kube-api-access-mg9c4\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c8dfn\" (UID: \"7b953d31-cbb1-44e8-99bd-4d41029dd395\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:46.069810 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:46.069787 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:46.216838 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:46.216811 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn"] Jul 15 22:38:46.218506 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:38:46.218479 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b953d31_cbb1_44e8_99bd_4d41029dd395.slice/crio-5be036c564a7f1c7d66dfe9fc0671458bcbb1582e536c6d6d0cfe7b4220410ea WatchSource:0}: Error finding container 5be036c564a7f1c7d66dfe9fc0671458bcbb1582e536c6d6d0cfe7b4220410ea: Status 404 returned error can't find the container with id 5be036c564a7f1c7d66dfe9fc0671458bcbb1582e536c6d6d0cfe7b4220410ea Jul 15 22:38:46.456045 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:46.456008 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" event={"ID":"7b953d31-cbb1-44e8-99bd-4d41029dd395","Type":"ContainerStarted","Data":"5be036c564a7f1c7d66dfe9fc0671458bcbb1582e536c6d6d0cfe7b4220410ea"} Jul 15 22:38:47.936114 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:47.936078 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz"] Jul 15 22:38:47.941717 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:47.941697 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:47.944384 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:47.944197 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 15 22:38:47.944384 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:47.944247 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 15 22:38:47.944384 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:47.944300 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 15 22:38:47.944384 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:47.944305 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gf6g9\"" Jul 15 22:38:47.955678 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:47.955656 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz"] Jul 15 22:38:48.031157 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.031127 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f600a088-10a7-4e79-a519-8a3a18839563-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-8g8bz\" (UID: \"f600a088-10a7-4e79-a519-8a3a18839563\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:48.031340 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.031179 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f600a088-10a7-4e79-a519-8a3a18839563-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-8g8bz\" (UID: \"f600a088-10a7-4e79-a519-8a3a18839563\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:48.031340 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.031233 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f600a088-10a7-4e79-a519-8a3a18839563-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-8g8bz\" (UID: \"f600a088-10a7-4e79-a519-8a3a18839563\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:48.031340 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.031268 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f600a088-10a7-4e79-a519-8a3a18839563-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-8g8bz\" (UID: \"f600a088-10a7-4e79-a519-8a3a18839563\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:48.031505 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.031401 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lwvm\" (UniqueName: \"kubernetes.io/projected/f600a088-10a7-4e79-a519-8a3a18839563-kube-api-access-7lwvm\") pod \"istiod-openshift-gateway-94bb8fbfd-8g8bz\" (UID: \"f600a088-10a7-4e79-a519-8a3a18839563\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:48.031505 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.031450 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f600a088-10a7-4e79-a519-8a3a18839563-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-8g8bz\" (UID: \"f600a088-10a7-4e79-a519-8a3a18839563\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:48.031505 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.031491 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f600a088-10a7-4e79-a519-8a3a18839563-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-8g8bz\" (UID: \"f600a088-10a7-4e79-a519-8a3a18839563\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:48.132299 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.132262 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f600a088-10a7-4e79-a519-8a3a18839563-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-8g8bz\" (UID: \"f600a088-10a7-4e79-a519-8a3a18839563\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:48.132478 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.132315 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f600a088-10a7-4e79-a519-8a3a18839563-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-8g8bz\" (UID: \"f600a088-10a7-4e79-a519-8a3a18839563\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:48.132478 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.132343 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f600a088-10a7-4e79-a519-8a3a18839563-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-8g8bz\" (UID: \"f600a088-10a7-4e79-a519-8a3a18839563\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:48.132478 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.132395 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f600a088-10a7-4e79-a519-8a3a18839563-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-8g8bz\" (UID: \"f600a088-10a7-4e79-a519-8a3a18839563\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:48.132478 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.132430 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f600a088-10a7-4e79-a519-8a3a18839563-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-8g8bz\" (UID: \"f600a088-10a7-4e79-a519-8a3a18839563\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:48.132478 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.132475 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f600a088-10a7-4e79-a519-8a3a18839563-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-8g8bz\" (UID: \"f600a088-10a7-4e79-a519-8a3a18839563\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:48.132734 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.132534 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lwvm\" (UniqueName: \"kubernetes.io/projected/f600a088-10a7-4e79-a519-8a3a18839563-kube-api-access-7lwvm\") pod \"istiod-openshift-gateway-94bb8fbfd-8g8bz\" (UID: \"f600a088-10a7-4e79-a519-8a3a18839563\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:48.133622 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.133566 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f600a088-10a7-4e79-a519-8a3a18839563-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-8g8bz\" (UID: \"f600a088-10a7-4e79-a519-8a3a18839563\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:48.135325 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.135302 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f600a088-10a7-4e79-a519-8a3a18839563-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-8g8bz\" (UID: \"f600a088-10a7-4e79-a519-8a3a18839563\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:48.135678 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.135658 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f600a088-10a7-4e79-a519-8a3a18839563-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-8g8bz\" (UID: \"f600a088-10a7-4e79-a519-8a3a18839563\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:48.135749 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.135679 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f600a088-10a7-4e79-a519-8a3a18839563-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-8g8bz\" (UID: \"f600a088-10a7-4e79-a519-8a3a18839563\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:48.135749 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.135687 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f600a088-10a7-4e79-a519-8a3a18839563-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-8g8bz\" (UID: \"f600a088-10a7-4e79-a519-8a3a18839563\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:48.144196 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.144169 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f600a088-10a7-4e79-a519-8a3a18839563-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-8g8bz\" (UID: \"f600a088-10a7-4e79-a519-8a3a18839563\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:48.144490 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.144466 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lwvm\" (UniqueName: \"kubernetes.io/projected/f600a088-10a7-4e79-a519-8a3a18839563-kube-api-access-7lwvm\") pod \"istiod-openshift-gateway-94bb8fbfd-8g8bz\" (UID: \"f600a088-10a7-4e79-a519-8a3a18839563\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:48.252988 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.252908 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:48.739341 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.739295 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 22:38:48.739471 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.739387 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 22:38:48.739471 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.739421 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 22:38:48.826793 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:48.826762 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz"] Jul 15 22:38:48.828789 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:38:48.828761 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf600a088_10a7_4e79_a519_8a3a18839563.slice/crio-58f32675efbd41fc166d5bc58bec42ddd41f9cb8fb383eb81498870192c00a3b WatchSource:0}: Error finding container 58f32675efbd41fc166d5bc58bec42ddd41f9cb8fb383eb81498870192c00a3b: Status 404 returned error can't find the container with id 58f32675efbd41fc166d5bc58bec42ddd41f9cb8fb383eb81498870192c00a3b Jul 15 22:38:49.474065 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:49.474030 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" event={"ID":"f600a088-10a7-4e79-a519-8a3a18839563","Type":"ContainerStarted","Data":"58f32675efbd41fc166d5bc58bec42ddd41f9cb8fb383eb81498870192c00a3b"} Jul 15 22:38:49.475634 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:49.475607 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" event={"ID":"7b953d31-cbb1-44e8-99bd-4d41029dd395","Type":"ContainerStarted","Data":"e497bb06cc2430e6e0da360de9076f8c90ece382b7f218f941a8f1cead093943"} Jul 15 22:38:49.537059 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:49.537011 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" podStartSLOduration=2.018539358 podStartE2EDuration="4.536995169s" totalImagesPullingTime="2.518455811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:38:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:38:49.535537076 +0000 UTC m=+339.243334671" watchObservedRunningTime="2026-07-15 22:38:49.536995169 +0000 UTC m=+339.244792761" Jul 15 22:38:50.070237 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:50.070199 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:50.075514 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:50.075482 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:50.481250 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:50.481219 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:50.482422 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:50.482396 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c8dfn" Jul 15 22:38:51.240799 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:51.240764 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 22:38:51.240895 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:51.240836 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 22:38:51.487318 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:51.487274 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" event={"ID":"f600a088-10a7-4e79-a519-8a3a18839563","Type":"ContainerStarted","Data":"68e0955a54d8524f59ff034cea5e6607e950dff95e5ba700c0149c01327798de"} Jul 15 22:38:52.491947 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:52.491913 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:52.493274 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:52.493251 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" Jul 15 22:38:52.520935 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:38:52.520879 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8g8bz" podStartSLOduration=3.111658856 podStartE2EDuration="5.520844863s" totalImagesPullingTime="2.409186007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:38:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:38:51.555177448 +0000 UTC m=+341.262975042" watchObservedRunningTime="2026-07-15 22:38:52.520844863 +0000 UTC m=+342.228642456" Jul 15 22:39:55.095050 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.095019 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl"] Jul 15 22:39:55.098357 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.098338 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl" Jul 15 22:39:55.100620 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.100599 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 22:39:55.100721 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.100691 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 22:39:55.101315 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.101299 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dm9m6\"" Jul 15 22:39:55.106939 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.106916 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl"] Jul 15 22:39:55.166567 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.166543 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nm86\" (UniqueName: \"kubernetes.io/projected/9ea01b42-fb4e-46fa-a95e-4fe3b2a52453-kube-api-access-9nm86\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl\" (UID: \"9ea01b42-fb4e-46fa-a95e-4fe3b2a52453\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl" Jul 15 22:39:55.166698 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.166585 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ea01b42-fb4e-46fa-a95e-4fe3b2a52453-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl\" (UID: \"9ea01b42-fb4e-46fa-a95e-4fe3b2a52453\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl" Jul 15 22:39:55.166698 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.166661 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ea01b42-fb4e-46fa-a95e-4fe3b2a52453-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl\" (UID: \"9ea01b42-fb4e-46fa-a95e-4fe3b2a52453\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl" Jul 15 22:39:55.267492 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.267462 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ea01b42-fb4e-46fa-a95e-4fe3b2a52453-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl\" (UID: \"9ea01b42-fb4e-46fa-a95e-4fe3b2a52453\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl" Jul 15 22:39:55.267706 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.267525 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nm86\" (UniqueName: \"kubernetes.io/projected/9ea01b42-fb4e-46fa-a95e-4fe3b2a52453-kube-api-access-9nm86\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl\" (UID: \"9ea01b42-fb4e-46fa-a95e-4fe3b2a52453\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl" Jul 15 22:39:55.267706 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.267558 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ea01b42-fb4e-46fa-a95e-4fe3b2a52453-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl\" (UID: \"9ea01b42-fb4e-46fa-a95e-4fe3b2a52453\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl" Jul 15 22:39:55.267931 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.267909 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ea01b42-fb4e-46fa-a95e-4fe3b2a52453-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl\" (UID: \"9ea01b42-fb4e-46fa-a95e-4fe3b2a52453\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl" Jul 15 22:39:55.267998 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.267937 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ea01b42-fb4e-46fa-a95e-4fe3b2a52453-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl\" (UID: \"9ea01b42-fb4e-46fa-a95e-4fe3b2a52453\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl" Jul 15 22:39:55.276269 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.276248 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nm86\" (UniqueName: \"kubernetes.io/projected/9ea01b42-fb4e-46fa-a95e-4fe3b2a52453-kube-api-access-9nm86\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl\" (UID: \"9ea01b42-fb4e-46fa-a95e-4fe3b2a52453\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl" Jul 15 22:39:55.408350 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.408295 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl" Jul 15 22:39:55.490180 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.490151 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l"] Jul 15 22:39:55.493794 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.493774 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l" Jul 15 22:39:55.503790 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.503770 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l"] Jul 15 22:39:55.556456 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.556430 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl"] Jul 15 22:39:55.558552 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:39:55.558527 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ea01b42_fb4e_46fa_a95e_4fe3b2a52453.slice/crio-87be1e78430ac155174b2c4db560074a4459397bf3c4c401b3887037ce98dde0 WatchSource:0}: Error finding container 87be1e78430ac155174b2c4db560074a4459397bf3c4c401b3887037ce98dde0: Status 404 returned error can't find the container with id 87be1e78430ac155174b2c4db560074a4459397bf3c4c401b3887037ce98dde0 Jul 15 22:39:55.571022 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.571001 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e2dd678-b2be-494b-bc03-77515a86e1e3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l\" (UID: \"8e2dd678-b2be-494b-bc03-77515a86e1e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l" Jul 15 22:39:55.571119 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.571033 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbll4\" (UniqueName: \"kubernetes.io/projected/8e2dd678-b2be-494b-bc03-77515a86e1e3-kube-api-access-cbll4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l\" (UID: \"8e2dd678-b2be-494b-bc03-77515a86e1e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l" Jul 15 22:39:55.571119 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.571084 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e2dd678-b2be-494b-bc03-77515a86e1e3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l\" (UID: \"8e2dd678-b2be-494b-bc03-77515a86e1e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l" Jul 15 22:39:55.672379 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.672352 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e2dd678-b2be-494b-bc03-77515a86e1e3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l\" (UID: \"8e2dd678-b2be-494b-bc03-77515a86e1e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l" Jul 15 22:39:55.672502 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.672390 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbll4\" (UniqueName: \"kubernetes.io/projected/8e2dd678-b2be-494b-bc03-77515a86e1e3-kube-api-access-cbll4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l\" (UID: \"8e2dd678-b2be-494b-bc03-77515a86e1e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l" Jul 15 22:39:55.672605 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.672582 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e2dd678-b2be-494b-bc03-77515a86e1e3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l\" (UID: \"8e2dd678-b2be-494b-bc03-77515a86e1e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l" Jul 15 22:39:55.672756 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.672739 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e2dd678-b2be-494b-bc03-77515a86e1e3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l\" (UID: \"8e2dd678-b2be-494b-bc03-77515a86e1e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l" Jul 15 22:39:55.672905 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.672889 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e2dd678-b2be-494b-bc03-77515a86e1e3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l\" (UID: \"8e2dd678-b2be-494b-bc03-77515a86e1e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l" Jul 15 22:39:55.681713 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.681694 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbll4\" (UniqueName: \"kubernetes.io/projected/8e2dd678-b2be-494b-bc03-77515a86e1e3-kube-api-access-cbll4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l\" (UID: \"8e2dd678-b2be-494b-bc03-77515a86e1e3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l" Jul 15 22:39:55.783754 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.783721 2560 generic.go:356] "Generic (PLEG): container finished" podID="9ea01b42-fb4e-46fa-a95e-4fe3b2a52453" containerID="701a13e6899d3df3dc81a13fc0529d41c165e87b0e7ca3eff353a9c836d9c207" exitCode=0 Jul 15 22:39:55.783904 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.783813 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl" event={"ID":"9ea01b42-fb4e-46fa-a95e-4fe3b2a52453","Type":"ContainerDied","Data":"701a13e6899d3df3dc81a13fc0529d41c165e87b0e7ca3eff353a9c836d9c207"} Jul 15 22:39:55.783904 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.783875 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl" event={"ID":"9ea01b42-fb4e-46fa-a95e-4fe3b2a52453","Type":"ContainerStarted","Data":"87be1e78430ac155174b2c4db560074a4459397bf3c4c401b3887037ce98dde0"} Jul 15 22:39:55.803727 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.803704 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l" Jul 15 22:39:55.897952 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.897926 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs"] Jul 15 22:39:55.902187 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.902166 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs" Jul 15 22:39:55.909703 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.909678 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs"] Jul 15 22:39:55.936110 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.936087 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l"] Jul 15 22:39:55.938896 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:39:55.938867 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e2dd678_b2be_494b_bc03_77515a86e1e3.slice/crio-5f9e4cded0063869e0690697d67cd2309d0042c49da6d0084bcaf7f4adf8f037 WatchSource:0}: Error finding container 5f9e4cded0063869e0690697d67cd2309d0042c49da6d0084bcaf7f4adf8f037: Status 404 returned error can't find the container with id 5f9e4cded0063869e0690697d67cd2309d0042c49da6d0084bcaf7f4adf8f037 Jul 15 22:39:55.975810 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.975791 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2aa1654d-ba81-40a7-a2ba-cd59d28b751e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs\" (UID: \"2aa1654d-ba81-40a7-a2ba-cd59d28b751e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs" Jul 15 22:39:55.975932 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.975823 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2aa1654d-ba81-40a7-a2ba-cd59d28b751e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs\" (UID: \"2aa1654d-ba81-40a7-a2ba-cd59d28b751e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs" Jul 15 22:39:55.975932 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:55.975876 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfb5k\" (UniqueName: \"kubernetes.io/projected/2aa1654d-ba81-40a7-a2ba-cd59d28b751e-kube-api-access-bfb5k\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs\" (UID: \"2aa1654d-ba81-40a7-a2ba-cd59d28b751e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs" Jul 15 22:39:56.077250 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.077219 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2aa1654d-ba81-40a7-a2ba-cd59d28b751e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs\" (UID: \"2aa1654d-ba81-40a7-a2ba-cd59d28b751e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs" Jul 15 22:39:56.077350 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.077259 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2aa1654d-ba81-40a7-a2ba-cd59d28b751e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs\" (UID: \"2aa1654d-ba81-40a7-a2ba-cd59d28b751e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs" Jul 15 22:39:56.077413 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.077390 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfb5k\" (UniqueName: \"kubernetes.io/projected/2aa1654d-ba81-40a7-a2ba-cd59d28b751e-kube-api-access-bfb5k\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs\" (UID: \"2aa1654d-ba81-40a7-a2ba-cd59d28b751e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs" Jul 15 22:39:56.077552 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.077537 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2aa1654d-ba81-40a7-a2ba-cd59d28b751e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs\" (UID: \"2aa1654d-ba81-40a7-a2ba-cd59d28b751e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs" Jul 15 22:39:56.077592 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.077577 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2aa1654d-ba81-40a7-a2ba-cd59d28b751e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs\" (UID: \"2aa1654d-ba81-40a7-a2ba-cd59d28b751e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs" Jul 15 22:39:56.085882 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.085825 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfb5k\" (UniqueName: \"kubernetes.io/projected/2aa1654d-ba81-40a7-a2ba-cd59d28b751e-kube-api-access-bfb5k\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs\" (UID: \"2aa1654d-ba81-40a7-a2ba-cd59d28b751e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs" Jul 15 22:39:56.216000 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.215974 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs" Jul 15 22:39:56.289163 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.289137 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg"] Jul 15 22:39:56.292700 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.292682 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg" Jul 15 22:39:56.301605 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.300245 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg"] Jul 15 22:39:56.352907 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.352882 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs"] Jul 15 22:39:56.354865 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:39:56.354826 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aa1654d_ba81_40a7_a2ba_cd59d28b751e.slice/crio-8167e3ee03c3bb6963ec881f011af38f3fcf7b9395947fd9657240d00eeb726c WatchSource:0}: Error finding container 8167e3ee03c3bb6963ec881f011af38f3fcf7b9395947fd9657240d00eeb726c: Status 404 returned error can't find the container with id 8167e3ee03c3bb6963ec881f011af38f3fcf7b9395947fd9657240d00eeb726c Jul 15 22:39:56.379801 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.379769 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50199233-8839-4d21-a9bd-e30c547381fe-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg\" (UID: \"50199233-8839-4d21-a9bd-e30c547381fe\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg" Jul 15 22:39:56.379959 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.379818 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50199233-8839-4d21-a9bd-e30c547381fe-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg\" (UID: \"50199233-8839-4d21-a9bd-e30c547381fe\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg" Jul 15 22:39:56.380014 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.379968 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9k89\" (UniqueName: \"kubernetes.io/projected/50199233-8839-4d21-a9bd-e30c547381fe-kube-api-access-w9k89\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg\" (UID: \"50199233-8839-4d21-a9bd-e30c547381fe\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg" Jul 15 22:39:56.481162 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.481139 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50199233-8839-4d21-a9bd-e30c547381fe-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg\" (UID: \"50199233-8839-4d21-a9bd-e30c547381fe\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg" Jul 15 22:39:56.481234 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.481187 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50199233-8839-4d21-a9bd-e30c547381fe-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg\" (UID: \"50199233-8839-4d21-a9bd-e30c547381fe\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg" Jul 15 22:39:56.481273 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.481262 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9k89\" (UniqueName: \"kubernetes.io/projected/50199233-8839-4d21-a9bd-e30c547381fe-kube-api-access-w9k89\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg\" (UID: \"50199233-8839-4d21-a9bd-e30c547381fe\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg" Jul 15 22:39:56.481540 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.481519 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50199233-8839-4d21-a9bd-e30c547381fe-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg\" (UID: \"50199233-8839-4d21-a9bd-e30c547381fe\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg" Jul 15 22:39:56.481579 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.481562 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50199233-8839-4d21-a9bd-e30c547381fe-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg\" (UID: \"50199233-8839-4d21-a9bd-e30c547381fe\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg" Jul 15 22:39:56.488591 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.488566 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9k89\" (UniqueName: \"kubernetes.io/projected/50199233-8839-4d21-a9bd-e30c547381fe-kube-api-access-w9k89\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg\" (UID: \"50199233-8839-4d21-a9bd-e30c547381fe\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg" Jul 15 22:39:56.604436 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.604412 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg" Jul 15 22:39:56.732890 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.732809 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg"] Jul 15 22:39:56.736346 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:39:56.736321 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50199233_8839_4d21_a9bd_e30c547381fe.slice/crio-b9f81c64eb6496147ba51213a8db9d4494745a47ce54eece16644d27bebebad3 WatchSource:0}: Error finding container b9f81c64eb6496147ba51213a8db9d4494745a47ce54eece16644d27bebebad3: Status 404 returned error can't find the container with id b9f81c64eb6496147ba51213a8db9d4494745a47ce54eece16644d27bebebad3 Jul 15 22:39:56.793052 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.793023 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg" event={"ID":"50199233-8839-4d21-a9bd-e30c547381fe","Type":"ContainerStarted","Data":"b9f81c64eb6496147ba51213a8db9d4494745a47ce54eece16644d27bebebad3"} Jul 15 22:39:56.794410 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.794388 2560 generic.go:356] "Generic (PLEG): container finished" podID="8e2dd678-b2be-494b-bc03-77515a86e1e3" containerID="fda0d8407c35fdf2def7fdf60029936c845e26d4635592f63c5c7b03d96651f1" exitCode=0 Jul 15 22:39:56.794513 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.794472 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l" event={"ID":"8e2dd678-b2be-494b-bc03-77515a86e1e3","Type":"ContainerDied","Data":"fda0d8407c35fdf2def7fdf60029936c845e26d4635592f63c5c7b03d96651f1"} Jul 15 22:39:56.794579 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.794518 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l" event={"ID":"8e2dd678-b2be-494b-bc03-77515a86e1e3","Type":"ContainerStarted","Data":"5f9e4cded0063869e0690697d67cd2309d0042c49da6d0084bcaf7f4adf8f037"} Jul 15 22:39:56.796282 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.796255 2560 generic.go:356] "Generic (PLEG): container finished" podID="9ea01b42-fb4e-46fa-a95e-4fe3b2a52453" containerID="ebbbb9b31d7f18fea68cb4fc42345064f58c80cd2593fa0b72f31e598facb5e4" exitCode=0 Jul 15 22:39:56.796372 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.796331 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl" event={"ID":"9ea01b42-fb4e-46fa-a95e-4fe3b2a52453","Type":"ContainerDied","Data":"ebbbb9b31d7f18fea68cb4fc42345064f58c80cd2593fa0b72f31e598facb5e4"} Jul 15 22:39:56.798497 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.798475 2560 generic.go:356] "Generic (PLEG): container finished" podID="2aa1654d-ba81-40a7-a2ba-cd59d28b751e" containerID="b9a4c258ac3ce48f578dd48db1b395bcfa4903ae862883f481836bdabe582fc0" exitCode=0 Jul 15 22:39:56.798611 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.798527 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs" event={"ID":"2aa1654d-ba81-40a7-a2ba-cd59d28b751e","Type":"ContainerDied","Data":"b9a4c258ac3ce48f578dd48db1b395bcfa4903ae862883f481836bdabe582fc0"} Jul 15 22:39:56.798611 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:56.798560 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs" event={"ID":"2aa1654d-ba81-40a7-a2ba-cd59d28b751e","Type":"ContainerStarted","Data":"8167e3ee03c3bb6963ec881f011af38f3fcf7b9395947fd9657240d00eeb726c"} Jul 15 22:39:57.804892 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:57.804796 2560 generic.go:356] "Generic (PLEG): container finished" podID="50199233-8839-4d21-a9bd-e30c547381fe" containerID="728cb675fb6c751a24b28deaa8f80ec3b3e9bf90d2a789efddd76d55822d4480" exitCode=0 Jul 15 22:39:57.805263 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:57.804883 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg" event={"ID":"50199233-8839-4d21-a9bd-e30c547381fe","Type":"ContainerDied","Data":"728cb675fb6c751a24b28deaa8f80ec3b3e9bf90d2a789efddd76d55822d4480"} Jul 15 22:39:57.806804 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:57.806779 2560 generic.go:356] "Generic (PLEG): container finished" podID="8e2dd678-b2be-494b-bc03-77515a86e1e3" containerID="b048bd65403bdf5e898836e3a08539416ecd0b33cb9b321bf15bdad14fd1011e" exitCode=0 Jul 15 22:39:57.806928 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:57.806873 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l" event={"ID":"8e2dd678-b2be-494b-bc03-77515a86e1e3","Type":"ContainerDied","Data":"b048bd65403bdf5e898836e3a08539416ecd0b33cb9b321bf15bdad14fd1011e"} Jul 15 22:39:57.809282 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:57.809257 2560 generic.go:356] "Generic (PLEG): container finished" podID="9ea01b42-fb4e-46fa-a95e-4fe3b2a52453" containerID="087b4fcba6a6e49d46a4c8dfcb6a945c3ed911bddc23bf0de72be3607975d6ca" exitCode=0 Jul 15 22:39:57.809366 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:57.809343 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl" event={"ID":"9ea01b42-fb4e-46fa-a95e-4fe3b2a52453","Type":"ContainerDied","Data":"087b4fcba6a6e49d46a4c8dfcb6a945c3ed911bddc23bf0de72be3607975d6ca"} Jul 15 22:39:57.811271 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:57.811237 2560 generic.go:356] "Generic (PLEG): container finished" podID="2aa1654d-ba81-40a7-a2ba-cd59d28b751e" containerID="7167506e2f21aed26829e40b593fabfac710719aca44cd112d1cbbd9054f222b" exitCode=0 Jul 15 22:39:57.811351 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:57.811291 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs" event={"ID":"2aa1654d-ba81-40a7-a2ba-cd59d28b751e","Type":"ContainerDied","Data":"7167506e2f21aed26829e40b593fabfac710719aca44cd112d1cbbd9054f222b"} Jul 15 22:39:58.817763 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:58.817734 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg" event={"ID":"50199233-8839-4d21-a9bd-e30c547381fe","Type":"ContainerStarted","Data":"d0d7972d03718b6acba9aac5fbf548f60b537b165deabe4806443d08c68fb6f9"} Jul 15 22:39:58.820011 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:58.819986 2560 generic.go:356] "Generic (PLEG): container finished" podID="8e2dd678-b2be-494b-bc03-77515a86e1e3" containerID="c81d9b313c0dd5db008f1ec0f24604bdb1ce44aba9c40e64d544257d9197a34c" exitCode=0 Jul 15 22:39:58.820109 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:58.820067 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l" event={"ID":"8e2dd678-b2be-494b-bc03-77515a86e1e3","Type":"ContainerDied","Data":"c81d9b313c0dd5db008f1ec0f24604bdb1ce44aba9c40e64d544257d9197a34c"} Jul 15 22:39:58.822423 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:58.822404 2560 generic.go:356] "Generic (PLEG): container finished" podID="2aa1654d-ba81-40a7-a2ba-cd59d28b751e" containerID="48c15415cdccdca7ac3672efb67a00f2751d06ac7324930e47cf25db544a8c01" exitCode=0 Jul 15 22:39:58.822503 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:58.822484 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs" event={"ID":"2aa1654d-ba81-40a7-a2ba-cd59d28b751e","Type":"ContainerDied","Data":"48c15415cdccdca7ac3672efb67a00f2751d06ac7324930e47cf25db544a8c01"} Jul 15 22:39:58.951197 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:58.951175 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl" Jul 15 22:39:59.007706 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:59.007628 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ea01b42-fb4e-46fa-a95e-4fe3b2a52453-bundle\") pod \"9ea01b42-fb4e-46fa-a95e-4fe3b2a52453\" (UID: \"9ea01b42-fb4e-46fa-a95e-4fe3b2a52453\") " Jul 15 22:39:59.007706 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:59.007702 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ea01b42-fb4e-46fa-a95e-4fe3b2a52453-util\") pod \"9ea01b42-fb4e-46fa-a95e-4fe3b2a52453\" (UID: \"9ea01b42-fb4e-46fa-a95e-4fe3b2a52453\") " Jul 15 22:39:59.007890 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:59.007737 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nm86\" (UniqueName: \"kubernetes.io/projected/9ea01b42-fb4e-46fa-a95e-4fe3b2a52453-kube-api-access-9nm86\") pod \"9ea01b42-fb4e-46fa-a95e-4fe3b2a52453\" (UID: \"9ea01b42-fb4e-46fa-a95e-4fe3b2a52453\") " Jul 15 22:39:59.008325 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:59.008299 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ea01b42-fb4e-46fa-a95e-4fe3b2a52453-bundle" (OuterVolumeSpecName: "bundle") pod "9ea01b42-fb4e-46fa-a95e-4fe3b2a52453" (UID: "9ea01b42-fb4e-46fa-a95e-4fe3b2a52453"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:39:59.010119 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:59.010100 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ea01b42-fb4e-46fa-a95e-4fe3b2a52453-kube-api-access-9nm86" (OuterVolumeSpecName: "kube-api-access-9nm86") pod "9ea01b42-fb4e-46fa-a95e-4fe3b2a52453" (UID: "9ea01b42-fb4e-46fa-a95e-4fe3b2a52453"). InnerVolumeSpecName "kube-api-access-9nm86". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:39:59.013101 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:59.013082 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ea01b42-fb4e-46fa-a95e-4fe3b2a52453-util" (OuterVolumeSpecName: "util") pod "9ea01b42-fb4e-46fa-a95e-4fe3b2a52453" (UID: "9ea01b42-fb4e-46fa-a95e-4fe3b2a52453"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:39:59.109219 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:59.109195 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nm86\" (UniqueName: \"kubernetes.io/projected/9ea01b42-fb4e-46fa-a95e-4fe3b2a52453-kube-api-access-9nm86\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:39:59.109219 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:59.109217 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ea01b42-fb4e-46fa-a95e-4fe3b2a52453-bundle\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:39:59.109355 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:59.109227 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ea01b42-fb4e-46fa-a95e-4fe3b2a52453-util\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:39:59.829409 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:59.829378 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl" Jul 15 22:39:59.829803 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:59.829413 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl" event={"ID":"9ea01b42-fb4e-46fa-a95e-4fe3b2a52453","Type":"ContainerDied","Data":"87be1e78430ac155174b2c4db560074a4459397bf3c4c401b3887037ce98dde0"} Jul 15 22:39:59.829803 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:59.829459 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87be1e78430ac155174b2c4db560074a4459397bf3c4c401b3887037ce98dde0" Jul 15 22:39:59.831227 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:59.831197 2560 generic.go:356] "Generic (PLEG): container finished" podID="50199233-8839-4d21-a9bd-e30c547381fe" containerID="d0d7972d03718b6acba9aac5fbf548f60b537b165deabe4806443d08c68fb6f9" exitCode=0 Jul 15 22:39:59.831330 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:39:59.831283 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg" event={"ID":"50199233-8839-4d21-a9bd-e30c547381fe","Type":"ContainerDied","Data":"d0d7972d03718b6acba9aac5fbf548f60b537b165deabe4806443d08c68fb6f9"} Jul 15 22:40:00.030383 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.030357 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs" Jul 15 22:40:00.033210 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.033194 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l" Jul 15 22:40:00.117715 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.117645 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e2dd678-b2be-494b-bc03-77515a86e1e3-bundle\") pod \"8e2dd678-b2be-494b-bc03-77515a86e1e3\" (UID: \"8e2dd678-b2be-494b-bc03-77515a86e1e3\") " Jul 15 22:40:00.117715 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.117681 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2aa1654d-ba81-40a7-a2ba-cd59d28b751e-bundle\") pod \"2aa1654d-ba81-40a7-a2ba-cd59d28b751e\" (UID: \"2aa1654d-ba81-40a7-a2ba-cd59d28b751e\") " Jul 15 22:40:00.117892 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.117726 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e2dd678-b2be-494b-bc03-77515a86e1e3-util\") pod \"8e2dd678-b2be-494b-bc03-77515a86e1e3\" (UID: \"8e2dd678-b2be-494b-bc03-77515a86e1e3\") " Jul 15 22:40:00.117892 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.117759 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbll4\" (UniqueName: \"kubernetes.io/projected/8e2dd678-b2be-494b-bc03-77515a86e1e3-kube-api-access-cbll4\") pod \"8e2dd678-b2be-494b-bc03-77515a86e1e3\" (UID: \"8e2dd678-b2be-494b-bc03-77515a86e1e3\") " Jul 15 22:40:00.117892 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.117779 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2aa1654d-ba81-40a7-a2ba-cd59d28b751e-util\") pod \"2aa1654d-ba81-40a7-a2ba-cd59d28b751e\" (UID: \"2aa1654d-ba81-40a7-a2ba-cd59d28b751e\") " Jul 15 22:40:00.117892 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.117885 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfb5k\" (UniqueName: \"kubernetes.io/projected/2aa1654d-ba81-40a7-a2ba-cd59d28b751e-kube-api-access-bfb5k\") pod \"2aa1654d-ba81-40a7-a2ba-cd59d28b751e\" (UID: \"2aa1654d-ba81-40a7-a2ba-cd59d28b751e\") " Jul 15 22:40:00.118326 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.118286 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aa1654d-ba81-40a7-a2ba-cd59d28b751e-bundle" (OuterVolumeSpecName: "bundle") pod "2aa1654d-ba81-40a7-a2ba-cd59d28b751e" (UID: "2aa1654d-ba81-40a7-a2ba-cd59d28b751e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:40:00.118326 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.118322 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e2dd678-b2be-494b-bc03-77515a86e1e3-bundle" (OuterVolumeSpecName: "bundle") pod "8e2dd678-b2be-494b-bc03-77515a86e1e3" (UID: "8e2dd678-b2be-494b-bc03-77515a86e1e3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:40:00.120014 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.119990 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e2dd678-b2be-494b-bc03-77515a86e1e3-kube-api-access-cbll4" (OuterVolumeSpecName: "kube-api-access-cbll4") pod "8e2dd678-b2be-494b-bc03-77515a86e1e3" (UID: "8e2dd678-b2be-494b-bc03-77515a86e1e3"). InnerVolumeSpecName "kube-api-access-cbll4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:40:00.120190 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.120171 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2aa1654d-ba81-40a7-a2ba-cd59d28b751e-kube-api-access-bfb5k" (OuterVolumeSpecName: "kube-api-access-bfb5k") pod "2aa1654d-ba81-40a7-a2ba-cd59d28b751e" (UID: "2aa1654d-ba81-40a7-a2ba-cd59d28b751e"). InnerVolumeSpecName "kube-api-access-bfb5k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:40:00.123704 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.123672 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aa1654d-ba81-40a7-a2ba-cd59d28b751e-util" (OuterVolumeSpecName: "util") pod "2aa1654d-ba81-40a7-a2ba-cd59d28b751e" (UID: "2aa1654d-ba81-40a7-a2ba-cd59d28b751e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:40:00.123821 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.123806 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e2dd678-b2be-494b-bc03-77515a86e1e3-util" (OuterVolumeSpecName: "util") pod "8e2dd678-b2be-494b-bc03-77515a86e1e3" (UID: "8e2dd678-b2be-494b-bc03-77515a86e1e3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:40:00.218796 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.218764 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfb5k\" (UniqueName: \"kubernetes.io/projected/2aa1654d-ba81-40a7-a2ba-cd59d28b751e-kube-api-access-bfb5k\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:40:00.218796 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.218790 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e2dd678-b2be-494b-bc03-77515a86e1e3-bundle\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:40:00.218796 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.218800 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2aa1654d-ba81-40a7-a2ba-cd59d28b751e-bundle\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:40:00.219011 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.218808 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e2dd678-b2be-494b-bc03-77515a86e1e3-util\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:40:00.219011 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.218816 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbll4\" (UniqueName: \"kubernetes.io/projected/8e2dd678-b2be-494b-bc03-77515a86e1e3-kube-api-access-cbll4\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:40:00.219011 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.218825 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2aa1654d-ba81-40a7-a2ba-cd59d28b751e-util\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:40:00.838716 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.838687 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l" Jul 15 22:40:00.840296 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.840275 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs" Jul 15 22:40:00.841794 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.841751 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l" event={"ID":"8e2dd678-b2be-494b-bc03-77515a86e1e3","Type":"ContainerDied","Data":"5f9e4cded0063869e0690697d67cd2309d0042c49da6d0084bcaf7f4adf8f037"} Jul 15 22:40:00.841915 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.841803 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f9e4cded0063869e0690697d67cd2309d0042c49da6d0084bcaf7f4adf8f037" Jul 15 22:40:00.841915 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.841819 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs" event={"ID":"2aa1654d-ba81-40a7-a2ba-cd59d28b751e","Type":"ContainerDied","Data":"8167e3ee03c3bb6963ec881f011af38f3fcf7b9395947fd9657240d00eeb726c"} Jul 15 22:40:00.841915 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.841839 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8167e3ee03c3bb6963ec881f011af38f3fcf7b9395947fd9657240d00eeb726c" Jul 15 22:40:00.842718 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.842690 2560 generic.go:356] "Generic (PLEG): container finished" podID="50199233-8839-4d21-a9bd-e30c547381fe" containerID="0b9bb930893dd69b74a61c5c4b9e0a05b9d0cfe0d82c5908f0e6babd57a0c9bc" exitCode=0 Jul 15 22:40:00.842810 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:00.842743 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg" event={"ID":"50199233-8839-4d21-a9bd-e30c547381fe","Type":"ContainerDied","Data":"0b9bb930893dd69b74a61c5c4b9e0a05b9d0cfe0d82c5908f0e6babd57a0c9bc"} Jul 15 22:40:01.976214 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:01.976192 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg" Jul 15 22:40:02.033634 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:02.033608 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9k89\" (UniqueName: \"kubernetes.io/projected/50199233-8839-4d21-a9bd-e30c547381fe-kube-api-access-w9k89\") pod \"50199233-8839-4d21-a9bd-e30c547381fe\" (UID: \"50199233-8839-4d21-a9bd-e30c547381fe\") " Jul 15 22:40:02.033771 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:02.033645 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50199233-8839-4d21-a9bd-e30c547381fe-bundle\") pod \"50199233-8839-4d21-a9bd-e30c547381fe\" (UID: \"50199233-8839-4d21-a9bd-e30c547381fe\") " Jul 15 22:40:02.033771 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:02.033733 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50199233-8839-4d21-a9bd-e30c547381fe-util\") pod \"50199233-8839-4d21-a9bd-e30c547381fe\" (UID: \"50199233-8839-4d21-a9bd-e30c547381fe\") " Jul 15 22:40:02.034133 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:02.034113 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50199233-8839-4d21-a9bd-e30c547381fe-bundle" (OuterVolumeSpecName: "bundle") pod "50199233-8839-4d21-a9bd-e30c547381fe" (UID: "50199233-8839-4d21-a9bd-e30c547381fe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:40:02.035821 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:02.035795 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50199233-8839-4d21-a9bd-e30c547381fe-kube-api-access-w9k89" (OuterVolumeSpecName: "kube-api-access-w9k89") pod "50199233-8839-4d21-a9bd-e30c547381fe" (UID: "50199233-8839-4d21-a9bd-e30c547381fe"). InnerVolumeSpecName "kube-api-access-w9k89". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:40:02.074884 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:02.074845 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50199233-8839-4d21-a9bd-e30c547381fe-util" (OuterVolumeSpecName: "util") pod "50199233-8839-4d21-a9bd-e30c547381fe" (UID: "50199233-8839-4d21-a9bd-e30c547381fe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:40:02.134627 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:02.134563 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50199233-8839-4d21-a9bd-e30c547381fe-util\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:40:02.134627 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:02.134594 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9k89\" (UniqueName: \"kubernetes.io/projected/50199233-8839-4d21-a9bd-e30c547381fe-kube-api-access-w9k89\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:40:02.134627 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:02.134608 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50199233-8839-4d21-a9bd-e30c547381fe-bundle\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:40:02.853357 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:02.853324 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg" event={"ID":"50199233-8839-4d21-a9bd-e30c547381fe","Type":"ContainerDied","Data":"b9f81c64eb6496147ba51213a8db9d4494745a47ce54eece16644d27bebebad3"} Jul 15 22:40:02.853474 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:02.853375 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9f81c64eb6496147ba51213a8db9d4494745a47ce54eece16644d27bebebad3" Jul 15 22:40:02.853474 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:02.853343 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg" Jul 15 22:40:17.604037 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:17.603997 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54494dc84c-2ccr7"] Jul 15 22:40:30.852115 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:30.852078 2560 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","burstable","pod2aa1654d-ba81-40a7-a2ba-cd59d28b751e"] err="unable to destroy cgroup paths for cgroup [kubepods burstable pod2aa1654d-ba81-40a7-a2ba-cd59d28b751e] : Timed out while waiting for systemd to remove kubepods-burstable-pod2aa1654d_ba81_40a7_a2ba_cd59d28b751e.slice" Jul 15 22:40:30.852115 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:40:30.852114 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods burstable pod2aa1654d-ba81-40a7-a2ba-cd59d28b751e] : unable to destroy cgroup paths for cgroup [kubepods burstable pod2aa1654d-ba81-40a7-a2ba-cd59d28b751e] : Timed out while waiting for systemd to remove kubepods-burstable-pod2aa1654d_ba81_40a7_a2ba_cd59d28b751e.slice" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs" podUID="2aa1654d-ba81-40a7-a2ba-cd59d28b751e" Jul 15 22:40:30.988041 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:30.988008 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs" Jul 15 22:40:42.627646 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:42.627562 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54494dc84c-2ccr7" podUID="255eb49c-23c0-46dd-ade2-504dc0c8a5d6" containerName="console" containerID="cri-o://28cd823507c2236a0d68a92679544dbe08d9011c731862d1802e486707b821ed" gracePeriod=15 Jul 15 22:40:42.867340 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:42.867315 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:40:42.945167 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:42.945142 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-console-serving-cert\") pod \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " Jul 15 22:40:42.945315 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:42.945183 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98rbw\" (UniqueName: \"kubernetes.io/projected/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-kube-api-access-98rbw\") pod \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " Jul 15 22:40:42.945315 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:42.945201 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-oauth-serving-cert\") pod \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " Jul 15 22:40:42.945315 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:42.945221 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-console-config\") pod \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " Jul 15 22:40:42.945315 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:42.945279 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-trusted-ca-bundle\") pod \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " Jul 15 22:40:42.945315 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:42.945305 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-service-ca\") pod \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " Jul 15 22:40:42.945596 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:42.945326 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-console-oauth-config\") pod \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\" (UID: \"255eb49c-23c0-46dd-ade2-504dc0c8a5d6\") " Jul 15 22:40:42.945596 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:42.945540 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "255eb49c-23c0-46dd-ade2-504dc0c8a5d6" (UID: "255eb49c-23c0-46dd-ade2-504dc0c8a5d6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:40:42.945734 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:42.945702 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-console-config" (OuterVolumeSpecName: "console-config") pod "255eb49c-23c0-46dd-ade2-504dc0c8a5d6" (UID: "255eb49c-23c0-46dd-ade2-504dc0c8a5d6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:40:42.945781 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:42.945719 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "255eb49c-23c0-46dd-ade2-504dc0c8a5d6" (UID: "255eb49c-23c0-46dd-ade2-504dc0c8a5d6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:40:42.945781 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:42.945711 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-service-ca" (OuterVolumeSpecName: "service-ca") pod "255eb49c-23c0-46dd-ade2-504dc0c8a5d6" (UID: "255eb49c-23c0-46dd-ade2-504dc0c8a5d6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:40:42.947442 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:42.947419 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "255eb49c-23c0-46dd-ade2-504dc0c8a5d6" (UID: "255eb49c-23c0-46dd-ade2-504dc0c8a5d6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:40:42.947442 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:42.947432 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-kube-api-access-98rbw" (OuterVolumeSpecName: "kube-api-access-98rbw") pod "255eb49c-23c0-46dd-ade2-504dc0c8a5d6" (UID: "255eb49c-23c0-46dd-ade2-504dc0c8a5d6"). InnerVolumeSpecName "kube-api-access-98rbw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:40:42.947568 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:42.947512 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "255eb49c-23c0-46dd-ade2-504dc0c8a5d6" (UID: "255eb49c-23c0-46dd-ade2-504dc0c8a5d6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:40:43.045834 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:43.045813 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:40:43.045834 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:43.045832 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-console-oauth-config\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:40:43.045993 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:43.045842 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-console-serving-cert\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:40:43.045993 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:43.045871 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98rbw\" (UniqueName: \"kubernetes.io/projected/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-kube-api-access-98rbw\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:40:43.045993 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:43.045880 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-oauth-serving-cert\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:40:43.045993 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:43.045891 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-console-config\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:40:43.045993 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:43.045894 2560 generic.go:356] "Generic (PLEG): container finished" podID="255eb49c-23c0-46dd-ade2-504dc0c8a5d6" containerID="28cd823507c2236a0d68a92679544dbe08d9011c731862d1802e486707b821ed" exitCode=0 Jul 15 22:40:43.045993 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:43.045922 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54494dc84c-2ccr7" event={"ID":"255eb49c-23c0-46dd-ade2-504dc0c8a5d6","Type":"ContainerDied","Data":"28cd823507c2236a0d68a92679544dbe08d9011c731862d1802e486707b821ed"} Jul 15 22:40:43.045993 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:43.045946 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54494dc84c-2ccr7" Jul 15 22:40:43.045993 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:43.045970 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54494dc84c-2ccr7" event={"ID":"255eb49c-23c0-46dd-ade2-504dc0c8a5d6","Type":"ContainerDied","Data":"8fc41acb270c57067f90853ed63adae80889607e71f35ef0c30ce5e45305cdae"} Jul 15 22:40:43.046271 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:43.045998 2560 scope.go:117] "RemoveContainer" containerID="28cd823507c2236a0d68a92679544dbe08d9011c731862d1802e486707b821ed" Jul 15 22:40:43.046271 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:43.045904 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/255eb49c-23c0-46dd-ade2-504dc0c8a5d6-trusted-ca-bundle\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:40:43.055172 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:43.055152 2560 scope.go:117] "RemoveContainer" containerID="28cd823507c2236a0d68a92679544dbe08d9011c731862d1802e486707b821ed" Jul 15 22:40:43.055416 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:40:43.055398 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28cd823507c2236a0d68a92679544dbe08d9011c731862d1802e486707b821ed\": container with ID starting with 28cd823507c2236a0d68a92679544dbe08d9011c731862d1802e486707b821ed not found: ID does not exist" containerID="28cd823507c2236a0d68a92679544dbe08d9011c731862d1802e486707b821ed" Jul 15 22:40:43.055463 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:43.055424 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28cd823507c2236a0d68a92679544dbe08d9011c731862d1802e486707b821ed"} err="failed to get container status \"28cd823507c2236a0d68a92679544dbe08d9011c731862d1802e486707b821ed\": rpc error: code = NotFound desc = could not find container \"28cd823507c2236a0d68a92679544dbe08d9011c731862d1802e486707b821ed\": container with ID starting with 28cd823507c2236a0d68a92679544dbe08d9011c731862d1802e486707b821ed not found: ID does not exist" Jul 15 22:40:43.066727 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:43.066708 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54494dc84c-2ccr7"] Jul 15 22:40:43.071179 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:43.071160 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54494dc84c-2ccr7"] Jul 15 22:40:44.840000 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:40:44.839961 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="255eb49c-23c0-46dd-ade2-504dc0c8a5d6" path="/var/lib/kubelet/pods/255eb49c-23c0-46dd-ade2-504dc0c8a5d6/volumes" Jul 15 22:41:11.785734 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.785698 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7"] Jul 15 22:41:11.786136 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786062 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="255eb49c-23c0-46dd-ade2-504dc0c8a5d6" containerName="console" Jul 15 22:41:11.786136 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786074 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="255eb49c-23c0-46dd-ade2-504dc0c8a5d6" containerName="console" Jul 15 22:41:11.786136 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786082 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50199233-8839-4d21-a9bd-e30c547381fe" containerName="extract" Jul 15 22:41:11.786136 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786088 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="50199233-8839-4d21-a9bd-e30c547381fe" containerName="extract" Jul 15 22:41:11.786136 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786098 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e2dd678-b2be-494b-bc03-77515a86e1e3" containerName="util" Jul 15 22:41:11.786136 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786103 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e2dd678-b2be-494b-bc03-77515a86e1e3" containerName="util" Jul 15 22:41:11.786136 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786112 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50199233-8839-4d21-a9bd-e30c547381fe" containerName="util" Jul 15 22:41:11.786136 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786121 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="50199233-8839-4d21-a9bd-e30c547381fe" containerName="util" Jul 15 22:41:11.786136 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786130 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ea01b42-fb4e-46fa-a95e-4fe3b2a52453" containerName="pull" Jul 15 22:41:11.786136 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786135 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ea01b42-fb4e-46fa-a95e-4fe3b2a52453" containerName="pull" Jul 15 22:41:11.786136 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786142 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ea01b42-fb4e-46fa-a95e-4fe3b2a52453" containerName="util" Jul 15 22:41:11.786482 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786147 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ea01b42-fb4e-46fa-a95e-4fe3b2a52453" containerName="util" Jul 15 22:41:11.786482 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786153 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e2dd678-b2be-494b-bc03-77515a86e1e3" containerName="pull" Jul 15 22:41:11.786482 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786158 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e2dd678-b2be-494b-bc03-77515a86e1e3" containerName="pull" Jul 15 22:41:11.786482 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786164 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50199233-8839-4d21-a9bd-e30c547381fe" containerName="pull" Jul 15 22:41:11.786482 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786168 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="50199233-8839-4d21-a9bd-e30c547381fe" containerName="pull" Jul 15 22:41:11.786482 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786174 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2aa1654d-ba81-40a7-a2ba-cd59d28b751e" containerName="pull" Jul 15 22:41:11.786482 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786178 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aa1654d-ba81-40a7-a2ba-cd59d28b751e" containerName="pull" Jul 15 22:41:11.786482 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786185 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ea01b42-fb4e-46fa-a95e-4fe3b2a52453" containerName="extract" Jul 15 22:41:11.786482 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786192 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ea01b42-fb4e-46fa-a95e-4fe3b2a52453" containerName="extract" Jul 15 22:41:11.786482 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786202 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e2dd678-b2be-494b-bc03-77515a86e1e3" containerName="extract" Jul 15 22:41:11.786482 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786208 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e2dd678-b2be-494b-bc03-77515a86e1e3" containerName="extract" Jul 15 22:41:11.786482 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786215 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2aa1654d-ba81-40a7-a2ba-cd59d28b751e" containerName="extract" Jul 15 22:41:11.786482 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786220 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aa1654d-ba81-40a7-a2ba-cd59d28b751e" containerName="extract" Jul 15 22:41:11.786482 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786226 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2aa1654d-ba81-40a7-a2ba-cd59d28b751e" containerName="util" Jul 15 22:41:11.786482 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786231 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aa1654d-ba81-40a7-a2ba-cd59d28b751e" containerName="util" Jul 15 22:41:11.786482 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786284 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="50199233-8839-4d21-a9bd-e30c547381fe" containerName="extract" Jul 15 22:41:11.786482 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786293 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2aa1654d-ba81-40a7-a2ba-cd59d28b751e" containerName="extract" Jul 15 22:41:11.786482 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786298 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e2dd678-b2be-494b-bc03-77515a86e1e3" containerName="extract" Jul 15 22:41:11.786482 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786306 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="255eb49c-23c0-46dd-ade2-504dc0c8a5d6" containerName="console" Jul 15 22:41:11.786482 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.786312 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ea01b42-fb4e-46fa-a95e-4fe3b2a52453" containerName="extract" Jul 15 22:41:11.789484 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.789464 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.792598 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.792267 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-lctkw\"" Jul 15 22:41:11.801963 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.801939 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7"] Jul 15 22:41:11.869464 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.869432 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1048ac31-134e-427d-bb33-020f726ff1ca-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.869633 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.869468 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhj2l\" (UniqueName: \"kubernetes.io/projected/1048ac31-134e-427d-bb33-020f726ff1ca-kube-api-access-vhj2l\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.869633 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.869498 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1048ac31-134e-427d-bb33-020f726ff1ca-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.869633 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.869552 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1048ac31-134e-427d-bb33-020f726ff1ca-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.869633 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.869601 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1048ac31-134e-427d-bb33-020f726ff1ca-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.869633 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.869632 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1048ac31-134e-427d-bb33-020f726ff1ca-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.869916 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.869663 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1048ac31-134e-427d-bb33-020f726ff1ca-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.869916 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.869744 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1048ac31-134e-427d-bb33-020f726ff1ca-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.869916 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.869781 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1048ac31-134e-427d-bb33-020f726ff1ca-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.971052 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.971021 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1048ac31-134e-427d-bb33-020f726ff1ca-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.971052 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.971052 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhj2l\" (UniqueName: \"kubernetes.io/projected/1048ac31-134e-427d-bb33-020f726ff1ca-kube-api-access-vhj2l\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.971272 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.971084 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1048ac31-134e-427d-bb33-020f726ff1ca-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.971272 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.971103 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1048ac31-134e-427d-bb33-020f726ff1ca-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.971272 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.971126 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1048ac31-134e-427d-bb33-020f726ff1ca-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.971272 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.971149 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1048ac31-134e-427d-bb33-020f726ff1ca-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.971467 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.971270 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1048ac31-134e-427d-bb33-020f726ff1ca-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.971467 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.971319 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1048ac31-134e-427d-bb33-020f726ff1ca-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.971467 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.971349 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1048ac31-134e-427d-bb33-020f726ff1ca-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.971613 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.971547 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1048ac31-134e-427d-bb33-020f726ff1ca-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.971790 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.971754 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1048ac31-134e-427d-bb33-020f726ff1ca-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.972117 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.971836 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1048ac31-134e-427d-bb33-020f726ff1ca-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.972117 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.971783 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1048ac31-134e-427d-bb33-020f726ff1ca-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.972117 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.972107 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1048ac31-134e-427d-bb33-020f726ff1ca-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.973631 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.973604 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1048ac31-134e-427d-bb33-020f726ff1ca-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.973722 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.973655 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1048ac31-134e-427d-bb33-020f726ff1ca-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.979983 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.979960 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1048ac31-134e-427d-bb33-020f726ff1ca-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:11.980154 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:11.980135 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhj2l\" (UniqueName: \"kubernetes.io/projected/1048ac31-134e-427d-bb33-020f726ff1ca-kube-api-access-vhj2l\") pod \"maas-default-gateway-openshift-default-56654dcf7-r59t7\" (UID: \"1048ac31-134e-427d-bb33-020f726ff1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:12.103882 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:12.103786 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:12.255362 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:12.255332 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7"] Jul 15 22:41:12.256861 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:41:12.256816 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1048ac31_134e_427d_bb33_020f726ff1ca.slice/crio-151598bd7cf317a2710c6e947ae90402201201a2669c8579041cdf7747e9d3e2 WatchSource:0}: Error finding container 151598bd7cf317a2710c6e947ae90402201201a2669c8579041cdf7747e9d3e2: Status 404 returned error can't find the container with id 151598bd7cf317a2710c6e947ae90402201201a2669c8579041cdf7747e9d3e2 Jul 15 22:41:12.259335 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:12.259303 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 22:41:12.259403 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:12.259370 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 22:41:12.259403 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:12.259400 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 22:41:13.194115 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:13.194085 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" event={"ID":"1048ac31-134e-427d-bb33-020f726ff1ca","Type":"ContainerStarted","Data":"d2f932848577b9976bbbbfee696b927b4ed7addde564ddddd8ac7804d144d14d"} Jul 15 22:41:13.194505 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:13.194134 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" event={"ID":"1048ac31-134e-427d-bb33-020f726ff1ca","Type":"ContainerStarted","Data":"151598bd7cf317a2710c6e947ae90402201201a2669c8579041cdf7747e9d3e2"} Jul 15 22:41:13.214465 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:13.214412 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" podStartSLOduration=2.21437477 podStartE2EDuration="2.21437477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:41:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:41:13.21322059 +0000 UTC m=+482.921018177" watchObservedRunningTime="2026-07-15 22:41:13.21437477 +0000 UTC m=+482.922172363" Jul 15 22:41:14.104102 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:14.104071 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:14.109101 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:14.109079 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:14.199724 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:14.199690 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:41:14.200501 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:41:14.200484 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:42:37.626966 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:37.626874 2560 generic.go:356] "Generic (PLEG): container finished" podID="1048ac31-134e-427d-bb33-020f726ff1ca" containerID="d2f932848577b9976bbbbfee696b927b4ed7addde564ddddd8ac7804d144d14d" exitCode=0 Jul 15 22:42:37.626966 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:37.626940 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" event={"ID":"1048ac31-134e-427d-bb33-020f726ff1ca","Type":"ContainerDied","Data":"d2f932848577b9976bbbbfee696b927b4ed7addde564ddddd8ac7804d144d14d"} Jul 15 22:42:37.627364 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:37.627286 2560 scope.go:117] "RemoveContainer" containerID="d2f932848577b9976bbbbfee696b927b4ed7addde564ddddd8ac7804d144d14d" Jul 15 22:42:37.628256 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:37.628234 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 22:42:37.628318 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:37.628304 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 22:42:37.628354 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:37.628340 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 22:42:38.634219 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:38.634185 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" event={"ID":"1048ac31-134e-427d-bb33-020f726ff1ca","Type":"ContainerStarted","Data":"0cdbce9692b0a0b48398ee009debc30b6e351d807819c9372cfc8fb68cb4d397"} Jul 15 22:42:39.104697 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:39.104662 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:42:39.104959 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:39.104928 2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-r59t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 15 22:42:39.105023 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:39.104986 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" podUID="1048ac31-134e-427d-bb33-020f726ff1ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 15 22:42:40.104630 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:40.104600 2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-r59t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 15 22:42:40.105011 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:40.104676 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" podUID="1048ac31-134e-427d-bb33-020f726ff1ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 15 22:42:41.105015 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:41.104976 2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-r59t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 15 22:42:41.105444 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:41.105031 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" podUID="1048ac31-134e-427d-bb33-020f726ff1ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 15 22:42:42.104333 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:42.104302 2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-r59t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 15 22:42:42.104501 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:42.104351 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" podUID="1048ac31-134e-427d-bb33-020f726ff1ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 15 22:42:43.107901 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:43.107867 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:42:43.108268 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:43.108163 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:42:43.108730 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:43.108714 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r59t7" Jul 15 22:42:55.879438 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:55.879402 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln"] Jul 15 22:42:55.881713 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:55.881693 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" Jul 15 22:42:55.884756 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:55.884735 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 15 22:42:55.885026 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:55.885012 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-d7k42\"" Jul 15 22:42:55.885386 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:55.885366 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 15 22:42:55.885601 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:55.885586 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 15 22:42:55.896425 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:55.896399 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln"] Jul 15 22:42:55.926533 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:55.926501 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6ddaa05-1572-4875-b8c8-96e53d9f00a3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln\" (UID: \"c6ddaa05-1572-4875-b8c8-96e53d9f00a3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" Jul 15 22:42:55.926695 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:55.926568 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkk86\" (UniqueName: \"kubernetes.io/projected/c6ddaa05-1572-4875-b8c8-96e53d9f00a3-kube-api-access-wkk86\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln\" (UID: \"c6ddaa05-1572-4875-b8c8-96e53d9f00a3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" Jul 15 22:42:55.926695 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:55.926605 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6ddaa05-1572-4875-b8c8-96e53d9f00a3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln\" (UID: \"c6ddaa05-1572-4875-b8c8-96e53d9f00a3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" Jul 15 22:42:55.926695 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:55.926656 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6ddaa05-1572-4875-b8c8-96e53d9f00a3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln\" (UID: \"c6ddaa05-1572-4875-b8c8-96e53d9f00a3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" Jul 15 22:42:55.926819 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:55.926711 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6ddaa05-1572-4875-b8c8-96e53d9f00a3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln\" (UID: \"c6ddaa05-1572-4875-b8c8-96e53d9f00a3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" Jul 15 22:42:55.926819 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:55.926732 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6ddaa05-1572-4875-b8c8-96e53d9f00a3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln\" (UID: \"c6ddaa05-1572-4875-b8c8-96e53d9f00a3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" Jul 15 22:42:56.027964 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:56.027919 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6ddaa05-1572-4875-b8c8-96e53d9f00a3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln\" (UID: \"c6ddaa05-1572-4875-b8c8-96e53d9f00a3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" Jul 15 22:42:56.028146 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:56.027978 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6ddaa05-1572-4875-b8c8-96e53d9f00a3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln\" (UID: \"c6ddaa05-1572-4875-b8c8-96e53d9f00a3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" Jul 15 22:42:56.028146 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:56.028034 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6ddaa05-1572-4875-b8c8-96e53d9f00a3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln\" (UID: \"c6ddaa05-1572-4875-b8c8-96e53d9f00a3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" Jul 15 22:42:56.028146 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:56.028091 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkk86\" (UniqueName: \"kubernetes.io/projected/c6ddaa05-1572-4875-b8c8-96e53d9f00a3-kube-api-access-wkk86\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln\" (UID: \"c6ddaa05-1572-4875-b8c8-96e53d9f00a3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" Jul 15 22:42:56.028317 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:56.028151 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6ddaa05-1572-4875-b8c8-96e53d9f00a3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln\" (UID: \"c6ddaa05-1572-4875-b8c8-96e53d9f00a3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" Jul 15 22:42:56.028317 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:56.028179 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6ddaa05-1572-4875-b8c8-96e53d9f00a3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln\" (UID: \"c6ddaa05-1572-4875-b8c8-96e53d9f00a3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" Jul 15 22:42:56.028490 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:56.028458 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6ddaa05-1572-4875-b8c8-96e53d9f00a3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln\" (UID: \"c6ddaa05-1572-4875-b8c8-96e53d9f00a3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" Jul 15 22:42:56.028670 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:56.028496 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6ddaa05-1572-4875-b8c8-96e53d9f00a3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln\" (UID: \"c6ddaa05-1572-4875-b8c8-96e53d9f00a3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" Jul 15 22:42:56.028670 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:56.028541 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6ddaa05-1572-4875-b8c8-96e53d9f00a3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln\" (UID: \"c6ddaa05-1572-4875-b8c8-96e53d9f00a3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" Jul 15 22:42:56.030326 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:56.030304 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6ddaa05-1572-4875-b8c8-96e53d9f00a3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln\" (UID: \"c6ddaa05-1572-4875-b8c8-96e53d9f00a3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" Jul 15 22:42:56.030767 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:56.030749 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6ddaa05-1572-4875-b8c8-96e53d9f00a3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln\" (UID: \"c6ddaa05-1572-4875-b8c8-96e53d9f00a3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" Jul 15 22:42:56.035767 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:56.035742 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkk86\" (UniqueName: \"kubernetes.io/projected/c6ddaa05-1572-4875-b8c8-96e53d9f00a3-kube-api-access-wkk86\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln\" (UID: \"c6ddaa05-1572-4875-b8c8-96e53d9f00a3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" Jul 15 22:42:56.193353 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:56.193314 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" Jul 15 22:42:56.331133 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:56.331099 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln"] Jul 15 22:42:56.334092 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:42:56.334057 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6ddaa05_1572_4875_b8c8_96e53d9f00a3.slice/crio-2420cb8fc682728d0850cbdbc345ebb089f5547aa01449b3425c8d3bab206286 WatchSource:0}: Error finding container 2420cb8fc682728d0850cbdbc345ebb089f5547aa01449b3425c8d3bab206286: Status 404 returned error can't find the container with id 2420cb8fc682728d0850cbdbc345ebb089f5547aa01449b3425c8d3bab206286 Jul 15 22:42:56.734140 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:56.734094 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" event={"ID":"c6ddaa05-1572-4875-b8c8-96e53d9f00a3","Type":"ContainerStarted","Data":"2420cb8fc682728d0850cbdbc345ebb089f5547aa01449b3425c8d3bab206286"} Jul 15 22:42:57.740925 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:57.740890 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" event={"ID":"c6ddaa05-1572-4875-b8c8-96e53d9f00a3","Type":"ContainerStarted","Data":"a5a17d0bc9fe81de0f518228fdc05cf31a6316b1afa2ed31166f8036fd3c07b8"} Jul 15 22:42:57.762236 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:42:57.762145 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" podStartSLOduration=1.58754113 podStartE2EDuration="2.762128813s" totalImagesPullingTime="1.174587683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:42:57.761525089 +0000 UTC m=+587.469322682" watchObservedRunningTime="2026-07-15 22:42:57.762128813 +0000 UTC m=+587.469926405" Jul 15 22:43:06.193662 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:06.193616 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" Jul 15 22:43:06.194361 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:06.193677 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" Jul 15 22:43:06.206518 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:06.206491 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" Jul 15 22:43:06.796426 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:06.796397 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln" Jul 15 22:43:10.758770 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:10.758740 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5q8kf_d57dc934-8cdc-4f82-8ee8-527f9cc60a41/console-operator/1.log" Jul 15 22:43:10.759583 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:10.759564 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5q8kf_d57dc934-8cdc-4f82-8ee8-527f9cc60a41/console-operator/1.log" Jul 15 22:43:10.762757 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:10.762737 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/ovn-acl-logging/0.log" Jul 15 22:43:10.763683 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:10.763664 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/ovn-acl-logging/0.log" Jul 15 22:43:17.574068 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:17.574031 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb"] Jul 15 22:43:17.577480 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:17.577462 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" Jul 15 22:43:17.579907 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:17.579884 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 15 22:43:17.589212 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:17.589191 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb"] Jul 15 22:43:17.711770 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:17.711733 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/badb4898-5807-49a0-9648-ab8deca6f1ac-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cntcb\" (UID: \"badb4898-5807-49a0-9648-ab8deca6f1ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" Jul 15 22:43:17.711977 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:17.711788 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/badb4898-5807-49a0-9648-ab8deca6f1ac-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cntcb\" (UID: \"badb4898-5807-49a0-9648-ab8deca6f1ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" Jul 15 22:43:17.711977 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:17.711831 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/badb4898-5807-49a0-9648-ab8deca6f1ac-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cntcb\" (UID: \"badb4898-5807-49a0-9648-ab8deca6f1ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" Jul 15 22:43:17.711977 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:17.711934 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxz7t\" (UniqueName: \"kubernetes.io/projected/badb4898-5807-49a0-9648-ab8deca6f1ac-kube-api-access-mxz7t\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cntcb\" (UID: \"badb4898-5807-49a0-9648-ab8deca6f1ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" Jul 15 22:43:17.712144 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:17.712017 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/badb4898-5807-49a0-9648-ab8deca6f1ac-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cntcb\" (UID: \"badb4898-5807-49a0-9648-ab8deca6f1ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" Jul 15 22:43:17.712144 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:17.712072 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/badb4898-5807-49a0-9648-ab8deca6f1ac-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cntcb\" (UID: \"badb4898-5807-49a0-9648-ab8deca6f1ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" Jul 15 22:43:17.813168 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:17.813125 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/badb4898-5807-49a0-9648-ab8deca6f1ac-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cntcb\" (UID: \"badb4898-5807-49a0-9648-ab8deca6f1ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" Jul 15 22:43:17.813168 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:17.813165 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/badb4898-5807-49a0-9648-ab8deca6f1ac-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cntcb\" (UID: \"badb4898-5807-49a0-9648-ab8deca6f1ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" Jul 15 22:43:17.813383 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:17.813181 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/badb4898-5807-49a0-9648-ab8deca6f1ac-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cntcb\" (UID: \"badb4898-5807-49a0-9648-ab8deca6f1ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" Jul 15 22:43:17.813383 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:17.813203 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/badb4898-5807-49a0-9648-ab8deca6f1ac-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cntcb\" (UID: \"badb4898-5807-49a0-9648-ab8deca6f1ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" Jul 15 22:43:17.813383 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:17.813252 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxz7t\" (UniqueName: \"kubernetes.io/projected/badb4898-5807-49a0-9648-ab8deca6f1ac-kube-api-access-mxz7t\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cntcb\" (UID: \"badb4898-5807-49a0-9648-ab8deca6f1ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" Jul 15 22:43:17.813383 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:17.813307 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/badb4898-5807-49a0-9648-ab8deca6f1ac-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cntcb\" (UID: \"badb4898-5807-49a0-9648-ab8deca6f1ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" Jul 15 22:43:17.813616 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:17.813590 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/badb4898-5807-49a0-9648-ab8deca6f1ac-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cntcb\" (UID: \"badb4898-5807-49a0-9648-ab8deca6f1ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" Jul 15 22:43:17.813677 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:17.813623 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/badb4898-5807-49a0-9648-ab8deca6f1ac-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cntcb\" (UID: \"badb4898-5807-49a0-9648-ab8deca6f1ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" Jul 15 22:43:17.813736 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:17.813670 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/badb4898-5807-49a0-9648-ab8deca6f1ac-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cntcb\" (UID: \"badb4898-5807-49a0-9648-ab8deca6f1ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" Jul 15 22:43:17.815763 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:17.815736 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/badb4898-5807-49a0-9648-ab8deca6f1ac-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cntcb\" (UID: \"badb4898-5807-49a0-9648-ab8deca6f1ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" Jul 15 22:43:17.815968 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:17.815951 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/badb4898-5807-49a0-9648-ab8deca6f1ac-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cntcb\" (UID: \"badb4898-5807-49a0-9648-ab8deca6f1ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" Jul 15 22:43:17.821546 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:17.821522 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxz7t\" (UniqueName: \"kubernetes.io/projected/badb4898-5807-49a0-9648-ab8deca6f1ac-kube-api-access-mxz7t\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cntcb\" (UID: \"badb4898-5807-49a0-9648-ab8deca6f1ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" Jul 15 22:43:17.887182 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:17.887123 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" Jul 15 22:43:18.020734 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:18.020703 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb"] Jul 15 22:43:18.023961 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:43:18.023931 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbadb4898_5807_49a0_9648_ab8deca6f1ac.slice/crio-8e6977cbb9d8e26050b773e2ead818792aede207dc7e677b9cec72f5b7e9ff41 WatchSource:0}: Error finding container 8e6977cbb9d8e26050b773e2ead818792aede207dc7e677b9cec72f5b7e9ff41: Status 404 returned error can't find the container with id 8e6977cbb9d8e26050b773e2ead818792aede207dc7e677b9cec72f5b7e9ff41 Jul 15 22:43:18.025311 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:18.025291 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 22:43:18.848071 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:18.848042 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" event={"ID":"badb4898-5807-49a0-9648-ab8deca6f1ac","Type":"ContainerStarted","Data":"f2336115eee9c5fbf1422a2356e5cea8fdb10e71d79c32252c85e88da6f97eb3"} Jul 15 22:43:18.848506 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:18.848093 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" event={"ID":"badb4898-5807-49a0-9648-ab8deca6f1ac","Type":"ContainerStarted","Data":"8e6977cbb9d8e26050b773e2ead818792aede207dc7e677b9cec72f5b7e9ff41"} Jul 15 22:43:18.866029 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:18.865979 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" podStartSLOduration=1.696171844 podStartE2EDuration="1.865963849s" totalImagesPullingTime="169.792005ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:43:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:43:18.864121456 +0000 UTC m=+608.571919050" watchObservedRunningTime="2026-07-15 22:43:18.865963849 +0000 UTC m=+608.573761442" Jul 15 22:43:27.887332 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:27.887294 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" Jul 15 22:43:27.887725 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:27.887359 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" Jul 15 22:43:27.900008 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:27.899980 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" Jul 15 22:43:28.903959 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:43:28.903930 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cntcb" Jul 15 22:45:00.140643 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:45:00.140609 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735925-l9hlx"] Jul 15 22:45:00.143818 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:45:00.143801 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735925-l9hlx" Jul 15 22:45:00.146010 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:45:00.145988 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rfpqz\"" Jul 15 22:45:00.150348 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:45:00.150323 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735925-l9hlx"] Jul 15 22:45:00.154109 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:45:00.154088 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735925-l9hlx" Jul 15 22:45:00.492245 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:45:00.492211 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735925-l9hlx"] Jul 15 22:45:00.495499 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:45:00.495474 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc715354_656b_4a25_a000_2d7720ddc424.slice/crio-37dbe83250729a5da60989adce22215730ec219c4965dbf916a8696c24143699 WatchSource:0}: Error finding container 37dbe83250729a5da60989adce22215730ec219c4965dbf916a8696c24143699: Status 404 returned error can't find the container with id 37dbe83250729a5da60989adce22215730ec219c4965dbf916a8696c24143699 Jul 15 22:45:01.345770 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:45:01.345738 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735925-l9hlx" event={"ID":"bc715354-656b-4a25-a000-2d7720ddc424","Type":"ContainerStarted","Data":"37dbe83250729a5da60989adce22215730ec219c4965dbf916a8696c24143699"} Jul 15 22:45:03.358734 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:45:03.358697 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735925-l9hlx" event={"ID":"bc715354-656b-4a25-a000-2d7720ddc424","Type":"ContainerStarted","Data":"3a6393a0e71fb4422bdff5fe445a0c99947eacdbcdf8d95c29ed9f3ec2b4d363"} Jul 15 22:45:03.373829 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:45:03.373781 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735925-l9hlx" podStartSLOduration=1.128600655 podStartE2EDuration="3.37376695s" totalImagesPullingTime="2.245166295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:45:03.37356173 +0000 UTC m=+713.081359339" watchObservedRunningTime="2026-07-15 22:45:03.37376695 +0000 UTC m=+713.081564547" Jul 15 22:45:04.364817 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:45:04.364785 2560 generic.go:356] "Generic (PLEG): container finished" podID="bc715354-656b-4a25-a000-2d7720ddc424" containerID="3a6393a0e71fb4422bdff5fe445a0c99947eacdbcdf8d95c29ed9f3ec2b4d363" exitCode=0 Jul 15 22:45:04.365209 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:45:04.364889 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735925-l9hlx" event={"ID":"bc715354-656b-4a25-a000-2d7720ddc424","Type":"ContainerDied","Data":"3a6393a0e71fb4422bdff5fe445a0c99947eacdbcdf8d95c29ed9f3ec2b4d363"} Jul 15 22:45:05.499972 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:45:05.499942 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735925-l9hlx" Jul 15 22:45:06.382501 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:45:06.382465 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735925-l9hlx" Jul 15 22:45:06.382698 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:45:06.382495 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735925-l9hlx" event={"ID":"bc715354-656b-4a25-a000-2d7720ddc424","Type":"ContainerDied","Data":"37dbe83250729a5da60989adce22215730ec219c4965dbf916a8696c24143699"} Jul 15 22:45:06.382698 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:45:06.382571 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37dbe83250729a5da60989adce22215730ec219c4965dbf916a8696c24143699" Jul 15 22:48:10.793363 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:48:10.793284 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5q8kf_d57dc934-8cdc-4f82-8ee8-527f9cc60a41/console-operator/1.log" Jul 15 22:48:10.793901 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:48:10.793406 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5q8kf_d57dc934-8cdc-4f82-8ee8-527f9cc60a41/console-operator/1.log" Jul 15 22:48:10.797706 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:48:10.797687 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/ovn-acl-logging/0.log" Jul 15 22:48:10.797866 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:48:10.797839 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/ovn-acl-logging/0.log" Jul 15 22:53:10.824571 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:53:10.824545 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5q8kf_d57dc934-8cdc-4f82-8ee8-527f9cc60a41/console-operator/1.log" Jul 15 22:53:10.827141 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:53:10.825701 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5q8kf_d57dc934-8cdc-4f82-8ee8-527f9cc60a41/console-operator/1.log" Jul 15 22:53:10.828629 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:53:10.828606 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/ovn-acl-logging/0.log" Jul 15 22:53:10.829363 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:53:10.829344 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/ovn-acl-logging/0.log" Jul 15 22:58:10.856333 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:58:10.856235 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5q8kf_d57dc934-8cdc-4f82-8ee8-527f9cc60a41/console-operator/1.log" Jul 15 22:58:10.860398 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:58:10.857235 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5q8kf_d57dc934-8cdc-4f82-8ee8-527f9cc60a41/console-operator/1.log" Jul 15 22:58:10.860398 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:58:10.859675 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/ovn-acl-logging/0.log" Jul 15 22:58:10.860801 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:58:10.860786 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/ovn-acl-logging/0.log" Jul 15 22:59:33.520783 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.520745 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn"] Jul 15 22:59:33.521376 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.521086 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc715354-656b-4a25-a000-2d7720ddc424" containerName="cleanup" Jul 15 22:59:33.521376 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.521097 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc715354-656b-4a25-a000-2d7720ddc424" containerName="cleanup" Jul 15 22:59:33.521376 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.521145 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc715354-656b-4a25-a000-2d7720ddc424" containerName="cleanup" Jul 15 22:59:33.523949 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.523912 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.526268 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.526189 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5d538e1f-openshift-default-dockercfg-769mm\"" Jul 15 22:59:33.548045 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.548022 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn"] Jul 15 22:59:33.549002 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.548981 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-workload-certs\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.549087 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.549021 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istio-envoy\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.549143 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.549094 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-credential-socket\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.549185 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.549145 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istio-data\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.549240 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.549181 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdrp7\" (UniqueName: \"kubernetes.io/projected/fcf11f3e-b1e4-4af4-8e99-3b111564642c-kube-api-access-cdrp7\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.549240 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.549206 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-workload-socket\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.549337 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.549261 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istio-podinfo\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.549374 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.549336 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istiod-ca-cert\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.549441 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.549386 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istio-token\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.650828 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.650796 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istio-token\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.651003 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.650836 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-workload-certs\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.651003 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.650884 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istio-envoy\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.651003 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.650908 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-credential-socket\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.651003 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.650924 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istio-data\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.651003 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.650953 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdrp7\" (UniqueName: \"kubernetes.io/projected/fcf11f3e-b1e4-4af4-8e99-3b111564642c-kube-api-access-cdrp7\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.651003 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.650978 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-workload-socket\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.651003 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.651003 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istio-podinfo\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.651386 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.651046 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istiod-ca-cert\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.651386 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.651325 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-credential-socket\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.651498 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.651475 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-workload-certs\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.651550 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.651501 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istio-data\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.651586 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.651542 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-workload-socket\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.651670 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.651655 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istiod-ca-cert\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.653268 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.653248 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istio-envoy\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.653563 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.653546 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istio-podinfo\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.659325 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.659299 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istio-token\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.660081 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.660060 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdrp7\" (UniqueName: \"kubernetes.io/projected/fcf11f3e-b1e4-4af4-8e99-3b111564642c-kube-api-access-cdrp7\") pod \"e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.835084 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.834997 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:33.971108 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.971069 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn"] Jul 15 22:59:33.976583 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:59:33.976536 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcf11f3e_b1e4_4af4_8e99_3b111564642c.slice/crio-4af7ad619fc576216160d27a9684516c52afad5f16525640040b3dc6c0e7edea WatchSource:0}: Error finding container 4af7ad619fc576216160d27a9684516c52afad5f16525640040b3dc6c0e7edea: Status 404 returned error can't find the container with id 4af7ad619fc576216160d27a9684516c52afad5f16525640040b3dc6c0e7edea Jul 15 22:59:33.978254 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.978221 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 22:59:33.978352 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.978321 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 22:59:33.978414 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:33.978364 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 22:59:34.640781 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:34.640747 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" event={"ID":"fcf11f3e-b1e4-4af4-8e99-3b111564642c","Type":"ContainerStarted","Data":"be75856ed157d5dc197ed0bbee13a46e1db1b4861681c79f8c6f2f9b111fa15a"} Jul 15 22:59:34.641164 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:34.640796 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" event={"ID":"fcf11f3e-b1e4-4af4-8e99-3b111564642c","Type":"ContainerStarted","Data":"4af7ad619fc576216160d27a9684516c52afad5f16525640040b3dc6c0e7edea"} Jul 15 22:59:34.661458 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:34.661412 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" podStartSLOduration=1.661395352 podStartE2EDuration="1.661395352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:59:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:59:34.658504863 +0000 UTC m=+1584.366302454" watchObservedRunningTime="2026-07-15 22:59:34.661395352 +0000 UTC m=+1584.369192942" Jul 15 22:59:34.841685 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:34.841654 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:35.839880 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:35.839820 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:36.650935 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:36.650904 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:36.651845 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:36.651828 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:39.785070 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:39.785039 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn"] Jul 15 22:59:39.785529 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:39.785203 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" podUID="fcf11f3e-b1e4-4af4-8e99-3b111564642c" containerName="istio-proxy" containerID="cri-o://be75856ed157d5dc197ed0bbee13a46e1db1b4861681c79f8c6f2f9b111fa15a" gracePeriod=30 Jul 15 22:59:45.702878 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.702825 2560 generic.go:356] "Generic (PLEG): container finished" podID="fcf11f3e-b1e4-4af4-8e99-3b111564642c" containerID="be75856ed157d5dc197ed0bbee13a46e1db1b4861681c79f8c6f2f9b111fa15a" exitCode=0 Jul 15 22:59:45.703260 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.702891 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" event={"ID":"fcf11f3e-b1e4-4af4-8e99-3b111564642c","Type":"ContainerDied","Data":"be75856ed157d5dc197ed0bbee13a46e1db1b4861681c79f8c6f2f9b111fa15a"} Jul 15 22:59:45.728168 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.728142 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:45.861315 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.861234 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdrp7\" (UniqueName: \"kubernetes.io/projected/fcf11f3e-b1e4-4af4-8e99-3b111564642c-kube-api-access-cdrp7\") pod \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " Jul 15 22:59:45.861315 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.861307 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-credential-socket\") pod \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " Jul 15 22:59:45.861493 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.861346 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istiod-ca-cert\") pod \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " Jul 15 22:59:45.861493 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.861384 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-workload-certs\") pod \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " Jul 15 22:59:45.861493 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.861408 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istio-podinfo\") pod \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " Jul 15 22:59:45.861493 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.861453 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istio-data\") pod \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " Jul 15 22:59:45.861493 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.861473 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istio-token\") pod \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " Jul 15 22:59:45.861728 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.861501 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istio-envoy\") pod \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " Jul 15 22:59:45.861728 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.861534 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-workload-socket\") pod \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\" (UID: \"fcf11f3e-b1e4-4af4-8e99-3b111564642c\") " Jul 15 22:59:45.861728 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.861646 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fcf11f3e-b1e4-4af4-8e99-3b111564642c" (UID: "fcf11f3e-b1e4-4af4-8e99-3b111564642c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:59:45.861914 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.861720 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fcf11f3e-b1e4-4af4-8e99-3b111564642c" (UID: "fcf11f3e-b1e4-4af4-8e99-3b111564642c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:59:45.861914 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.861796 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fcf11f3e-b1e4-4af4-8e99-3b111564642c" (UID: "fcf11f3e-b1e4-4af4-8e99-3b111564642c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:59:45.861914 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.861879 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-credential-socket\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:59:45.861914 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.861901 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-workload-certs\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:59:45.862115 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.862058 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fcf11f3e-b1e4-4af4-8e99-3b111564642c" (UID: "fcf11f3e-b1e4-4af4-8e99-3b111564642c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:59:45.862298 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.862239 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istio-data" (OuterVolumeSpecName: "istio-data") pod "fcf11f3e-b1e4-4af4-8e99-3b111564642c" (UID: "fcf11f3e-b1e4-4af4-8e99-3b111564642c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:59:45.863891 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.863826 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fcf11f3e-b1e4-4af4-8e99-3b111564642c" (UID: "fcf11f3e-b1e4-4af4-8e99-3b111564642c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:59:45.863891 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.863877 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fcf11f3e-b1e4-4af4-8e99-3b111564642c" (UID: "fcf11f3e-b1e4-4af4-8e99-3b111564642c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 22:59:45.864140 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.864116 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istio-token" (OuterVolumeSpecName: "istio-token") pod "fcf11f3e-b1e4-4af4-8e99-3b111564642c" (UID: "fcf11f3e-b1e4-4af4-8e99-3b111564642c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:59:45.864140 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.864126 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcf11f3e-b1e4-4af4-8e99-3b111564642c-kube-api-access-cdrp7" (OuterVolumeSpecName: "kube-api-access-cdrp7") pod "fcf11f3e-b1e4-4af4-8e99-3b111564642c" (UID: "fcf11f3e-b1e4-4af4-8e99-3b111564642c"). InnerVolumeSpecName "kube-api-access-cdrp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:59:45.882206 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.882181 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74"] Jul 15 22:59:45.882527 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.882515 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcf11f3e-b1e4-4af4-8e99-3b111564642c" containerName="istio-proxy" Jul 15 22:59:45.882599 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.882529 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcf11f3e-b1e4-4af4-8e99-3b111564642c" containerName="istio-proxy" Jul 15 22:59:45.882654 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.882599 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcf11f3e-b1e4-4af4-8e99-3b111564642c" containerName="istio-proxy" Jul 15 22:59:45.884838 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.884818 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:45.887107 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.887085 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-56f79d48-gw-openshift-default-dockercfg-5wbjv\"" Jul 15 22:59:45.897049 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.897030 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74"] Jul 15 22:59:45.963082 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.963053 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-workload-certs\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:45.963193 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.963118 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-istio-envoy\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:45.963193 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.963143 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-istio-data\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:45.963281 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.963231 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-workload-socket\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:45.963321 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.963279 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-credential-socket\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:45.963321 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.963298 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f6a993a-9d58-4b93-9956-2d28322b23c6-istio-token\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:45.963408 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.963369 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f6a993a-9d58-4b93-9956-2d28322b23c6-istio-podinfo\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:45.963408 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.963404 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f6a993a-9d58-4b93-9956-2d28322b23c6-istiod-ca-cert\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:45.963471 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.963420 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2hd9\" (UniqueName: \"kubernetes.io/projected/3f6a993a-9d58-4b93-9956-2d28322b23c6-kube-api-access-q2hd9\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:45.963511 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.963497 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istiod-ca-cert\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:59:45.963547 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.963512 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istio-podinfo\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:59:45.963547 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.963525 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istio-data\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:59:45.963547 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.963534 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istio-token\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:59:45.963547 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.963541 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-istio-envoy\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:59:45.963680 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.963549 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcf11f3e-b1e4-4af4-8e99-3b111564642c-workload-socket\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:59:45.963680 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:45.963556 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdrp7\" (UniqueName: \"kubernetes.io/projected/fcf11f3e-b1e4-4af4-8e99-3b111564642c-kube-api-access-cdrp7\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:59:46.064417 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.064384 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-workload-certs\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:46.064417 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.064424 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-istio-envoy\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:46.064655 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.064439 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-istio-data\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:46.064655 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.064507 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-workload-socket\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:46.064655 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.064522 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-credential-socket\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:46.064655 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.064537 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f6a993a-9d58-4b93-9956-2d28322b23c6-istio-token\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:46.064655 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.064582 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f6a993a-9d58-4b93-9956-2d28322b23c6-istio-podinfo\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:46.064655 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.064606 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f6a993a-9d58-4b93-9956-2d28322b23c6-istiod-ca-cert\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:46.064655 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.064627 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2hd9\" (UniqueName: \"kubernetes.io/projected/3f6a993a-9d58-4b93-9956-2d28322b23c6-kube-api-access-q2hd9\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:46.065018 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.064886 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-workload-certs\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:46.065348 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.065323 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-workload-socket\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:46.065483 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.065325 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-credential-socket\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:46.065483 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.065402 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-istio-data\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:46.065642 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.065619 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f6a993a-9d58-4b93-9956-2d28322b23c6-istiod-ca-cert\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:46.066890 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.066844 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-istio-envoy\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:46.067207 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.067187 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f6a993a-9d58-4b93-9956-2d28322b23c6-istio-podinfo\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:46.072502 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.072473 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2hd9\" (UniqueName: \"kubernetes.io/projected/3f6a993a-9d58-4b93-9956-2d28322b23c6-kube-api-access-q2hd9\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:46.072603 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.072591 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f6a993a-9d58-4b93-9956-2d28322b23c6-istio-token\") pod \"e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:46.197427 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.197399 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:46.333758 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.333724 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74"] Jul 15 22:59:46.334952 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:59:46.334914 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f6a993a_9d58_4b93_9956_2d28322b23c6.slice/crio-9ac7124f7f698c73b2e05f95fd24e3c50de1975869c771786871c943e435cb86 WatchSource:0}: Error finding container 9ac7124f7f698c73b2e05f95fd24e3c50de1975869c771786871c943e435cb86: Status 404 returned error can't find the container with id 9ac7124f7f698c73b2e05f95fd24e3c50de1975869c771786871c943e435cb86 Jul 15 22:59:46.336966 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.336939 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 22:59:46.337027 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.337000 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 22:59:46.337063 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.337029 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 22:59:46.709491 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.709467 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" Jul 15 22:59:46.709972 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.709483 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn" event={"ID":"fcf11f3e-b1e4-4af4-8e99-3b111564642c","Type":"ContainerDied","Data":"4af7ad619fc576216160d27a9684516c52afad5f16525640040b3dc6c0e7edea"} Jul 15 22:59:46.709972 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.709541 2560 scope.go:117] "RemoveContainer" containerID="be75856ed157d5dc197ed0bbee13a46e1db1b4861681c79f8c6f2f9b111fa15a" Jul 15 22:59:46.711104 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.711082 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" event={"ID":"3f6a993a-9d58-4b93-9956-2d28322b23c6","Type":"ContainerStarted","Data":"0b27fca024da4ccd080737f66a8e5a74f0f48da339ecc00b82311f7f739b0b7b"} Jul 15 22:59:46.711222 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.711165 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" event={"ID":"3f6a993a-9d58-4b93-9956-2d28322b23c6","Type":"ContainerStarted","Data":"9ac7124f7f698c73b2e05f95fd24e3c50de1975869c771786871c943e435cb86"} Jul 15 22:59:46.733190 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.733143 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" podStartSLOduration=1.7331307040000001 podStartE2EDuration="1.733130704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:59:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:59:46.73060968 +0000 UTC m=+1596.438407270" watchObservedRunningTime="2026-07-15 22:59:46.733130704 +0000 UTC m=+1596.440928295" Jul 15 22:59:46.745667 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.745634 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn"] Jul 15 22:59:46.747735 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.747716 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5d538e1f-openshift-default-6f4ccd4cf7-6ccpn"] Jul 15 22:59:46.840730 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:46.840707 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcf11f3e-b1e4-4af4-8e99-3b111564642c" path="/var/lib/kubelet/pods/fcf11f3e-b1e4-4af4-8e99-3b111564642c/volumes" Jul 15 22:59:47.197764 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:47.197738 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:47.202780 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:47.202757 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:47.716718 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:47.716688 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:47.717646 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:47.717630 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:51.708281 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:51.708249 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74"] Jul 15 22:59:51.708748 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:51.708436 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" podUID="3f6a993a-9d58-4b93-9956-2d28322b23c6" containerName="istio-proxy" containerID="cri-o://0b27fca024da4ccd080737f66a8e5a74f0f48da339ecc00b82311f7f739b0b7b" gracePeriod=30 Jul 15 22:59:56.557694 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.557640 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:56.657004 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.656932 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-istio-envoy\") pod \"3f6a993a-9d58-4b93-9956-2d28322b23c6\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " Jul 15 22:59:56.657004 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.656973 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-istio-data\") pod \"3f6a993a-9d58-4b93-9956-2d28322b23c6\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " Jul 15 22:59:56.657004 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.657001 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f6a993a-9d58-4b93-9956-2d28322b23c6-istio-token\") pod \"3f6a993a-9d58-4b93-9956-2d28322b23c6\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " Jul 15 22:59:56.657252 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.657061 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-credential-socket\") pod \"3f6a993a-9d58-4b93-9956-2d28322b23c6\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " Jul 15 22:59:56.657252 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.657111 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f6a993a-9d58-4b93-9956-2d28322b23c6-istiod-ca-cert\") pod \"3f6a993a-9d58-4b93-9956-2d28322b23c6\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " Jul 15 22:59:56.657252 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.657168 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2hd9\" (UniqueName: \"kubernetes.io/projected/3f6a993a-9d58-4b93-9956-2d28322b23c6-kube-api-access-q2hd9\") pod \"3f6a993a-9d58-4b93-9956-2d28322b23c6\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " Jul 15 22:59:56.657252 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.657221 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-workload-certs\") pod \"3f6a993a-9d58-4b93-9956-2d28322b23c6\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " Jul 15 22:59:56.657500 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.657273 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-workload-socket\") pod \"3f6a993a-9d58-4b93-9956-2d28322b23c6\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " Jul 15 22:59:56.657500 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.657300 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f6a993a-9d58-4b93-9956-2d28322b23c6-istio-podinfo\") pod \"3f6a993a-9d58-4b93-9956-2d28322b23c6\" (UID: \"3f6a993a-9d58-4b93-9956-2d28322b23c6\") " Jul 15 22:59:56.657500 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.657267 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3f6a993a-9d58-4b93-9956-2d28322b23c6" (UID: "3f6a993a-9d58-4b93-9956-2d28322b23c6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:59:56.657500 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.657469 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3f6a993a-9d58-4b93-9956-2d28322b23c6" (UID: "3f6a993a-9d58-4b93-9956-2d28322b23c6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:59:56.657500 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.657480 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f6a993a-9d58-4b93-9956-2d28322b23c6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3f6a993a-9d58-4b93-9956-2d28322b23c6" (UID: "3f6a993a-9d58-4b93-9956-2d28322b23c6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:59:56.657741 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.657562 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f6a993a-9d58-4b93-9956-2d28322b23c6-istiod-ca-cert\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:59:56.657741 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.657580 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-workload-certs\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:59:56.657741 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.657592 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-credential-socket\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:59:56.657741 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.657653 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3f6a993a-9d58-4b93-9956-2d28322b23c6" (UID: "3f6a993a-9d58-4b93-9956-2d28322b23c6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:59:56.657958 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.657894 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-istio-data" (OuterVolumeSpecName: "istio-data") pod "3f6a993a-9d58-4b93-9956-2d28322b23c6" (UID: "3f6a993a-9d58-4b93-9956-2d28322b23c6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:59:56.659403 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.659383 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3f6a993a-9d58-4b93-9956-2d28322b23c6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3f6a993a-9d58-4b93-9956-2d28322b23c6" (UID: "3f6a993a-9d58-4b93-9956-2d28322b23c6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 22:59:56.659516 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.659404 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f6a993a-9d58-4b93-9956-2d28322b23c6-kube-api-access-q2hd9" (OuterVolumeSpecName: "kube-api-access-q2hd9") pod "3f6a993a-9d58-4b93-9956-2d28322b23c6" (UID: "3f6a993a-9d58-4b93-9956-2d28322b23c6"). InnerVolumeSpecName "kube-api-access-q2hd9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:59:56.659669 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.659647 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3f6a993a-9d58-4b93-9956-2d28322b23c6" (UID: "3f6a993a-9d58-4b93-9956-2d28322b23c6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:59:56.659737 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.659696 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f6a993a-9d58-4b93-9956-2d28322b23c6-istio-token" (OuterVolumeSpecName: "istio-token") pod "3f6a993a-9d58-4b93-9956-2d28322b23c6" (UID: "3f6a993a-9d58-4b93-9956-2d28322b23c6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:59:56.758618 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.758588 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-workload-socket\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:59:56.758618 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.758616 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f6a993a-9d58-4b93-9956-2d28322b23c6-istio-podinfo\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:59:56.758618 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.758626 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-istio-envoy\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:59:56.758775 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.758635 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f6a993a-9d58-4b93-9956-2d28322b23c6-istio-data\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:59:56.758775 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.758642 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f6a993a-9d58-4b93-9956-2d28322b23c6-istio-token\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:59:56.758775 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.758650 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2hd9\" (UniqueName: \"kubernetes.io/projected/3f6a993a-9d58-4b93-9956-2d28322b23c6-kube-api-access-q2hd9\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 22:59:56.763797 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.763769 2560 generic.go:356] "Generic (PLEG): container finished" podID="3f6a993a-9d58-4b93-9956-2d28322b23c6" containerID="0b27fca024da4ccd080737f66a8e5a74f0f48da339ecc00b82311f7f739b0b7b" exitCode=0 Jul 15 22:59:56.763907 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.763811 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" Jul 15 22:59:56.763907 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.763869 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" event={"ID":"3f6a993a-9d58-4b93-9956-2d28322b23c6","Type":"ContainerDied","Data":"0b27fca024da4ccd080737f66a8e5a74f0f48da339ecc00b82311f7f739b0b7b"} Jul 15 22:59:56.763989 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.763919 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74" event={"ID":"3f6a993a-9d58-4b93-9956-2d28322b23c6","Type":"ContainerDied","Data":"9ac7124f7f698c73b2e05f95fd24e3c50de1975869c771786871c943e435cb86"} Jul 15 22:59:56.763989 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.763940 2560 scope.go:117] "RemoveContainer" containerID="0b27fca024da4ccd080737f66a8e5a74f0f48da339ecc00b82311f7f739b0b7b" Jul 15 22:59:56.772363 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.772346 2560 scope.go:117] "RemoveContainer" containerID="0b27fca024da4ccd080737f66a8e5a74f0f48da339ecc00b82311f7f739b0b7b" Jul 15 22:59:56.772623 ip-10-0-132-45 kubenswrapper[2560]: E0715 22:59:56.772606 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b27fca024da4ccd080737f66a8e5a74f0f48da339ecc00b82311f7f739b0b7b\": container with ID starting with 0b27fca024da4ccd080737f66a8e5a74f0f48da339ecc00b82311f7f739b0b7b not found: ID does not exist" containerID="0b27fca024da4ccd080737f66a8e5a74f0f48da339ecc00b82311f7f739b0b7b" Jul 15 22:59:56.772666 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.772632 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b27fca024da4ccd080737f66a8e5a74f0f48da339ecc00b82311f7f739b0b7b"} err="failed to get container status \"0b27fca024da4ccd080737f66a8e5a74f0f48da339ecc00b82311f7f739b0b7b\": rpc error: code = NotFound desc = could not find container \"0b27fca024da4ccd080737f66a8e5a74f0f48da339ecc00b82311f7f739b0b7b\": container with ID starting with 0b27fca024da4ccd080737f66a8e5a74f0f48da339ecc00b82311f7f739b0b7b not found: ID does not exist" Jul 15 22:59:56.783056 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.783036 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74"] Jul 15 22:59:56.788930 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.788905 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-56f79d48-gw-openshift-default-5d6f84d67f-psn74"] Jul 15 22:59:56.840397 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:56.840374 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f6a993a-9d58-4b93-9956-2d28322b23c6" path="/var/lib/kubelet/pods/3f6a993a-9d58-4b93-9956-2d28322b23c6/volumes" Jul 15 22:59:57.771351 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.771321 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c"] Jul 15 22:59:57.771690 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.771626 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f6a993a-9d58-4b93-9956-2d28322b23c6" containerName="istio-proxy" Jul 15 22:59:57.771690 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.771636 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f6a993a-9d58-4b93-9956-2d28322b23c6" containerName="istio-proxy" Jul 15 22:59:57.771759 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.771693 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f6a993a-9d58-4b93-9956-2d28322b23c6" containerName="istio-proxy" Jul 15 22:59:57.775976 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.775957 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.778303 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.778287 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-ccc4377e-openshift-default-dockercfg-zwl2x\"" Jul 15 22:59:57.798328 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.798305 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c"] Jul 15 22:59:57.868530 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.868505 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istio-token\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.868670 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.868537 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-workload-certs\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.868670 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.868558 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-credential-socket\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.868670 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.868615 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x88l\" (UniqueName: \"kubernetes.io/projected/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-kube-api-access-6x88l\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.868845 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.868678 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istio-envoy\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.868845 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.868704 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istiod-ca-cert\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.868845 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.868727 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istio-data\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.868845 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.868791 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-workload-socket\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.868845 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.868814 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istio-podinfo\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.970010 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.969984 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istio-data\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.970138 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.970027 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-workload-socket\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.970138 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.970044 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istio-podinfo\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.970248 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.970190 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istio-token\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.970248 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.970234 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-workload-certs\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.970361 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.970263 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-credential-socket\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.970361 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.970324 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x88l\" (UniqueName: \"kubernetes.io/projected/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-kube-api-access-6x88l\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.970511 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.970380 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istio-envoy\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.970511 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.970419 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-workload-socket\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.970623 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.970609 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-credential-socket\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.971008 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.970970 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istiod-ca-cert\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.971137 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.971070 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istio-data\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.971137 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.971078 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-workload-certs\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.971569 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.971548 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istiod-ca-cert\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.972840 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.972817 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istio-podinfo\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.973233 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.973213 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istio-envoy\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.987377 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.987359 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istio-token\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:57.987868 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:57.987833 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x88l\" (UniqueName: \"kubernetes.io/projected/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-kube-api-access-6x88l\") pod \"e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:58.087045 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:58.086968 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:58.228429 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:58.228404 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c"] Jul 15 22:59:58.230269 ip-10-0-132-45 kubenswrapper[2560]: W0715 22:59:58.230245 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a5d5092_b39d_4071_82b7_b4ab3026e2b5.slice/crio-2babc72cc75aa5ca1e839233492cf084612524e416009d47d2e466243342876d WatchSource:0}: Error finding container 2babc72cc75aa5ca1e839233492cf084612524e416009d47d2e466243342876d: Status 404 returned error can't find the container with id 2babc72cc75aa5ca1e839233492cf084612524e416009d47d2e466243342876d Jul 15 22:59:58.232257 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:58.232227 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 22:59:58.232310 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:58.232288 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 22:59:58.232350 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:58.232314 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 22:59:58.777182 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:58.777141 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" event={"ID":"8a5d5092-b39d-4071-82b7-b4ab3026e2b5","Type":"ContainerStarted","Data":"7d8ec5ead0d068cb5cd3afd1459ef873412acc020f4f2f904f84d5e6110027db"} Jul 15 22:59:58.777182 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:58.777187 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" event={"ID":"8a5d5092-b39d-4071-82b7-b4ab3026e2b5","Type":"ContainerStarted","Data":"2babc72cc75aa5ca1e839233492cf084612524e416009d47d2e466243342876d"} Jul 15 22:59:58.796774 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:58.796732 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" podStartSLOduration=1.7967183960000002 podStartE2EDuration="1.796718396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:59:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:59:58.794310452 +0000 UTC m=+1608.502108046" watchObservedRunningTime="2026-07-15 22:59:58.796718396 +0000 UTC m=+1608.504515986" Jul 15 22:59:59.087940 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:59.087844 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:59.092245 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:59.092222 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:59.788479 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:59.788444 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 22:59:59.789289 ip-10-0-132-45 kubenswrapper[2560]: I0715 22:59:59.789266 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 23:00:00.130239 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:00.130167 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735940-wwqnv"] Jul 15 23:00:00.133697 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:00.133676 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735940-wwqnv" Jul 15 23:00:00.134368 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:00.134346 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-56f79d48-29735940-6s5tk"] Jul 15 23:00:00.135610 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:00.135594 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rfpqz\"" Jul 15 23:00:00.138000 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:00.137985 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc4377e-29735940-k5bz6"] Jul 15 23:00:00.138096 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:00.138081 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-56f79d48-29735940-6s5tk" Jul 15 23:00:00.143096 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:00.143076 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735940-wwqnv"] Jul 15 23:00:00.143250 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:00.143201 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc4377e-29735940-k5bz6" Jul 15 23:00:00.145903 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:00.145881 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-56f79d48-29735940-6s5tk"] Jul 15 23:00:00.147039 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:00.147023 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735940-wwqnv" Jul 15 23:00:00.148893 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:00.148871 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc4377e-29735940-k5bz6"] Jul 15 23:00:00.155329 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:00.155185 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-56f79d48-29735940-6s5tk" Jul 15 23:00:00.161829 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:00.161815 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc4377e-29735940-k5bz6" Jul 15 23:00:00.310682 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:00.310653 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735940-wwqnv"] Jul 15 23:00:00.311639 ip-10-0-132-45 kubenswrapper[2560]: W0715 23:00:00.311610 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14cab98b_eca1_4b62_978e_bda3b0fbdbb5.slice/crio-907a36dcea2c017db21d6ffaf5a9dba0b62d947511c0cab48b55aaec73de2a5c WatchSource:0}: Error finding container 907a36dcea2c017db21d6ffaf5a9dba0b62d947511c0cab48b55aaec73de2a5c: Status 404 returned error can't find the container with id 907a36dcea2c017db21d6ffaf5a9dba0b62d947511c0cab48b55aaec73de2a5c Jul 15 23:00:00.540390 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:00.540350 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-56f79d48-29735940-6s5tk"] Jul 15 23:00:00.542345 ip-10-0-132-45 kubenswrapper[2560]: W0715 23:00:00.542319 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod282c84a8_5c78_4be1_af5c_e0f1b5e249af.slice/crio-d38e27b0e4e91ba568b2b6d4da1cd8d7ff823394929aad1864b4c0fb17a28b81 WatchSource:0}: Error finding container d38e27b0e4e91ba568b2b6d4da1cd8d7ff823394929aad1864b4c0fb17a28b81: Status 404 returned error can't find the container with id d38e27b0e4e91ba568b2b6d4da1cd8d7ff823394929aad1864b4c0fb17a28b81 Jul 15 23:00:00.542602 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:00.542581 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc4377e-29735940-k5bz6"] Jul 15 23:00:00.543165 ip-10-0-132-45 kubenswrapper[2560]: W0715 23:00:00.543144 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeda4e44_6dc3_4cd4_828a_74997f3fb5e3.slice/crio-373a19fabfbeb52f41ee5749a50342386962045609354bd14dbe3a5a5cbe3640 WatchSource:0}: Error finding container 373a19fabfbeb52f41ee5749a50342386962045609354bd14dbe3a5a5cbe3640: Status 404 returned error can't find the container with id 373a19fabfbeb52f41ee5749a50342386962045609354bd14dbe3a5a5cbe3640 Jul 15 23:00:00.793597 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:00.793534 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-56f79d48-29735940-6s5tk" event={"ID":"feda4e44-6dc3-4cd4-828a-74997f3fb5e3","Type":"ContainerStarted","Data":"373a19fabfbeb52f41ee5749a50342386962045609354bd14dbe3a5a5cbe3640"} Jul 15 23:00:00.795063 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:00.795029 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc4377e-29735940-k5bz6" event={"ID":"282c84a8-5c78-4be1-af5c-e0f1b5e249af","Type":"ContainerStarted","Data":"866c179390ff4ed1183881f9ddf343398f02b7f7b7ecfa21553eb30dde60b297"} Jul 15 23:00:00.795168 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:00.795076 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc4377e-29735940-k5bz6" event={"ID":"282c84a8-5c78-4be1-af5c-e0f1b5e249af","Type":"ContainerStarted","Data":"d38e27b0e4e91ba568b2b6d4da1cd8d7ff823394929aad1864b4c0fb17a28b81"} Jul 15 23:00:00.796452 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:00.796428 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735940-wwqnv" event={"ID":"14cab98b-eca1-4b62-978e-bda3b0fbdbb5","Type":"ContainerStarted","Data":"f91122930649faf1872978cc9bcf150228bc545c890ccd3f05a9cf746133f59b"} Jul 15 23:00:00.796530 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:00.796477 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735940-wwqnv" event={"ID":"14cab98b-eca1-4b62-978e-bda3b0fbdbb5","Type":"ContainerStarted","Data":"907a36dcea2c017db21d6ffaf5a9dba0b62d947511c0cab48b55aaec73de2a5c"} Jul 15 23:00:00.809940 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:00.809901 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc4377e-29735940-k5bz6" podStartSLOduration=0.809888098 podStartE2EDuration="809.888098ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:00:00.807431309 +0000 UTC m=+1610.515228900" watchObservedRunningTime="2026-07-15 23:00:00.809888098 +0000 UTC m=+1610.517685684" Jul 15 23:00:01.802754 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:01.802715 2560 generic.go:356] "Generic (PLEG): container finished" podID="feda4e44-6dc3-4cd4-828a-74997f3fb5e3" containerID="44b9e4195ad7b76d5ae654c1d4441dcd11ecbbc44794698817ca2973d01b24f7" exitCode=0 Jul 15 23:00:01.803168 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:01.802773 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-56f79d48-29735940-6s5tk" event={"ID":"feda4e44-6dc3-4cd4-828a-74997f3fb5e3","Type":"ContainerDied","Data":"44b9e4195ad7b76d5ae654c1d4441dcd11ecbbc44794698817ca2973d01b24f7"} Jul 15 23:00:01.804328 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:01.804305 2560 generic.go:356] "Generic (PLEG): container finished" podID="282c84a8-5c78-4be1-af5c-e0f1b5e249af" containerID="866c179390ff4ed1183881f9ddf343398f02b7f7b7ecfa21553eb30dde60b297" exitCode=7 Jul 15 23:00:01.804456 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:01.804366 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc4377e-29735940-k5bz6" event={"ID":"282c84a8-5c78-4be1-af5c-e0f1b5e249af","Type":"ContainerDied","Data":"866c179390ff4ed1183881f9ddf343398f02b7f7b7ecfa21553eb30dde60b297"} Jul 15 23:00:01.804546 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:01.804532 2560 scope.go:117] "RemoveContainer" containerID="866c179390ff4ed1183881f9ddf343398f02b7f7b7ecfa21553eb30dde60b297" Jul 15 23:00:01.805840 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:01.805821 2560 generic.go:356] "Generic (PLEG): container finished" podID="14cab98b-eca1-4b62-978e-bda3b0fbdbb5" containerID="f91122930649faf1872978cc9bcf150228bc545c890ccd3f05a9cf746133f59b" exitCode=0 Jul 15 23:00:01.805949 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:01.805901 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735940-wwqnv" event={"ID":"14cab98b-eca1-4b62-978e-bda3b0fbdbb5","Type":"ContainerDied","Data":"f91122930649faf1872978cc9bcf150228bc545c890ccd3f05a9cf746133f59b"} Jul 15 23:00:01.818496 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:01.818459 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735940-wwqnv" podStartSLOduration=1.8184452549999999 podStartE2EDuration="1.818445255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:00:00.823120262 +0000 UTC m=+1610.530917854" watchObservedRunningTime="2026-07-15 23:00:01.818445255 +0000 UTC m=+1611.526242846" Jul 15 23:00:02.813445 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:02.813404 2560 generic.go:356] "Generic (PLEG): container finished" podID="282c84a8-5c78-4be1-af5c-e0f1b5e249af" containerID="0f5e17e15a1951e42c15fca332e7945cce9bb385269296a8d44b628c2ec940ec" exitCode=7 Jul 15 23:00:02.813874 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:02.813485 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc4377e-29735940-k5bz6" event={"ID":"282c84a8-5c78-4be1-af5c-e0f1b5e249af","Type":"ContainerDied","Data":"0f5e17e15a1951e42c15fca332e7945cce9bb385269296a8d44b628c2ec940ec"} Jul 15 23:00:02.813874 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:02.813561 2560 scope.go:117] "RemoveContainer" containerID="866c179390ff4ed1183881f9ddf343398f02b7f7b7ecfa21553eb30dde60b297" Jul 15 23:00:02.813874 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:02.813680 2560 scope.go:117] "RemoveContainer" containerID="0f5e17e15a1951e42c15fca332e7945cce9bb385269296a8d44b628c2ec940ec" Jul 15 23:00:02.814414 ip-10-0-132-45 kubenswrapper[2560]: E0715 23:00:02.813929 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-derive-ccc4377e-29735940-k5bz6_odh-ai-gateway-infra(282c84a8-5c78-4be1-af5c-e0f1b5e249af)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc4377e-29735940-k5bz6" podUID="282c84a8-5c78-4be1-af5c-e0f1b5e249af" Jul 15 23:00:03.014844 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:03.014812 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-56f79d48-29735940-6s5tk" Jul 15 23:00:03.076182 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:03.076101 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735940-wwqnv" Jul 15 23:00:03.392157 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:03.392071 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c"] Jul 15 23:00:03.392319 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:03.392273 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" podUID="8a5d5092-b39d-4071-82b7-b4ab3026e2b5" containerName="istio-proxy" containerID="cri-o://7d8ec5ead0d068cb5cd3afd1459ef873412acc020f4f2f904f84d5e6110027db" gracePeriod=30 Jul 15 23:00:03.820090 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:03.820055 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-56f79d48-29735940-6s5tk" Jul 15 23:00:03.820090 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:03.820074 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-56f79d48-29735940-6s5tk" event={"ID":"feda4e44-6dc3-4cd4-828a-74997f3fb5e3","Type":"ContainerDied","Data":"373a19fabfbeb52f41ee5749a50342386962045609354bd14dbe3a5a5cbe3640"} Jul 15 23:00:03.820572 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:03.820115 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="373a19fabfbeb52f41ee5749a50342386962045609354bd14dbe3a5a5cbe3640" Jul 15 23:00:03.821973 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:03.821948 2560 scope.go:117] "RemoveContainer" containerID="0f5e17e15a1951e42c15fca332e7945cce9bb385269296a8d44b628c2ec940ec" Jul 15 23:00:03.822227 ip-10-0-132-45 kubenswrapper[2560]: E0715 23:00:03.822204 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-derive-ccc4377e-29735940-k5bz6_odh-ai-gateway-infra(282c84a8-5c78-4be1-af5c-e0f1b5e249af)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc4377e-29735940-k5bz6" podUID="282c84a8-5c78-4be1-af5c-e0f1b5e249af" Jul 15 23:00:03.822967 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:03.822951 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735940-wwqnv" Jul 15 23:00:03.823072 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:03.822989 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735940-wwqnv" event={"ID":"14cab98b-eca1-4b62-978e-bda3b0fbdbb5","Type":"ContainerDied","Data":"907a36dcea2c017db21d6ffaf5a9dba0b62d947511c0cab48b55aaec73de2a5c"} Jul 15 23:00:03.823072 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:03.823025 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="907a36dcea2c017db21d6ffaf5a9dba0b62d947511c0cab48b55aaec73de2a5c" Jul 15 23:00:09.645788 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.645761 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 23:00:09.775778 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.775749 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-credential-socket\") pod \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " Jul 15 23:00:09.775979 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.775789 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istiod-ca-cert\") pod \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " Jul 15 23:00:09.775979 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.775891 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6x88l\" (UniqueName: \"kubernetes.io/projected/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-kube-api-access-6x88l\") pod \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " Jul 15 23:00:09.775979 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.775916 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-workload-socket\") pod \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " Jul 15 23:00:09.775979 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.775941 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istio-envoy\") pod \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " Jul 15 23:00:09.775979 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.775965 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istio-podinfo\") pod \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " Jul 15 23:00:09.776218 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.776011 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istio-data\") pod \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " Jul 15 23:00:09.776218 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.776036 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istio-token\") pod \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " Jul 15 23:00:09.776218 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.776074 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-workload-certs\") pod \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\" (UID: \"8a5d5092-b39d-4071-82b7-b4ab3026e2b5\") " Jul 15 23:00:09.776218 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.776114 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8a5d5092-b39d-4071-82b7-b4ab3026e2b5" (UID: "8a5d5092-b39d-4071-82b7-b4ab3026e2b5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:00:09.776420 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.776314 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8a5d5092-b39d-4071-82b7-b4ab3026e2b5" (UID: "8a5d5092-b39d-4071-82b7-b4ab3026e2b5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 23:00:09.776420 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.776359 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-credential-socket\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:00:09.776560 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.776490 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8a5d5092-b39d-4071-82b7-b4ab3026e2b5" (UID: "8a5d5092-b39d-4071-82b7-b4ab3026e2b5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:00:09.776560 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.776543 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8a5d5092-b39d-4071-82b7-b4ab3026e2b5" (UID: "8a5d5092-b39d-4071-82b7-b4ab3026e2b5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:00:09.777058 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.777026 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istio-data" (OuterVolumeSpecName: "istio-data") pod "8a5d5092-b39d-4071-82b7-b4ab3026e2b5" (UID: "8a5d5092-b39d-4071-82b7-b4ab3026e2b5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:00:09.778271 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.778249 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-kube-api-access-6x88l" (OuterVolumeSpecName: "kube-api-access-6x88l") pod "8a5d5092-b39d-4071-82b7-b4ab3026e2b5" (UID: "8a5d5092-b39d-4071-82b7-b4ab3026e2b5"). InnerVolumeSpecName "kube-api-access-6x88l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:00:09.778374 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.778269 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8a5d5092-b39d-4071-82b7-b4ab3026e2b5" (UID: "8a5d5092-b39d-4071-82b7-b4ab3026e2b5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:00:09.778374 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.778279 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istio-token" (OuterVolumeSpecName: "istio-token") pod "8a5d5092-b39d-4071-82b7-b4ab3026e2b5" (UID: "8a5d5092-b39d-4071-82b7-b4ab3026e2b5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:00:09.778374 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.778317 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8a5d5092-b39d-4071-82b7-b4ab3026e2b5" (UID: "8a5d5092-b39d-4071-82b7-b4ab3026e2b5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 23:00:09.858379 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.858344 2560 generic.go:356] "Generic (PLEG): container finished" podID="8a5d5092-b39d-4071-82b7-b4ab3026e2b5" containerID="7d8ec5ead0d068cb5cd3afd1459ef873412acc020f4f2f904f84d5e6110027db" exitCode=0 Jul 15 23:00:09.858512 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.858389 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" Jul 15 23:00:09.858512 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.858419 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" event={"ID":"8a5d5092-b39d-4071-82b7-b4ab3026e2b5","Type":"ContainerDied","Data":"7d8ec5ead0d068cb5cd3afd1459ef873412acc020f4f2f904f84d5e6110027db"} Jul 15 23:00:09.858512 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.858457 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c" event={"ID":"8a5d5092-b39d-4071-82b7-b4ab3026e2b5","Type":"ContainerDied","Data":"2babc72cc75aa5ca1e839233492cf084612524e416009d47d2e466243342876d"} Jul 15 23:00:09.858512 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.858477 2560 scope.go:117] "RemoveContainer" containerID="7d8ec5ead0d068cb5cd3afd1459ef873412acc020f4f2f904f84d5e6110027db" Jul 15 23:00:09.867346 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.867327 2560 scope.go:117] "RemoveContainer" containerID="7d8ec5ead0d068cb5cd3afd1459ef873412acc020f4f2f904f84d5e6110027db" Jul 15 23:00:09.867558 ip-10-0-132-45 kubenswrapper[2560]: E0715 23:00:09.867538 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d8ec5ead0d068cb5cd3afd1459ef873412acc020f4f2f904f84d5e6110027db\": container with ID starting with 7d8ec5ead0d068cb5cd3afd1459ef873412acc020f4f2f904f84d5e6110027db not found: ID does not exist" containerID="7d8ec5ead0d068cb5cd3afd1459ef873412acc020f4f2f904f84d5e6110027db" Jul 15 23:00:09.867596 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.867571 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d8ec5ead0d068cb5cd3afd1459ef873412acc020f4f2f904f84d5e6110027db"} err="failed to get container status \"7d8ec5ead0d068cb5cd3afd1459ef873412acc020f4f2f904f84d5e6110027db\": rpc error: code = NotFound desc = could not find container \"7d8ec5ead0d068cb5cd3afd1459ef873412acc020f4f2f904f84d5e6110027db\": container with ID starting with 7d8ec5ead0d068cb5cd3afd1459ef873412acc020f4f2f904f84d5e6110027db not found: ID does not exist" Jul 15 23:00:09.877281 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.877266 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istiod-ca-cert\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:00:09.877362 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.877283 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6x88l\" (UniqueName: \"kubernetes.io/projected/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-kube-api-access-6x88l\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:00:09.877362 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.877293 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-workload-socket\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:00:09.877362 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.877301 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istio-envoy\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:00:09.877362 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.877308 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istio-podinfo\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:00:09.877362 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.877315 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istio-data\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:00:09.877362 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.877322 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-istio-token\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:00:09.877362 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.877328 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a5d5092-b39d-4071-82b7-b4ab3026e2b5-workload-certs\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:00:09.901965 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.901945 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c"] Jul 15 23:00:09.918649 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:09.918629 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-ccc4377e-openshift-default-68c95bc5dc-8pf9c"] Jul 15 23:00:10.841461 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:10.841433 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a5d5092-b39d-4071-82b7-b4ab3026e2b5" path="/var/lib/kubelet/pods/8a5d5092-b39d-4071-82b7-b4ab3026e2b5/volumes" Jul 15 23:00:18.835767 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:18.835732 2560 scope.go:117] "RemoveContainer" containerID="0f5e17e15a1951e42c15fca332e7945cce9bb385269296a8d44b628c2ec940ec" Jul 15 23:00:19.919368 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:19.919339 2560 generic.go:356] "Generic (PLEG): container finished" podID="282c84a8-5c78-4be1-af5c-e0f1b5e249af" containerID="1a294ff18a851d11844907724d5b64aa01317fa188f17014f0432be11b585fd2" exitCode=0 Jul 15 23:00:19.919742 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:19.919418 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc4377e-29735940-k5bz6" event={"ID":"282c84a8-5c78-4be1-af5c-e0f1b5e249af","Type":"ContainerDied","Data":"1a294ff18a851d11844907724d5b64aa01317fa188f17014f0432be11b585fd2"} Jul 15 23:00:19.919742 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:19.919503 2560 scope.go:117] "RemoveContainer" containerID="0f5e17e15a1951e42c15fca332e7945cce9bb385269296a8d44b628c2ec940ec" Jul 15 23:00:20.948477 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:20.948445 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc4377e-29735940-k5bz6"] Jul 15 23:00:21.054379 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:21.054356 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc4377e-29735940-k5bz6" Jul 15 23:00:21.932150 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:21.932120 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc4377e-29735940-k5bz6" Jul 15 23:00:21.932336 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:21.932170 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc4377e-29735940-k5bz6" event={"ID":"282c84a8-5c78-4be1-af5c-e0f1b5e249af","Type":"ContainerDied","Data":"d38e27b0e4e91ba568b2b6d4da1cd8d7ff823394929aad1864b4c0fb17a28b81"} Jul 15 23:00:21.932336 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:21.932225 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d38e27b0e4e91ba568b2b6d4da1cd8d7ff823394929aad1864b4c0fb17a28b81" Jul 15 23:00:21.958902 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:21.958872 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc4377e-29735940-k5bz6"] Jul 15 23:00:21.965753 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:21.965725 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc4377e-29735940-k5bz6"] Jul 15 23:00:22.841385 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:00:22.841354 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="282c84a8-5c78-4be1-af5c-e0f1b5e249af" path="/var/lib/kubelet/pods/282c84a8-5c78-4be1-af5c-e0f1b5e249af/volumes" Jul 15 23:01:43.619409 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.619338 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2"] Jul 15 23:01:43.619825 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.619687 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14cab98b-eca1-4b62-978e-bda3b0fbdbb5" containerName="cleanup" Jul 15 23:01:43.619825 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.619699 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="14cab98b-eca1-4b62-978e-bda3b0fbdbb5" containerName="cleanup" Jul 15 23:01:43.619825 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.619717 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="282c84a8-5c78-4be1-af5c-e0f1b5e249af" containerName="cleanup" Jul 15 23:01:43.619825 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.619722 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="282c84a8-5c78-4be1-af5c-e0f1b5e249af" containerName="cleanup" Jul 15 23:01:43.619825 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.619729 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="282c84a8-5c78-4be1-af5c-e0f1b5e249af" containerName="cleanup" Jul 15 23:01:43.619825 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.619734 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="282c84a8-5c78-4be1-af5c-e0f1b5e249af" containerName="cleanup" Jul 15 23:01:43.619825 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.619742 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a5d5092-b39d-4071-82b7-b4ab3026e2b5" containerName="istio-proxy" Jul 15 23:01:43.619825 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.619747 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a5d5092-b39d-4071-82b7-b4ab3026e2b5" containerName="istio-proxy" Jul 15 23:01:43.619825 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.619754 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="282c84a8-5c78-4be1-af5c-e0f1b5e249af" containerName="cleanup" Jul 15 23:01:43.619825 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.619759 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="282c84a8-5c78-4be1-af5c-e0f1b5e249af" containerName="cleanup" Jul 15 23:01:43.619825 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.619767 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feda4e44-6dc3-4cd4-828a-74997f3fb5e3" containerName="cleanup" Jul 15 23:01:43.619825 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.619772 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="feda4e44-6dc3-4cd4-828a-74997f3fb5e3" containerName="cleanup" Jul 15 23:01:43.619825 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.619819 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a5d5092-b39d-4071-82b7-b4ab3026e2b5" containerName="istio-proxy" Jul 15 23:01:43.619825 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.619826 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="282c84a8-5c78-4be1-af5c-e0f1b5e249af" containerName="cleanup" Jul 15 23:01:43.619825 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.619833 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="14cab98b-eca1-4b62-978e-bda3b0fbdbb5" containerName="cleanup" Jul 15 23:01:43.620288 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.619839 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="282c84a8-5c78-4be1-af5c-e0f1b5e249af" containerName="cleanup" Jul 15 23:01:43.620288 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.619845 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="feda4e44-6dc3-4cd4-828a-74997f3fb5e3" containerName="cleanup" Jul 15 23:01:43.620288 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.619870 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="282c84a8-5c78-4be1-af5c-e0f1b5e249af" containerName="cleanup" Jul 15 23:01:43.622830 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.622813 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.625686 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.625666 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-03f59fb7-openshift-default-dockercfg-xgcx8\"" Jul 15 23:01:43.632678 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.632655 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2"] Jul 15 23:01:43.744654 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.744625 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istio-data\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.744834 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.744663 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istio-token\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.744834 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.744698 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-workload-socket\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.744834 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.744770 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istio-podinfo\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.745059 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.744877 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-workload-certs\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.745059 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.744919 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istio-envoy\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.745059 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.744948 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istiod-ca-cert\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.745059 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.744981 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-credential-socket\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.745059 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.745013 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrqw5\" (UniqueName: \"kubernetes.io/projected/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-kube-api-access-vrqw5\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.845702 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.845674 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istio-envoy\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.845895 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.845714 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istiod-ca-cert\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.845895 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.845833 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-credential-socket\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.846024 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.845898 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrqw5\" (UniqueName: \"kubernetes.io/projected/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-kube-api-access-vrqw5\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.846024 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.845932 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istio-data\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.846024 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.845967 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istio-token\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.846024 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.846006 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-workload-socket\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.846222 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.846132 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istio-podinfo\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.846222 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.846212 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-workload-certs\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.846325 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.846305 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istio-data\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.846402 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.846378 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-workload-socket\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.846529 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.846454 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-credential-socket\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.846529 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.846519 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-workload-certs\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.846624 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.846575 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istiod-ca-cert\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.848276 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.848241 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istio-envoy\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.848713 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.848693 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istio-podinfo\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.856403 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.856371 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istio-token\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.856575 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.856557 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrqw5\" (UniqueName: \"kubernetes.io/projected/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-kube-api-access-vrqw5\") pod \"e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:43.933912 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:43.933880 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:44.065553 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:44.065529 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2"] Jul 15 23:01:44.067465 ip-10-0-132-45 kubenswrapper[2560]: W0715 23:01:44.067438 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20fe0795_5ec9_4e7b_b9e3_f8697e8bf724.slice/crio-f32b632fe35ccde951058e271ec045d66c798c9cd18717060372106c4f1829b4 WatchSource:0}: Error finding container f32b632fe35ccde951058e271ec045d66c798c9cd18717060372106c4f1829b4: Status 404 returned error can't find the container with id f32b632fe35ccde951058e271ec045d66c798c9cd18717060372106c4f1829b4 Jul 15 23:01:44.069402 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:44.069371 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:01:44.069465 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:44.069434 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:01:44.069505 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:44.069476 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:01:44.350513 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:44.350429 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" event={"ID":"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724","Type":"ContainerStarted","Data":"ef96cbd80a36630b3b1b9e923c3f2a7581f061655d9da2f29d47d0ca1e177421"} Jul 15 23:01:44.350513 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:44.350484 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" event={"ID":"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724","Type":"ContainerStarted","Data":"f32b632fe35ccde951058e271ec045d66c798c9cd18717060372106c4f1829b4"} Jul 15 23:01:44.370312 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:44.370247 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" podStartSLOduration=1.3702275689999999 podStartE2EDuration="1.370227569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:01:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:01:44.36964626 +0000 UTC m=+1714.077443862" watchObservedRunningTime="2026-07-15 23:01:44.370227569 +0000 UTC m=+1714.078025162" Jul 15 23:01:44.934814 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:44.934776 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:45.455676 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:45.455638 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn"] Jul 15 23:01:45.460290 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:45.460267 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn" Jul 15 23:01:45.462472 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:45.462451 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 15 23:01:45.463107 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:45.463085 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-03f59fb7-serving-cert\"" Jul 15 23:01:45.463107 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:45.463105 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bb4dr\"" Jul 15 23:01:45.463299 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:45.463146 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 23:01:45.468634 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:45.468428 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn"] Jul 15 23:01:45.560176 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:45.560143 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a4e6f69-6521-405c-87d9-ee7354f0c293-openshift-service-ca\") pod \"maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn\" (UID: \"4a4e6f69-6521-405c-87d9-ee7354f0c293\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn" Jul 15 23:01:45.560331 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:45.560188 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a4e6f69-6521-405c-87d9-ee7354f0c293-maas-api-tls\") pod \"maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn\" (UID: \"4a4e6f69-6521-405c-87d9-ee7354f0c293\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn" Jul 15 23:01:45.560331 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:45.560208 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r82dn\" (UniqueName: \"kubernetes.io/projected/4a4e6f69-6521-405c-87d9-ee7354f0c293-kube-api-access-r82dn\") pod \"maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn\" (UID: \"4a4e6f69-6521-405c-87d9-ee7354f0c293\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn" Jul 15 23:01:45.661732 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:45.661698 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a4e6f69-6521-405c-87d9-ee7354f0c293-openshift-service-ca\") pod \"maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn\" (UID: \"4a4e6f69-6521-405c-87d9-ee7354f0c293\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn" Jul 15 23:01:45.661919 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:45.661740 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a4e6f69-6521-405c-87d9-ee7354f0c293-maas-api-tls\") pod \"maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn\" (UID: \"4a4e6f69-6521-405c-87d9-ee7354f0c293\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn" Jul 15 23:01:45.661919 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:45.661757 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r82dn\" (UniqueName: \"kubernetes.io/projected/4a4e6f69-6521-405c-87d9-ee7354f0c293-kube-api-access-r82dn\") pod \"maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn\" (UID: \"4a4e6f69-6521-405c-87d9-ee7354f0c293\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn" Jul 15 23:01:45.661919 ip-10-0-132-45 kubenswrapper[2560]: E0715 23:01:45.661898 2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-03f59fb7-serving-cert: secret "maas-api-e2e-mt-03f59fb7-serving-cert" not found Jul 15 23:01:45.662025 ip-10-0-132-45 kubenswrapper[2560]: E0715 23:01:45.661969 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a4e6f69-6521-405c-87d9-ee7354f0c293-maas-api-tls podName:4a4e6f69-6521-405c-87d9-ee7354f0c293 nodeName:}" failed. No retries permitted until 2026-07-15 23:01:46.161948845 +0000 UTC m=+1715.869746427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4a4e6f69-6521-405c-87d9-ee7354f0c293-maas-api-tls") pod "maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn" (UID: "4a4e6f69-6521-405c-87d9-ee7354f0c293") : secret "maas-api-e2e-mt-03f59fb7-serving-cert" not found Jul 15 23:01:45.662710 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:45.662691 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a4e6f69-6521-405c-87d9-ee7354f0c293-openshift-service-ca\") pod \"maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn\" (UID: \"4a4e6f69-6521-405c-87d9-ee7354f0c293\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn" Jul 15 23:01:45.674557 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:45.674520 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r82dn\" (UniqueName: \"kubernetes.io/projected/4a4e6f69-6521-405c-87d9-ee7354f0c293-kube-api-access-r82dn\") pod \"maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn\" (UID: \"4a4e6f69-6521-405c-87d9-ee7354f0c293\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn" Jul 15 23:01:45.939657 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:45.939628 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:46.166930 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:46.166895 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a4e6f69-6521-405c-87d9-ee7354f0c293-maas-api-tls\") pod \"maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn\" (UID: \"4a4e6f69-6521-405c-87d9-ee7354f0c293\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn" Jul 15 23:01:46.169539 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:46.169518 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a4e6f69-6521-405c-87d9-ee7354f0c293-maas-api-tls\") pod \"maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn\" (UID: \"4a4e6f69-6521-405c-87d9-ee7354f0c293\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn" Jul 15 23:01:46.360051 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:46.359969 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:46.360766 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:46.360748 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:01:46.372482 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:46.372458 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn" Jul 15 23:01:46.505674 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:46.505651 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn"] Jul 15 23:01:46.507403 ip-10-0-132-45 kubenswrapper[2560]: W0715 23:01:46.507369 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a4e6f69_6521_405c_87d9_ee7354f0c293.slice/crio-ec3ee2536db2b474bd29be67643f6e358fa8751ed1bf2c1c4ddc162026ef3375 WatchSource:0}: Error finding container ec3ee2536db2b474bd29be67643f6e358fa8751ed1bf2c1c4ddc162026ef3375: Status 404 returned error can't find the container with id ec3ee2536db2b474bd29be67643f6e358fa8751ed1bf2c1c4ddc162026ef3375 Jul 15 23:01:46.508708 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:46.508690 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 23:01:47.368479 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:47.368440 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn" event={"ID":"4a4e6f69-6521-405c-87d9-ee7354f0c293","Type":"ContainerStarted","Data":"ec3ee2536db2b474bd29be67643f6e358fa8751ed1bf2c1c4ddc162026ef3375"} Jul 15 23:01:49.384392 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:49.384360 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn" event={"ID":"4a4e6f69-6521-405c-87d9-ee7354f0c293","Type":"ContainerStarted","Data":"d5c4c5ec1cd75914c4ac8768b549d0e75940907e5194c9ea3d3c55c952570bf5"} Jul 15 23:01:49.384869 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:49.384472 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn" Jul 15 23:01:49.401760 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:49.401716 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn" podStartSLOduration=2.180763508 podStartE2EDuration="4.401700565s" totalImagesPullingTime="2.220937057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:01:49.399382555 +0000 UTC m=+1719.107180146" watchObservedRunningTime="2026-07-15 23:01:49.401700565 +0000 UTC m=+1719.109498156" Jul 15 23:01:55.396283 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:01:55.396250 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn" Jul 15 23:02:01.539074 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:01.538438 2560 patch_prober.go:28] interesting pod/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": read tcp 10.133.0.2:35412->10.133.0.46:15021: read: connection reset by peer" start-of-body= Jul 15 23:02:01.539074 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:01.538510 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" podUID="20fe0795-5ec9-4e7b-b9e3-f8697e8bf724" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": read tcp 10.133.0.2:35412->10.133.0.46:15021: read: connection reset by peer" Jul 15 23:02:02.453366 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:02.453335 2560 generic.go:356] "Generic (PLEG): container finished" podID="20fe0795-5ec9-4e7b-b9e3-f8697e8bf724" containerID="ef96cbd80a36630b3b1b9e923c3f2a7581f061655d9da2f29d47d0ca1e177421" exitCode=0 Jul 15 23:02:02.453548 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:02.453418 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" event={"ID":"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724","Type":"ContainerDied","Data":"ef96cbd80a36630b3b1b9e923c3f2a7581f061655d9da2f29d47d0ca1e177421"} Jul 15 23:02:02.453836 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:02.453823 2560 scope.go:117] "RemoveContainer" containerID="ef96cbd80a36630b3b1b9e923c3f2a7581f061655d9da2f29d47d0ca1e177421" Jul 15 23:02:02.454777 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:02.454751 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:02:02.454885 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:02.454834 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:02:02.454956 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:02.454907 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:02:03.461905 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:03.461843 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" event={"ID":"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724","Type":"ContainerStarted","Data":"af8bb7f6850aa07424f3b69d4a993d222f749e47b15196cc342ddc1c9dd7dcea"} Jul 15 23:02:03.934383 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:03.934344 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:02:03.934589 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:03.934564 2560 patch_prober.go:28] interesting pod/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 15 23:02:03.934683 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:03.934661 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" podUID="20fe0795-5ec9-4e7b-b9e3-f8697e8bf724" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 15 23:02:04.399533 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:04.399455 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2"] Jul 15 23:02:04.470791 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:04.470748 2560 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" secret="" err="secret \"e2e-mt-03f59fb7-openshift-default-dockercfg-xgcx8\" not found" Jul 15 23:02:04.934597 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:04.934562 2560 patch_prober.go:28] interesting pod/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 15 23:02:04.934770 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:04.934629 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" podUID="20fe0795-5ec9-4e7b-b9e3-f8697e8bf724" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 15 23:02:05.476776 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:05.476736 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" podUID="20fe0795-5ec9-4e7b-b9e3-f8697e8bf724" containerName="istio-proxy" containerID="cri-o://af8bb7f6850aa07424f3b69d4a993d222f749e47b15196cc342ddc1c9dd7dcea" gracePeriod=30 Jul 15 23:02:12.722442 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.722417 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:02:12.836612 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.836546 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istio-token\") pod \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " Jul 15 23:02:12.836612 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.836578 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-workload-socket\") pod \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " Jul 15 23:02:12.836612 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.836596 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istio-podinfo\") pod \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " Jul 15 23:02:12.836908 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.836626 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-credential-socket\") pod \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " Jul 15 23:02:12.836908 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.836708 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istiod-ca-cert\") pod \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " Jul 15 23:02:12.836908 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.836727 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-workload-certs\") pod \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " Jul 15 23:02:12.836908 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.836755 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrqw5\" (UniqueName: \"kubernetes.io/projected/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-kube-api-access-vrqw5\") pod \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " Jul 15 23:02:12.836908 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.836779 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istio-envoy\") pod \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " Jul 15 23:02:12.836908 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.836808 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istio-data\") pod \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\" (UID: \"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724\") " Jul 15 23:02:12.837219 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.837008 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "20fe0795-5ec9-4e7b-b9e3-f8697e8bf724" (UID: "20fe0795-5ec9-4e7b-b9e3-f8697e8bf724"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:02:12.837219 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.836932 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "20fe0795-5ec9-4e7b-b9e3-f8697e8bf724" (UID: "20fe0795-5ec9-4e7b-b9e3-f8697e8bf724"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:02:12.837219 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.837158 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "20fe0795-5ec9-4e7b-b9e3-f8697e8bf724" (UID: "20fe0795-5ec9-4e7b-b9e3-f8697e8bf724"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 23:02:12.837532 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.837371 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "20fe0795-5ec9-4e7b-b9e3-f8697e8bf724" (UID: "20fe0795-5ec9-4e7b-b9e3-f8697e8bf724"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:02:12.837701 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.837680 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istio-data" (OuterVolumeSpecName: "istio-data") pod "20fe0795-5ec9-4e7b-b9e3-f8697e8bf724" (UID: "20fe0795-5ec9-4e7b-b9e3-f8697e8bf724"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:02:12.839086 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.839053 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "20fe0795-5ec9-4e7b-b9e3-f8697e8bf724" (UID: "20fe0795-5ec9-4e7b-b9e3-f8697e8bf724"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 23:02:12.839215 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.839197 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istio-token" (OuterVolumeSpecName: "istio-token") pod "20fe0795-5ec9-4e7b-b9e3-f8697e8bf724" (UID: "20fe0795-5ec9-4e7b-b9e3-f8697e8bf724"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:02:12.839589 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.839563 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-kube-api-access-vrqw5" (OuterVolumeSpecName: "kube-api-access-vrqw5") pod "20fe0795-5ec9-4e7b-b9e3-f8697e8bf724" (UID: "20fe0795-5ec9-4e7b-b9e3-f8697e8bf724"). InnerVolumeSpecName "kube-api-access-vrqw5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:02:12.839589 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.839569 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "20fe0795-5ec9-4e7b-b9e3-f8697e8bf724" (UID: "20fe0795-5ec9-4e7b-b9e3-f8697e8bf724"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:02:12.938199 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.938165 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-workload-certs\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:02:12.938199 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.938194 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrqw5\" (UniqueName: \"kubernetes.io/projected/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-kube-api-access-vrqw5\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:02:12.938379 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.938209 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istio-envoy\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:02:12.938379 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.938220 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istio-data\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:02:12.938379 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.938230 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istio-token\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:02:12.938379 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.938240 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-workload-socket\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:02:12.938379 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.938251 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istio-podinfo\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:02:12.938379 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.938262 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-credential-socket\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:02:12.938379 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:12.938272 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724-istiod-ca-cert\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:02:13.523310 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:13.523279 2560 generic.go:356] "Generic (PLEG): container finished" podID="20fe0795-5ec9-4e7b-b9e3-f8697e8bf724" containerID="af8bb7f6850aa07424f3b69d4a993d222f749e47b15196cc342ddc1c9dd7dcea" exitCode=0 Jul 15 23:02:13.523498 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:13.523329 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" Jul 15 23:02:13.523498 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:13.523365 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" event={"ID":"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724","Type":"ContainerDied","Data":"af8bb7f6850aa07424f3b69d4a993d222f749e47b15196cc342ddc1c9dd7dcea"} Jul 15 23:02:13.523498 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:13.523423 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2" event={"ID":"20fe0795-5ec9-4e7b-b9e3-f8697e8bf724","Type":"ContainerDied","Data":"f32b632fe35ccde951058e271ec045d66c798c9cd18717060372106c4f1829b4"} Jul 15 23:02:13.523498 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:13.523445 2560 scope.go:117] "RemoveContainer" containerID="af8bb7f6850aa07424f3b69d4a993d222f749e47b15196cc342ddc1c9dd7dcea" Jul 15 23:02:13.532298 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:13.532283 2560 scope.go:117] "RemoveContainer" containerID="ef96cbd80a36630b3b1b9e923c3f2a7581f061655d9da2f29d47d0ca1e177421" Jul 15 23:02:13.540453 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:13.540435 2560 scope.go:117] "RemoveContainer" containerID="af8bb7f6850aa07424f3b69d4a993d222f749e47b15196cc342ddc1c9dd7dcea" Jul 15 23:02:13.540695 ip-10-0-132-45 kubenswrapper[2560]: E0715 23:02:13.540676 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af8bb7f6850aa07424f3b69d4a993d222f749e47b15196cc342ddc1c9dd7dcea\": container with ID starting with af8bb7f6850aa07424f3b69d4a993d222f749e47b15196cc342ddc1c9dd7dcea not found: ID does not exist" containerID="af8bb7f6850aa07424f3b69d4a993d222f749e47b15196cc342ddc1c9dd7dcea" Jul 15 23:02:13.540756 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:13.540703 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af8bb7f6850aa07424f3b69d4a993d222f749e47b15196cc342ddc1c9dd7dcea"} err="failed to get container status \"af8bb7f6850aa07424f3b69d4a993d222f749e47b15196cc342ddc1c9dd7dcea\": rpc error: code = NotFound desc = could not find container \"af8bb7f6850aa07424f3b69d4a993d222f749e47b15196cc342ddc1c9dd7dcea\": container with ID starting with af8bb7f6850aa07424f3b69d4a993d222f749e47b15196cc342ddc1c9dd7dcea not found: ID does not exist" Jul 15 23:02:13.540756 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:13.540719 2560 scope.go:117] "RemoveContainer" containerID="ef96cbd80a36630b3b1b9e923c3f2a7581f061655d9da2f29d47d0ca1e177421" Jul 15 23:02:13.540993 ip-10-0-132-45 kubenswrapper[2560]: E0715 23:02:13.540973 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef96cbd80a36630b3b1b9e923c3f2a7581f061655d9da2f29d47d0ca1e177421\": container with ID starting with ef96cbd80a36630b3b1b9e923c3f2a7581f061655d9da2f29d47d0ca1e177421 not found: ID does not exist" containerID="ef96cbd80a36630b3b1b9e923c3f2a7581f061655d9da2f29d47d0ca1e177421" Jul 15 23:02:13.541079 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:13.540994 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef96cbd80a36630b3b1b9e923c3f2a7581f061655d9da2f29d47d0ca1e177421"} err="failed to get container status \"ef96cbd80a36630b3b1b9e923c3f2a7581f061655d9da2f29d47d0ca1e177421\": rpc error: code = NotFound desc = could not find container \"ef96cbd80a36630b3b1b9e923c3f2a7581f061655d9da2f29d47d0ca1e177421\": container with ID starting with ef96cbd80a36630b3b1b9e923c3f2a7581f061655d9da2f29d47d0ca1e177421 not found: ID does not exist" Jul 15 23:02:13.541161 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:13.541143 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2"] Jul 15 23:02:13.544654 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:13.544636 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-03f59fb7-openshift-default-d68775bb7-jxgp2"] Jul 15 23:02:14.840624 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:02:14.840583 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20fe0795-5ec9-4e7b-b9e3-f8697e8bf724" path="/var/lib/kubelet/pods/20fe0795-5ec9-4e7b-b9e3-f8697e8bf724/volumes" Jul 15 23:03:10.888825 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:10.888784 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5q8kf_d57dc934-8cdc-4f82-8ee8-527f9cc60a41/console-operator/1.log" Jul 15 23:03:10.891334 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:10.891299 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5q8kf_d57dc934-8cdc-4f82-8ee8-527f9cc60a41/console-operator/1.log" Jul 15 23:03:10.893469 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:10.893448 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/ovn-acl-logging/0.log" Jul 15 23:03:10.895599 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:10.895579 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/ovn-acl-logging/0.log" Jul 15 23:03:17.534077 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.534040 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9"] Jul 15 23:03:17.534523 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.534495 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20fe0795-5ec9-4e7b-b9e3-f8697e8bf724" containerName="istio-proxy" Jul 15 23:03:17.534523 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.534512 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="20fe0795-5ec9-4e7b-b9e3-f8697e8bf724" containerName="istio-proxy" Jul 15 23:03:17.534653 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.534641 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="20fe0795-5ec9-4e7b-b9e3-f8697e8bf724" containerName="istio-proxy" Jul 15 23:03:17.537472 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.537450 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.540065 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.540045 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-83ad46-openshift-default-dockercfg-7whf4\"" Jul 15 23:03:17.552896 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.552845 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9"] Jul 15 23:03:17.632237 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.632204 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-credential-socket\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.632382 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.632245 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-workload-certs\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.632382 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.632280 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsnrv\" (UniqueName: \"kubernetes.io/projected/6ff8e559-c5af-48ea-b5c5-5891d82638ba-kube-api-access-lsnrv\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.632382 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.632303 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istio-data\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.632382 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.632341 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istio-token\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.632549 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.632381 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istio-podinfo\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.632549 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.632421 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-workload-socket\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.632549 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.632466 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istiod-ca-cert\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.632549 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.632498 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istio-envoy\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.732915 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.732887 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istio-token\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.733090 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.732927 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istio-podinfo\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.733090 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.732971 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-workload-socket\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.733090 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.733031 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istiod-ca-cert\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.733090 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.733073 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istio-envoy\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.733302 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.733104 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-credential-socket\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.733302 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.733137 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-workload-certs\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.733302 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.733174 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsnrv\" (UniqueName: \"kubernetes.io/projected/6ff8e559-c5af-48ea-b5c5-5891d82638ba-kube-api-access-lsnrv\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.733302 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.733201 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istio-data\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.733740 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.733620 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-credential-socket\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.733740 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.733684 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istio-data\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.733937 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.733754 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-workload-socket\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.733937 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.733911 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istiod-ca-cert\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.734275 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.734131 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-workload-certs\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.735913 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.735872 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istio-envoy\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.736560 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.736530 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istio-podinfo\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.742589 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.742571 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsnrv\" (UniqueName: \"kubernetes.io/projected/6ff8e559-c5af-48ea-b5c5-5891d82638ba-kube-api-access-lsnrv\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.742589 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.742583 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istio-token\") pod \"e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.847145 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.847079 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:17.986341 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.986313 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9"] Jul 15 23:03:17.988175 ip-10-0-132-45 kubenswrapper[2560]: W0715 23:03:17.988143 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ff8e559_c5af_48ea_b5c5_5891d82638ba.slice/crio-bf1f77a0b5b657f2268b2e629a2fa5884b2aa8e2b6ebf5987625f15c6d8437b8 WatchSource:0}: Error finding container bf1f77a0b5b657f2268b2e629a2fa5884b2aa8e2b6ebf5987625f15c6d8437b8: Status 404 returned error can't find the container with id bf1f77a0b5b657f2268b2e629a2fa5884b2aa8e2b6ebf5987625f15c6d8437b8 Jul 15 23:03:17.990442 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.990411 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:03:17.990517 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.990481 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:03:17.990517 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:17.990510 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:03:18.868119 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:18.868080 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" event={"ID":"6ff8e559-c5af-48ea-b5c5-5891d82638ba","Type":"ContainerStarted","Data":"adc416862d6f870d879cc838fdb9635e3b5b3f4c7ff626f83d9374f1c0180f4a"} Jul 15 23:03:18.868503 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:18.868138 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" event={"ID":"6ff8e559-c5af-48ea-b5c5-5891d82638ba","Type":"ContainerStarted","Data":"bf1f77a0b5b657f2268b2e629a2fa5884b2aa8e2b6ebf5987625f15c6d8437b8"} Jul 15 23:03:18.891155 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:18.891102 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" podStartSLOduration=1.891088169 podStartE2EDuration="1.891088169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:03:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:03:18.888116949 +0000 UTC m=+1808.595914540" watchObservedRunningTime="2026-07-15 23:03:18.891088169 +0000 UTC m=+1808.598885759" Jul 15 23:03:19.847671 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:19.847637 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:19.852811 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:19.852783 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:19.874095 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:19.874071 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:19.874820 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:19.874802 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:19.962067 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:19.962037 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h"] Jul 15 23:03:19.962428 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:19.962414 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20fe0795-5ec9-4e7b-b9e3-f8697e8bf724" containerName="istio-proxy" Jul 15 23:03:19.962475 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:19.962431 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="20fe0795-5ec9-4e7b-b9e3-f8697e8bf724" containerName="istio-proxy" Jul 15 23:03:19.962508 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:19.962492 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="20fe0795-5ec9-4e7b-b9e3-f8697e8bf724" containerName="istio-proxy" Jul 15 23:03:19.965929 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:19.965906 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h" Jul 15 23:03:19.969205 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:19.969182 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-83ad46-serving-cert\"" Jul 15 23:03:20.000086 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:20.000062 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h"] Jul 15 23:03:20.050421 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:20.050396 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0291c7d1-5d95-405b-bbca-832b5eabda26-openshift-service-ca\") pod \"maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h\" (UID: \"0291c7d1-5d95-405b-bbca-832b5eabda26\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h" Jul 15 23:03:20.050581 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:20.050431 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7kg5\" (UniqueName: \"kubernetes.io/projected/0291c7d1-5d95-405b-bbca-832b5eabda26-kube-api-access-w7kg5\") pod \"maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h\" (UID: \"0291c7d1-5d95-405b-bbca-832b5eabda26\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h" Jul 15 23:03:20.050581 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:20.050523 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0291c7d1-5d95-405b-bbca-832b5eabda26-maas-api-tls\") pod \"maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h\" (UID: \"0291c7d1-5d95-405b-bbca-832b5eabda26\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h" Jul 15 23:03:20.151046 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:20.150950 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0291c7d1-5d95-405b-bbca-832b5eabda26-openshift-service-ca\") pod \"maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h\" (UID: \"0291c7d1-5d95-405b-bbca-832b5eabda26\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h" Jul 15 23:03:20.151046 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:20.150985 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7kg5\" (UniqueName: \"kubernetes.io/projected/0291c7d1-5d95-405b-bbca-832b5eabda26-kube-api-access-w7kg5\") pod \"maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h\" (UID: \"0291c7d1-5d95-405b-bbca-832b5eabda26\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h" Jul 15 23:03:20.151046 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:20.151042 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0291c7d1-5d95-405b-bbca-832b5eabda26-maas-api-tls\") pod \"maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h\" (UID: \"0291c7d1-5d95-405b-bbca-832b5eabda26\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h" Jul 15 23:03:20.151628 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:20.151603 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0291c7d1-5d95-405b-bbca-832b5eabda26-openshift-service-ca\") pod \"maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h\" (UID: \"0291c7d1-5d95-405b-bbca-832b5eabda26\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h" Jul 15 23:03:20.153422 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:20.153403 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0291c7d1-5d95-405b-bbca-832b5eabda26-maas-api-tls\") pod \"maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h\" (UID: \"0291c7d1-5d95-405b-bbca-832b5eabda26\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h" Jul 15 23:03:20.159176 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:20.159153 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7kg5\" (UniqueName: \"kubernetes.io/projected/0291c7d1-5d95-405b-bbca-832b5eabda26-kube-api-access-w7kg5\") pod \"maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h\" (UID: \"0291c7d1-5d95-405b-bbca-832b5eabda26\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h" Jul 15 23:03:20.278412 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:20.278382 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h" Jul 15 23:03:20.412209 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:20.412183 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h"] Jul 15 23:03:20.413760 ip-10-0-132-45 kubenswrapper[2560]: W0715 23:03:20.413733 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0291c7d1_5d95_405b_bbca_832b5eabda26.slice/crio-4deacb38a65f6266a786ec11dfc00cb630569656f98a3e79701cb34a1deb719a WatchSource:0}: Error finding container 4deacb38a65f6266a786ec11dfc00cb630569656f98a3e79701cb34a1deb719a: Status 404 returned error can't find the container with id 4deacb38a65f6266a786ec11dfc00cb630569656f98a3e79701cb34a1deb719a Jul 15 23:03:20.880085 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:20.880060 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h" event={"ID":"0291c7d1-5d95-405b-bbca-832b5eabda26","Type":"ContainerStarted","Data":"4deacb38a65f6266a786ec11dfc00cb630569656f98a3e79701cb34a1deb719a"} Jul 15 23:03:21.886202 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:21.886166 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h" event={"ID":"0291c7d1-5d95-405b-bbca-832b5eabda26","Type":"ContainerStarted","Data":"0332c4ee9ddab15e49406447253183bfc6786d2102bbfab58dc5c701c9704b8b"} Jul 15 23:03:21.886576 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:21.886335 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h" Jul 15 23:03:21.904319 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:21.904270 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h" podStartSLOduration=2.480023347 podStartE2EDuration="2.904255948s" totalImagesPullingTime="424.232601ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:03:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:03:21.901570184 +0000 UTC m=+1811.609367772" watchObservedRunningTime="2026-07-15 23:03:21.904255948 +0000 UTC m=+1811.612053538" Jul 15 23:03:25.902142 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:25.902109 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4"] Jul 15 23:03:25.905943 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:25.905924 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:25.908313 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:25.908291 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-2b485c-openshift-default-dockercfg-xsf7x\"" Jul 15 23:03:25.918521 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:25.918496 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4"] Jul 15 23:03:26.001276 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.001225 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/986c9913-f98a-45ae-a3e8-7ff6454ee109-istiod-ca-cert\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.001276 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.001276 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-istio-envoy\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.001561 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.001348 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-istio-data\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.001561 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.001372 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-workload-certs\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.001561 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.001408 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/986c9913-f98a-45ae-a3e8-7ff6454ee109-istio-token\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.001561 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.001455 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dlnh\" (UniqueName: \"kubernetes.io/projected/986c9913-f98a-45ae-a3e8-7ff6454ee109-kube-api-access-9dlnh\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.001561 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.001530 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-credential-socket\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.001899 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.001585 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-workload-socket\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.001899 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.001648 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/986c9913-f98a-45ae-a3e8-7ff6454ee109-istio-podinfo\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.102251 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.102217 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-workload-socket\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.102498 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.102262 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/986c9913-f98a-45ae-a3e8-7ff6454ee109-istio-podinfo\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.102498 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.102295 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/986c9913-f98a-45ae-a3e8-7ff6454ee109-istiod-ca-cert\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.102498 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.102317 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-istio-envoy\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.102498 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.102371 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-istio-data\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.102498 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.102397 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-workload-certs\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.102764 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.102507 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/986c9913-f98a-45ae-a3e8-7ff6454ee109-istio-token\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.102764 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.102623 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dlnh\" (UniqueName: \"kubernetes.io/projected/986c9913-f98a-45ae-a3e8-7ff6454ee109-kube-api-access-9dlnh\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.102764 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.102684 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-credential-socket\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.102764 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.102741 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-workload-socket\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.103008 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.102893 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-workload-certs\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.103068 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.103019 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-credential-socket\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.103122 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.103096 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-istio-data\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.103241 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.103222 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/986c9913-f98a-45ae-a3e8-7ff6454ee109-istiod-ca-cert\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.105204 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.105184 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-istio-envoy\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.105412 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.105394 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/986c9913-f98a-45ae-a3e8-7ff6454ee109-istio-podinfo\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.111135 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.111114 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/986c9913-f98a-45ae-a3e8-7ff6454ee109-istio-token\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.111340 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.111322 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dlnh\" (UniqueName: \"kubernetes.io/projected/986c9913-f98a-45ae-a3e8-7ff6454ee109-kube-api-access-9dlnh\") pod \"e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.217067 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.217039 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:26.354840 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.354813 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4"] Jul 15 23:03:26.356638 ip-10-0-132-45 kubenswrapper[2560]: W0715 23:03:26.356609 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod986c9913_f98a_45ae_a3e8_7ff6454ee109.slice/crio-234a36de16fcf56f86d8431319f57a9e0f3f4bdb608add98f182afd7ff04b681 WatchSource:0}: Error finding container 234a36de16fcf56f86d8431319f57a9e0f3f4bdb608add98f182afd7ff04b681: Status 404 returned error can't find the container with id 234a36de16fcf56f86d8431319f57a9e0f3f4bdb608add98f182afd7ff04b681 Jul 15 23:03:26.358626 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.358600 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:03:26.358690 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.358660 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:03:26.358730 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.358689 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:03:26.913606 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.913569 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" event={"ID":"986c9913-f98a-45ae-a3e8-7ff6454ee109","Type":"ContainerStarted","Data":"67c11f5ec7254175a2bb5bddfc914d4831483eb5d674f93002e7643b80b674a6"} Jul 15 23:03:26.914065 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.913618 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" event={"ID":"986c9913-f98a-45ae-a3e8-7ff6454ee109","Type":"ContainerStarted","Data":"234a36de16fcf56f86d8431319f57a9e0f3f4bdb608add98f182afd7ff04b681"} Jul 15 23:03:26.937331 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:26.937285 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" podStartSLOduration=1.937272079 podStartE2EDuration="1.937272079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:03:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:03:26.934797988 +0000 UTC m=+1816.642595590" watchObservedRunningTime="2026-07-15 23:03:26.937272079 +0000 UTC m=+1816.645069669" Jul 15 23:03:27.217565 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:27.217527 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:27.222727 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:27.222700 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:27.897867 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:27.897822 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h" Jul 15 23:03:27.919648 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:27.919610 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:27.925711 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:27.925684 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:28.146677 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:28.146646 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2b485c-664f799997-nbtj6"] Jul 15 23:03:28.150268 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:28.150204 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b485c-664f799997-nbtj6" Jul 15 23:03:28.153330 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:28.153305 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-2b485c-serving-cert\"" Jul 15 23:03:28.168606 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:28.168583 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2b485c-664f799997-nbtj6"] Jul 15 23:03:28.220528 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:28.220498 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a891ec6-b8bf-4dc7-b86a-e6ed0f06597a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2b485c-664f799997-nbtj6\" (UID: \"6a891ec6-b8bf-4dc7-b86a-e6ed0f06597a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b485c-664f799997-nbtj6" Jul 15 23:03:28.220640 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:28.220563 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5dhl\" (UniqueName: \"kubernetes.io/projected/6a891ec6-b8bf-4dc7-b86a-e6ed0f06597a-kube-api-access-c5dhl\") pod \"maas-api-e2e-inf-b-2b485c-664f799997-nbtj6\" (UID: \"6a891ec6-b8bf-4dc7-b86a-e6ed0f06597a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b485c-664f799997-nbtj6" Jul 15 23:03:28.220693 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:28.220655 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a891ec6-b8bf-4dc7-b86a-e6ed0f06597a-maas-api-tls\") pod \"maas-api-e2e-inf-b-2b485c-664f799997-nbtj6\" (UID: \"6a891ec6-b8bf-4dc7-b86a-e6ed0f06597a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b485c-664f799997-nbtj6" Jul 15 23:03:28.321388 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:28.321359 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a891ec6-b8bf-4dc7-b86a-e6ed0f06597a-maas-api-tls\") pod \"maas-api-e2e-inf-b-2b485c-664f799997-nbtj6\" (UID: \"6a891ec6-b8bf-4dc7-b86a-e6ed0f06597a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b485c-664f799997-nbtj6" Jul 15 23:03:28.321567 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:28.321407 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a891ec6-b8bf-4dc7-b86a-e6ed0f06597a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2b485c-664f799997-nbtj6\" (UID: \"6a891ec6-b8bf-4dc7-b86a-e6ed0f06597a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b485c-664f799997-nbtj6" Jul 15 23:03:28.321634 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:28.321615 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5dhl\" (UniqueName: \"kubernetes.io/projected/6a891ec6-b8bf-4dc7-b86a-e6ed0f06597a-kube-api-access-c5dhl\") pod \"maas-api-e2e-inf-b-2b485c-664f799997-nbtj6\" (UID: \"6a891ec6-b8bf-4dc7-b86a-e6ed0f06597a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b485c-664f799997-nbtj6" Jul 15 23:03:28.322183 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:28.322165 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a891ec6-b8bf-4dc7-b86a-e6ed0f06597a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2b485c-664f799997-nbtj6\" (UID: \"6a891ec6-b8bf-4dc7-b86a-e6ed0f06597a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b485c-664f799997-nbtj6" Jul 15 23:03:28.324042 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:28.324024 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a891ec6-b8bf-4dc7-b86a-e6ed0f06597a-maas-api-tls\") pod \"maas-api-e2e-inf-b-2b485c-664f799997-nbtj6\" (UID: \"6a891ec6-b8bf-4dc7-b86a-e6ed0f06597a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b485c-664f799997-nbtj6" Jul 15 23:03:28.333912 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:28.333888 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5dhl\" (UniqueName: \"kubernetes.io/projected/6a891ec6-b8bf-4dc7-b86a-e6ed0f06597a-kube-api-access-c5dhl\") pod \"maas-api-e2e-inf-b-2b485c-664f799997-nbtj6\" (UID: \"6a891ec6-b8bf-4dc7-b86a-e6ed0f06597a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b485c-664f799997-nbtj6" Jul 15 23:03:28.461019 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:28.460994 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b485c-664f799997-nbtj6" Jul 15 23:03:28.609271 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:28.609208 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2b485c-664f799997-nbtj6"] Jul 15 23:03:28.610799 ip-10-0-132-45 kubenswrapper[2560]: W0715 23:03:28.610770 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a891ec6_b8bf_4dc7_b86a_e6ed0f06597a.slice/crio-e2e30a9b2f94ba6ccbfef5ab28406a7b5bba87f2a9709aea24ccc5742a203287 WatchSource:0}: Error finding container e2e30a9b2f94ba6ccbfef5ab28406a7b5bba87f2a9709aea24ccc5742a203287: Status 404 returned error can't find the container with id e2e30a9b2f94ba6ccbfef5ab28406a7b5bba87f2a9709aea24ccc5742a203287 Jul 15 23:03:28.927501 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:28.927449 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b485c-664f799997-nbtj6" event={"ID":"6a891ec6-b8bf-4dc7-b86a-e6ed0f06597a","Type":"ContainerStarted","Data":"e2e30a9b2f94ba6ccbfef5ab28406a7b5bba87f2a9709aea24ccc5742a203287"} Jul 15 23:03:29.934000 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:29.933964 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b485c-664f799997-nbtj6" event={"ID":"6a891ec6-b8bf-4dc7-b86a-e6ed0f06597a","Type":"ContainerStarted","Data":"b788b49a049effc2686f967e0cfede7acd782c4bf61b7f7725ae0890d97db3f6"} Jul 15 23:03:29.951396 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:29.951342 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b485c-664f799997-nbtj6" podStartSLOduration=1.6212509800000001 podStartE2EDuration="1.951324988s" totalImagesPullingTime="330.074008ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:03:29.95061164 +0000 UTC m=+1819.658409231" watchObservedRunningTime="2026-07-15 23:03:29.951324988 +0000 UTC m=+1819.659122578" Jul 15 23:03:30.938901 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:30.938871 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b485c-664f799997-nbtj6" Jul 15 23:03:35.917076 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:35.917023 2560 patch_prober.go:28] interesting pod/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 15 23:03:35.917578 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:35.917096 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" podUID="6ff8e559-c5af-48ea-b5c5-5891d82638ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 15 23:03:36.949280 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:36.949246 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b485c-664f799997-nbtj6" Jul 15 23:03:37.981579 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:37.981540 2560 generic.go:356] "Generic (PLEG): container finished" podID="6ff8e559-c5af-48ea-b5c5-5891d82638ba" containerID="adc416862d6f870d879cc838fdb9635e3b5b3f4c7ff626f83d9374f1c0180f4a" exitCode=0 Jul 15 23:03:37.982030 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:37.981618 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" event={"ID":"6ff8e559-c5af-48ea-b5c5-5891d82638ba","Type":"ContainerDied","Data":"adc416862d6f870d879cc838fdb9635e3b5b3f4c7ff626f83d9374f1c0180f4a"} Jul 15 23:03:37.982072 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:37.982030 2560 scope.go:117] "RemoveContainer" containerID="adc416862d6f870d879cc838fdb9635e3b5b3f4c7ff626f83d9374f1c0180f4a" Jul 15 23:03:37.983081 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:37.983056 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:03:37.983156 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:37.983120 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:03:37.983156 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:37.983152 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:03:38.992598 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:38.992551 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" event={"ID":"6ff8e559-c5af-48ea-b5c5-5891d82638ba","Type":"ContainerStarted","Data":"1c5c1f124b706b38be286298ef093d94d0966024fec553b4ea8292e4ea64d631"} Jul 15 23:03:39.847830 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:39.847789 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:39.848131 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:39.847975 2560 patch_prober.go:28] interesting pod/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 15 23:03:39.848131 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:39.848024 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" podUID="6ff8e559-c5af-48ea-b5c5-5891d82638ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 15 23:03:40.847869 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:40.847819 2560 patch_prober.go:28] interesting pod/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 15 23:03:40.848237 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:40.847893 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" podUID="6ff8e559-c5af-48ea-b5c5-5891d82638ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 15 23:03:41.848340 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:41.848307 2560 patch_prober.go:28] interesting pod/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 15 23:03:41.848810 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:41.848373 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" podUID="6ff8e559-c5af-48ea-b5c5-5891d82638ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 15 23:03:42.868687 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:42.868650 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:42.869200 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:42.869066 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:42.873254 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:42.873226 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:03:43.961055 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:43.961016 2560 patch_prober.go:28] interesting pod/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 15 23:03:43.961512 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:43.961092 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" podUID="986c9913-f98a-45ae-a3e8-7ff6454ee109" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 15 23:03:45.028591 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:45.028509 2560 generic.go:356] "Generic (PLEG): container finished" podID="986c9913-f98a-45ae-a3e8-7ff6454ee109" containerID="67c11f5ec7254175a2bb5bddfc914d4831483eb5d674f93002e7643b80b674a6" exitCode=0 Jul 15 23:03:45.029103 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:45.028581 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" event={"ID":"986c9913-f98a-45ae-a3e8-7ff6454ee109","Type":"ContainerDied","Data":"67c11f5ec7254175a2bb5bddfc914d4831483eb5d674f93002e7643b80b674a6"} Jul 15 23:03:45.029103 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:45.028970 2560 scope.go:117] "RemoveContainer" containerID="67c11f5ec7254175a2bb5bddfc914d4831483eb5d674f93002e7643b80b674a6" Jul 15 23:03:45.029980 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:45.029955 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:03:45.030050 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:45.030020 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:03:45.030087 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:45.030050 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:03:46.036344 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:46.036305 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" event={"ID":"986c9913-f98a-45ae-a3e8-7ff6454ee109","Type":"ContainerStarted","Data":"ee48c6340a04d3fc1497b0a259566d153f872361be76e8234a723768ee4ce3be"} Jul 15 23:03:46.217210 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:46.217175 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:46.217377 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:46.217342 2560 patch_prober.go:28] interesting pod/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 15 23:03:46.217430 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:46.217388 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" podUID="986c9913-f98a-45ae-a3e8-7ff6454ee109" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 15 23:03:47.218154 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:47.218121 2560 patch_prober.go:28] interesting pod/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 15 23:03:47.218578 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:47.218174 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" podUID="986c9913-f98a-45ae-a3e8-7ff6454ee109" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 15 23:03:48.218018 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:48.217982 2560 patch_prober.go:28] interesting pod/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 15 23:03:48.218173 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:48.218039 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" podUID="986c9913-f98a-45ae-a3e8-7ff6454ee109" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 15 23:03:49.218179 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:49.218140 2560 patch_prober.go:28] interesting pod/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 15 23:03:49.218567 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:49.218206 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" podUID="986c9913-f98a-45ae-a3e8-7ff6454ee109" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 15 23:03:50.221149 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:50.221121 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:50.221612 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:50.221593 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:03:50.222143 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:03:50.222124 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:05:10.155993 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:10.155961 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9"] Jul 15 23:05:10.156440 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:10.156171 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" podUID="6ff8e559-c5af-48ea-b5c5-5891d82638ba" containerName="istio-proxy" containerID="cri-o://1c5c1f124b706b38be286298ef093d94d0966024fec553b4ea8292e4ea64d631" gracePeriod=30 Jul 15 23:05:12.871234 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:12.871196 2560 patch_prober.go:28] interesting pod/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 23:05:12.871611 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:12.871260 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" podUID="6ff8e559-c5af-48ea-b5c5-5891d82638ba" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 23:05:15.410997 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.410973 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:05:15.494387 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.494358 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istio-podinfo\") pod \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " Jul 15 23:05:15.494555 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.494428 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istiod-ca-cert\") pod \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " Jul 15 23:05:15.494555 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.494518 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istio-token\") pod \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " Jul 15 23:05:15.494649 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.494565 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsnrv\" (UniqueName: \"kubernetes.io/projected/6ff8e559-c5af-48ea-b5c5-5891d82638ba-kube-api-access-lsnrv\") pod \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " Jul 15 23:05:15.494649 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.494595 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-workload-socket\") pod \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " Jul 15 23:05:15.494649 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.494636 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-workload-certs\") pod \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " Jul 15 23:05:15.494794 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.494689 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-credential-socket\") pod \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " Jul 15 23:05:15.494794 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.494721 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istio-data\") pod \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " Jul 15 23:05:15.494794 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.494754 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istio-envoy\") pod \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\" (UID: \"6ff8e559-c5af-48ea-b5c5-5891d82638ba\") " Jul 15 23:05:15.494986 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.494826 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6ff8e559-c5af-48ea-b5c5-5891d82638ba" (UID: "6ff8e559-c5af-48ea-b5c5-5891d82638ba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 23:05:15.494986 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.494920 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6ff8e559-c5af-48ea-b5c5-5891d82638ba" (UID: "6ff8e559-c5af-48ea-b5c5-5891d82638ba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:05:15.495179 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.495138 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istiod-ca-cert\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:15.495179 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.495160 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-workload-socket\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:15.495354 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.495108 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6ff8e559-c5af-48ea-b5c5-5891d82638ba" (UID: "6ff8e559-c5af-48ea-b5c5-5891d82638ba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:05:15.495430 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.495410 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6ff8e559-c5af-48ea-b5c5-5891d82638ba" (UID: "6ff8e559-c5af-48ea-b5c5-5891d82638ba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:05:15.495770 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.495751 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istio-data" (OuterVolumeSpecName: "istio-data") pod "6ff8e559-c5af-48ea-b5c5-5891d82638ba" (UID: "6ff8e559-c5af-48ea-b5c5-5891d82638ba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:05:15.496742 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.496725 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6ff8e559-c5af-48ea-b5c5-5891d82638ba" (UID: "6ff8e559-c5af-48ea-b5c5-5891d82638ba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 23:05:15.497015 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.497000 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6ff8e559-c5af-48ea-b5c5-5891d82638ba" (UID: "6ff8e559-c5af-48ea-b5c5-5891d82638ba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:05:15.497209 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.497188 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ff8e559-c5af-48ea-b5c5-5891d82638ba-kube-api-access-lsnrv" (OuterVolumeSpecName: "kube-api-access-lsnrv") pod "6ff8e559-c5af-48ea-b5c5-5891d82638ba" (UID: "6ff8e559-c5af-48ea-b5c5-5891d82638ba"). InnerVolumeSpecName "kube-api-access-lsnrv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:05:15.497258 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.497209 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istio-token" (OuterVolumeSpecName: "istio-token") pod "6ff8e559-c5af-48ea-b5c5-5891d82638ba" (UID: "6ff8e559-c5af-48ea-b5c5-5891d82638ba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:05:15.521524 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.521496 2560 generic.go:356] "Generic (PLEG): container finished" podID="6ff8e559-c5af-48ea-b5c5-5891d82638ba" containerID="1c5c1f124b706b38be286298ef093d94d0966024fec553b4ea8292e4ea64d631" exitCode=0 Jul 15 23:05:15.521666 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.521545 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" Jul 15 23:05:15.521666 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.521579 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" event={"ID":"6ff8e559-c5af-48ea-b5c5-5891d82638ba","Type":"ContainerDied","Data":"1c5c1f124b706b38be286298ef093d94d0966024fec553b4ea8292e4ea64d631"} Jul 15 23:05:15.521666 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.521635 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9" event={"ID":"6ff8e559-c5af-48ea-b5c5-5891d82638ba","Type":"ContainerDied","Data":"bf1f77a0b5b657f2268b2e629a2fa5884b2aa8e2b6ebf5987625f15c6d8437b8"} Jul 15 23:05:15.521666 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.521658 2560 scope.go:117] "RemoveContainer" containerID="1c5c1f124b706b38be286298ef093d94d0966024fec553b4ea8292e4ea64d631" Jul 15 23:05:15.530953 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.530935 2560 scope.go:117] "RemoveContainer" containerID="adc416862d6f870d879cc838fdb9635e3b5b3f4c7ff626f83d9374f1c0180f4a" Jul 15 23:05:15.539814 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.539787 2560 scope.go:117] "RemoveContainer" containerID="1c5c1f124b706b38be286298ef093d94d0966024fec553b4ea8292e4ea64d631" Jul 15 23:05:15.540128 ip-10-0-132-45 kubenswrapper[2560]: E0715 23:05:15.540107 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c5c1f124b706b38be286298ef093d94d0966024fec553b4ea8292e4ea64d631\": container with ID starting with 1c5c1f124b706b38be286298ef093d94d0966024fec553b4ea8292e4ea64d631 not found: ID does not exist" containerID="1c5c1f124b706b38be286298ef093d94d0966024fec553b4ea8292e4ea64d631" Jul 15 23:05:15.540209 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.540171 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c5c1f124b706b38be286298ef093d94d0966024fec553b4ea8292e4ea64d631"} err="failed to get container status \"1c5c1f124b706b38be286298ef093d94d0966024fec553b4ea8292e4ea64d631\": rpc error: code = NotFound desc = could not find container \"1c5c1f124b706b38be286298ef093d94d0966024fec553b4ea8292e4ea64d631\": container with ID starting with 1c5c1f124b706b38be286298ef093d94d0966024fec553b4ea8292e4ea64d631 not found: ID does not exist" Jul 15 23:05:15.540209 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.540189 2560 scope.go:117] "RemoveContainer" containerID="adc416862d6f870d879cc838fdb9635e3b5b3f4c7ff626f83d9374f1c0180f4a" Jul 15 23:05:15.540494 ip-10-0-132-45 kubenswrapper[2560]: E0715 23:05:15.540445 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adc416862d6f870d879cc838fdb9635e3b5b3f4c7ff626f83d9374f1c0180f4a\": container with ID starting with adc416862d6f870d879cc838fdb9635e3b5b3f4c7ff626f83d9374f1c0180f4a not found: ID does not exist" containerID="adc416862d6f870d879cc838fdb9635e3b5b3f4c7ff626f83d9374f1c0180f4a" Jul 15 23:05:15.540494 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.540480 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adc416862d6f870d879cc838fdb9635e3b5b3f4c7ff626f83d9374f1c0180f4a"} err="failed to get container status \"adc416862d6f870d879cc838fdb9635e3b5b3f4c7ff626f83d9374f1c0180f4a\": rpc error: code = NotFound desc = could not find container \"adc416862d6f870d879cc838fdb9635e3b5b3f4c7ff626f83d9374f1c0180f4a\": container with ID starting with adc416862d6f870d879cc838fdb9635e3b5b3f4c7ff626f83d9374f1c0180f4a not found: ID does not exist" Jul 15 23:05:15.543765 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.543743 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9"] Jul 15 23:05:15.551036 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.551011 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-83ad46-openshift-default-fc796fbb5-p7jm9"] Jul 15 23:05:15.596484 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.596454 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-credential-socket\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:15.596484 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.596481 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istio-data\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:15.596484 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.596492 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istio-envoy\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:15.596693 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.596501 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istio-podinfo\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:15.596693 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.596509 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ff8e559-c5af-48ea-b5c5-5891d82638ba-istio-token\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:15.596693 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.596517 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsnrv\" (UniqueName: \"kubernetes.io/projected/6ff8e559-c5af-48ea-b5c5-5891d82638ba-kube-api-access-lsnrv\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:15.596693 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:15.596526 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ff8e559-c5af-48ea-b5c5-5891d82638ba-workload-certs\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:16.722505 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:16.722474 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4"] Jul 15 23:05:16.722901 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:16.722714 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" podUID="986c9913-f98a-45ae-a3e8-7ff6454ee109" containerName="istio-proxy" containerID="cri-o://ee48c6340a04d3fc1497b0a259566d153f872361be76e8234a723768ee4ce3be" gracePeriod=30 Jul 15 23:05:16.851205 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:16.851161 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ff8e559-c5af-48ea-b5c5-5891d82638ba" path="/var/lib/kubelet/pods/6ff8e559-c5af-48ea-b5c5-5891d82638ba/volumes" Jul 15 23:05:17.620344 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.620312 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb"] Jul 15 23:05:17.620670 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.620658 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff8e559-c5af-48ea-b5c5-5891d82638ba" containerName="istio-proxy" Jul 15 23:05:17.620719 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.620672 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff8e559-c5af-48ea-b5c5-5891d82638ba" containerName="istio-proxy" Jul 15 23:05:17.620757 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.620740 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ff8e559-c5af-48ea-b5c5-5891d82638ba" containerName="istio-proxy" Jul 15 23:05:17.620757 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.620749 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ff8e559-c5af-48ea-b5c5-5891d82638ba" containerName="istio-proxy" Jul 15 23:05:17.625104 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.625086 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.628663 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.628644 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-9171f6-openshift-default-dockercfg-g5x9b\"" Jul 15 23:05:17.644105 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.644081 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb"] Jul 15 23:05:17.716786 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.716758 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-istio-envoy\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.716986 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.716796 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57406989-3c30-4fc6-a823-99e21c5495e9-istio-podinfo\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.716986 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.716830 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-workload-socket\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.716986 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.716918 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-istio-data\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.716986 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.716948 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-workload-certs\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.717122 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.717006 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-credential-socket\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.717122 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.717035 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57406989-3c30-4fc6-a823-99e21c5495e9-istio-token\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.717122 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.717072 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57406989-3c30-4fc6-a823-99e21c5495e9-istiod-ca-cert\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.717122 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.717108 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc6vp\" (UniqueName: \"kubernetes.io/projected/57406989-3c30-4fc6-a823-99e21c5495e9-kube-api-access-bc6vp\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.817894 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.817843 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-credential-socket\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.818354 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.817900 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57406989-3c30-4fc6-a823-99e21c5495e9-istio-token\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.818354 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.817930 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57406989-3c30-4fc6-a823-99e21c5495e9-istiod-ca-cert\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.818354 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.817976 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc6vp\" (UniqueName: \"kubernetes.io/projected/57406989-3c30-4fc6-a823-99e21c5495e9-kube-api-access-bc6vp\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.818354 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.818006 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-istio-envoy\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.818354 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.818027 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57406989-3c30-4fc6-a823-99e21c5495e9-istio-podinfo\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.818354 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.818065 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-workload-socket\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.818354 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.818090 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-istio-data\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.818354 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.818175 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-workload-certs\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.818354 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.818267 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-credential-socket\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.818715 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.818401 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-workload-socket\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.818715 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.818470 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-istio-data\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.818715 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.818572 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-workload-certs\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.818715 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.818677 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57406989-3c30-4fc6-a823-99e21c5495e9-istiod-ca-cert\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.820514 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.820489 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-istio-envoy\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.820613 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.820591 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57406989-3c30-4fc6-a823-99e21c5495e9-istio-podinfo\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.825391 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.825365 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc6vp\" (UniqueName: \"kubernetes.io/projected/57406989-3c30-4fc6-a823-99e21c5495e9-kube-api-access-bc6vp\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.825493 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.825440 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57406989-3c30-4fc6-a823-99e21c5495e9-istio-token\") pod \"e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:17.935465 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:17.935434 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:18.074948 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:18.074922 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb"] Jul 15 23:05:18.076488 ip-10-0-132-45 kubenswrapper[2560]: W0715 23:05:18.076460 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57406989_3c30_4fc6_a823_99e21c5495e9.slice/crio-b1cfd2c913953005dd939d2083f8fcbe6e8dfa5bedd7ae006c7bcc57b5c3c4f6 WatchSource:0}: Error finding container b1cfd2c913953005dd939d2083f8fcbe6e8dfa5bedd7ae006c7bcc57b5c3c4f6: Status 404 returned error can't find the container with id b1cfd2c913953005dd939d2083f8fcbe6e8dfa5bedd7ae006c7bcc57b5c3c4f6 Jul 15 23:05:18.078537 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:18.078503 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:05:18.078624 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:18.078577 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:05:18.078624 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:18.078607 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:05:18.540555 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:18.540524 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" event={"ID":"57406989-3c30-4fc6-a823-99e21c5495e9","Type":"ContainerStarted","Data":"dd64397072a8828c2b00477eb2c776f72d960092942e752a2bd7e390830c6e49"} Jul 15 23:05:18.540726 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:18.540585 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" event={"ID":"57406989-3c30-4fc6-a823-99e21c5495e9","Type":"ContainerStarted","Data":"b1cfd2c913953005dd939d2083f8fcbe6e8dfa5bedd7ae006c7bcc57b5c3c4f6"} Jul 15 23:05:18.559392 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:18.559344 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" podStartSLOduration=1.559331078 podStartE2EDuration="1.559331078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:05:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:05:18.557142236 +0000 UTC m=+1928.264939839" watchObservedRunningTime="2026-07-15 23:05:18.559331078 +0000 UTC m=+1928.267128669" Jul 15 23:05:18.936038 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:18.936010 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:19.673135 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:19.673102 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf"] Jul 15 23:05:19.673640 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:19.673623 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff8e559-c5af-48ea-b5c5-5891d82638ba" containerName="istio-proxy" Jul 15 23:05:19.673640 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:19.673641 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff8e559-c5af-48ea-b5c5-5891d82638ba" containerName="istio-proxy" Jul 15 23:05:19.677249 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:19.677229 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf" Jul 15 23:05:19.679751 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:19.679732 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-9171f6-serving-cert\"" Jul 15 23:05:19.686036 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:19.686015 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf"] Jul 15 23:05:19.735657 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:19.735631 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4dca009a-6fc9-4b2d-af9e-316a693f73b6-maas-api-tls\") pod \"maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf\" (UID: \"4dca009a-6fc9-4b2d-af9e-316a693f73b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf" Jul 15 23:05:19.735779 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:19.735668 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lnp6\" (UniqueName: \"kubernetes.io/projected/4dca009a-6fc9-4b2d-af9e-316a693f73b6-kube-api-access-2lnp6\") pod \"maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf\" (UID: \"4dca009a-6fc9-4b2d-af9e-316a693f73b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf" Jul 15 23:05:19.735779 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:19.735688 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dca009a-6fc9-4b2d-af9e-316a693f73b6-openshift-service-ca\") pod \"maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf\" (UID: \"4dca009a-6fc9-4b2d-af9e-316a693f73b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf" Jul 15 23:05:19.836462 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:19.836431 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4dca009a-6fc9-4b2d-af9e-316a693f73b6-maas-api-tls\") pod \"maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf\" (UID: \"4dca009a-6fc9-4b2d-af9e-316a693f73b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf" Jul 15 23:05:19.836462 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:19.836467 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lnp6\" (UniqueName: \"kubernetes.io/projected/4dca009a-6fc9-4b2d-af9e-316a693f73b6-kube-api-access-2lnp6\") pod \"maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf\" (UID: \"4dca009a-6fc9-4b2d-af9e-316a693f73b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf" Jul 15 23:05:19.836671 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:19.836484 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dca009a-6fc9-4b2d-af9e-316a693f73b6-openshift-service-ca\") pod \"maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf\" (UID: \"4dca009a-6fc9-4b2d-af9e-316a693f73b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf" Jul 15 23:05:19.837123 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:19.837104 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dca009a-6fc9-4b2d-af9e-316a693f73b6-openshift-service-ca\") pod \"maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf\" (UID: \"4dca009a-6fc9-4b2d-af9e-316a693f73b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf" Jul 15 23:05:19.839044 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:19.839023 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4dca009a-6fc9-4b2d-af9e-316a693f73b6-maas-api-tls\") pod \"maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf\" (UID: \"4dca009a-6fc9-4b2d-af9e-316a693f73b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf" Jul 15 23:05:19.844925 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:19.844900 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lnp6\" (UniqueName: \"kubernetes.io/projected/4dca009a-6fc9-4b2d-af9e-316a693f73b6-kube-api-access-2lnp6\") pod \"maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf\" (UID: \"4dca009a-6fc9-4b2d-af9e-316a693f73b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf" Jul 15 23:05:19.941606 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:19.941537 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:19.989641 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:19.989607 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf" Jul 15 23:05:20.128401 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:20.128370 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf"] Jul 15 23:05:20.130164 ip-10-0-132-45 kubenswrapper[2560]: W0715 23:05:20.130136 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dca009a_6fc9_4b2d_af9e_316a693f73b6.slice/crio-40c2d8b7ab7b400ff527b34d20704198d94ef57717ae2575c020bb0e2468ffff WatchSource:0}: Error finding container 40c2d8b7ab7b400ff527b34d20704198d94ef57717ae2575c020bb0e2468ffff: Status 404 returned error can't find the container with id 40c2d8b7ab7b400ff527b34d20704198d94ef57717ae2575c020bb0e2468ffff Jul 15 23:05:20.223306 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:20.223232 2560 patch_prober.go:28] interesting pod/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 23:05:20.223413 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:20.223297 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" podUID="986c9913-f98a-45ae-a3e8-7ff6454ee109" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 23:05:20.552208 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:20.552126 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf" event={"ID":"4dca009a-6fc9-4b2d-af9e-316a693f73b6","Type":"ContainerStarted","Data":"40c2d8b7ab7b400ff527b34d20704198d94ef57717ae2575c020bb0e2468ffff"} Jul 15 23:05:20.552486 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:20.552456 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:20.553318 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:20.553299 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:21.559092 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:21.559054 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf" event={"ID":"4dca009a-6fc9-4b2d-af9e-316a693f73b6","Type":"ContainerStarted","Data":"a7a3f0e9349dc76d4466a35b24dd90ac0a37c912f9e3c0d55933f49a43d7d3cc"} Jul 15 23:05:21.559466 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:21.559341 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf" Jul 15 23:05:21.576648 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:21.576582 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf" podStartSLOduration=2.094130521 podStartE2EDuration="2.576565445s" totalImagesPullingTime="482.434924ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:05:21.575746774 +0000 UTC m=+1931.283544359" watchObservedRunningTime="2026-07-15 23:05:21.576565445 +0000 UTC m=+1931.284363036" Jul 15 23:05:21.972005 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:21.971974 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:05:22.058281 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.058256 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dlnh\" (UniqueName: \"kubernetes.io/projected/986c9913-f98a-45ae-a3e8-7ff6454ee109-kube-api-access-9dlnh\") pod \"986c9913-f98a-45ae-a3e8-7ff6454ee109\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " Jul 15 23:05:22.058405 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.058307 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-istio-data\") pod \"986c9913-f98a-45ae-a3e8-7ff6454ee109\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " Jul 15 23:05:22.058405 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.058324 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-credential-socket\") pod \"986c9913-f98a-45ae-a3e8-7ff6454ee109\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " Jul 15 23:05:22.058405 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.058346 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/986c9913-f98a-45ae-a3e8-7ff6454ee109-istio-podinfo\") pod \"986c9913-f98a-45ae-a3e8-7ff6454ee109\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " Jul 15 23:05:22.058405 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.058371 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/986c9913-f98a-45ae-a3e8-7ff6454ee109-istiod-ca-cert\") pod \"986c9913-f98a-45ae-a3e8-7ff6454ee109\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " Jul 15 23:05:22.058606 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.058442 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-workload-socket\") pod \"986c9913-f98a-45ae-a3e8-7ff6454ee109\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " Jul 15 23:05:22.058606 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.058574 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-workload-certs\") pod \"986c9913-f98a-45ae-a3e8-7ff6454ee109\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " Jul 15 23:05:22.058712 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.058622 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-istio-envoy\") pod \"986c9913-f98a-45ae-a3e8-7ff6454ee109\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " Jul 15 23:05:22.058712 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.058670 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/986c9913-f98a-45ae-a3e8-7ff6454ee109-istio-token\") pod \"986c9913-f98a-45ae-a3e8-7ff6454ee109\" (UID: \"986c9913-f98a-45ae-a3e8-7ff6454ee109\") " Jul 15 23:05:22.058712 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.058674 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "986c9913-f98a-45ae-a3e8-7ff6454ee109" (UID: "986c9913-f98a-45ae-a3e8-7ff6454ee109"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:05:22.059090 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.058895 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "986c9913-f98a-45ae-a3e8-7ff6454ee109" (UID: "986c9913-f98a-45ae-a3e8-7ff6454ee109"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:05:22.059090 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.058925 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/986c9913-f98a-45ae-a3e8-7ff6454ee109-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "986c9913-f98a-45ae-a3e8-7ff6454ee109" (UID: "986c9913-f98a-45ae-a3e8-7ff6454ee109"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 23:05:22.059090 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.059073 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "986c9913-f98a-45ae-a3e8-7ff6454ee109" (UID: "986c9913-f98a-45ae-a3e8-7ff6454ee109"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:05:22.059241 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.059134 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-workload-certs\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:22.059241 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.059153 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-credential-socket\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:22.059241 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.059168 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/986c9913-f98a-45ae-a3e8-7ff6454ee109-istiod-ca-cert\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:22.059498 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.059475 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-istio-data" (OuterVolumeSpecName: "istio-data") pod "986c9913-f98a-45ae-a3e8-7ff6454ee109" (UID: "986c9913-f98a-45ae-a3e8-7ff6454ee109"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:05:22.060688 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.060668 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/986c9913-f98a-45ae-a3e8-7ff6454ee109-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "986c9913-f98a-45ae-a3e8-7ff6454ee109" (UID: "986c9913-f98a-45ae-a3e8-7ff6454ee109"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 23:05:22.060774 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.060746 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/986c9913-f98a-45ae-a3e8-7ff6454ee109-kube-api-access-9dlnh" (OuterVolumeSpecName: "kube-api-access-9dlnh") pod "986c9913-f98a-45ae-a3e8-7ff6454ee109" (UID: "986c9913-f98a-45ae-a3e8-7ff6454ee109"). InnerVolumeSpecName "kube-api-access-9dlnh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:05:22.061255 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.061237 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "986c9913-f98a-45ae-a3e8-7ff6454ee109" (UID: "986c9913-f98a-45ae-a3e8-7ff6454ee109"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:05:22.061317 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.061268 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/986c9913-f98a-45ae-a3e8-7ff6454ee109-istio-token" (OuterVolumeSpecName: "istio-token") pod "986c9913-f98a-45ae-a3e8-7ff6454ee109" (UID: "986c9913-f98a-45ae-a3e8-7ff6454ee109"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:05:22.159919 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.159829 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/986c9913-f98a-45ae-a3e8-7ff6454ee109-istio-token\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:22.159919 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.159882 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dlnh\" (UniqueName: \"kubernetes.io/projected/986c9913-f98a-45ae-a3e8-7ff6454ee109-kube-api-access-9dlnh\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:22.159919 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.159892 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-istio-data\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:22.159919 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.159902 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/986c9913-f98a-45ae-a3e8-7ff6454ee109-istio-podinfo\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:22.159919 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.159909 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-workload-socket\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:22.159919 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.159917 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/986c9913-f98a-45ae-a3e8-7ff6454ee109-istio-envoy\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:22.566555 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.566506 2560 generic.go:356] "Generic (PLEG): container finished" podID="986c9913-f98a-45ae-a3e8-7ff6454ee109" containerID="ee48c6340a04d3fc1497b0a259566d153f872361be76e8234a723768ee4ce3be" exitCode=0 Jul 15 23:05:22.566555 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.566557 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" Jul 15 23:05:22.567021 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.566587 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" event={"ID":"986c9913-f98a-45ae-a3e8-7ff6454ee109","Type":"ContainerDied","Data":"ee48c6340a04d3fc1497b0a259566d153f872361be76e8234a723768ee4ce3be"} Jul 15 23:05:22.567021 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.566639 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4" event={"ID":"986c9913-f98a-45ae-a3e8-7ff6454ee109","Type":"ContainerDied","Data":"234a36de16fcf56f86d8431319f57a9e0f3f4bdb608add98f182afd7ff04b681"} Jul 15 23:05:22.567021 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.566661 2560 scope.go:117] "RemoveContainer" containerID="ee48c6340a04d3fc1497b0a259566d153f872361be76e8234a723768ee4ce3be" Jul 15 23:05:22.576607 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.576588 2560 scope.go:117] "RemoveContainer" containerID="67c11f5ec7254175a2bb5bddfc914d4831483eb5d674f93002e7643b80b674a6" Jul 15 23:05:22.584757 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.584715 2560 scope.go:117] "RemoveContainer" containerID="ee48c6340a04d3fc1497b0a259566d153f872361be76e8234a723768ee4ce3be" Jul 15 23:05:22.585063 ip-10-0-132-45 kubenswrapper[2560]: E0715 23:05:22.585036 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee48c6340a04d3fc1497b0a259566d153f872361be76e8234a723768ee4ce3be\": container with ID starting with ee48c6340a04d3fc1497b0a259566d153f872361be76e8234a723768ee4ce3be not found: ID does not exist" containerID="ee48c6340a04d3fc1497b0a259566d153f872361be76e8234a723768ee4ce3be" Jul 15 23:05:22.585164 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.585073 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee48c6340a04d3fc1497b0a259566d153f872361be76e8234a723768ee4ce3be"} err="failed to get container status \"ee48c6340a04d3fc1497b0a259566d153f872361be76e8234a723768ee4ce3be\": rpc error: code = NotFound desc = could not find container \"ee48c6340a04d3fc1497b0a259566d153f872361be76e8234a723768ee4ce3be\": container with ID starting with ee48c6340a04d3fc1497b0a259566d153f872361be76e8234a723768ee4ce3be not found: ID does not exist" Jul 15 23:05:22.585164 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.585097 2560 scope.go:117] "RemoveContainer" containerID="67c11f5ec7254175a2bb5bddfc914d4831483eb5d674f93002e7643b80b674a6" Jul 15 23:05:22.585449 ip-10-0-132-45 kubenswrapper[2560]: E0715 23:05:22.585427 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67c11f5ec7254175a2bb5bddfc914d4831483eb5d674f93002e7643b80b674a6\": container with ID starting with 67c11f5ec7254175a2bb5bddfc914d4831483eb5d674f93002e7643b80b674a6 not found: ID does not exist" containerID="67c11f5ec7254175a2bb5bddfc914d4831483eb5d674f93002e7643b80b674a6" Jul 15 23:05:22.585536 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.585454 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67c11f5ec7254175a2bb5bddfc914d4831483eb5d674f93002e7643b80b674a6"} err="failed to get container status \"67c11f5ec7254175a2bb5bddfc914d4831483eb5d674f93002e7643b80b674a6\": rpc error: code = NotFound desc = could not find container \"67c11f5ec7254175a2bb5bddfc914d4831483eb5d674f93002e7643b80b674a6\": container with ID starting with 67c11f5ec7254175a2bb5bddfc914d4831483eb5d674f93002e7643b80b674a6 not found: ID does not exist" Jul 15 23:05:22.588795 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.588771 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4"] Jul 15 23:05:22.591714 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.591695 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-2b485c-openshift-default-69cf58b75-4gcj4"] Jul 15 23:05:22.840780 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:22.840706 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="986c9913-f98a-45ae-a3e8-7ff6454ee109" path="/var/lib/kubelet/pods/986c9913-f98a-45ae-a3e8-7ff6454ee109/volumes" Jul 15 23:05:25.658241 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.658193 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2"] Jul 15 23:05:25.658845 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.658644 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="986c9913-f98a-45ae-a3e8-7ff6454ee109" containerName="istio-proxy" Jul 15 23:05:25.658845 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.658657 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="986c9913-f98a-45ae-a3e8-7ff6454ee109" containerName="istio-proxy" Jul 15 23:05:25.658845 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.658671 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="986c9913-f98a-45ae-a3e8-7ff6454ee109" containerName="istio-proxy" Jul 15 23:05:25.658845 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.658679 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="986c9913-f98a-45ae-a3e8-7ff6454ee109" containerName="istio-proxy" Jul 15 23:05:25.658845 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.658778 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="986c9913-f98a-45ae-a3e8-7ff6454ee109" containerName="istio-proxy" Jul 15 23:05:25.658845 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.658788 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="986c9913-f98a-45ae-a3e8-7ff6454ee109" containerName="istio-proxy" Jul 15 23:05:25.663483 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.663464 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.665767 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.665751 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-e81434-openshift-default-dockercfg-h2vnl\"" Jul 15 23:05:25.674598 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.674575 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2"] Jul 15 23:05:25.791820 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.791784 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-workload-socket\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.791997 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.791830 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-workload-certs\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.791997 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.791883 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg9vq\" (UniqueName: \"kubernetes.io/projected/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-kube-api-access-zg9vq\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.791997 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.791936 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istio-envoy\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.791997 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.791958 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istio-data\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.791997 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.791986 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istiod-ca-cert\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.792166 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.792031 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-credential-socket\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.792166 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.792057 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istio-token\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.792166 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.792074 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istio-podinfo\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.892677 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.892638 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-workload-socket\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.892677 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.892689 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-workload-certs\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.892951 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.892709 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg9vq\" (UniqueName: \"kubernetes.io/projected/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-kube-api-access-zg9vq\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.892951 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.892737 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istio-envoy\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.892951 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.892756 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istio-data\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.892951 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.892779 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istiod-ca-cert\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.892951 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.892817 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-credential-socket\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.893208 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.892981 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istio-token\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.893208 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.893030 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istio-podinfo\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.893208 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.893113 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-workload-certs\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.893362 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.893244 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-workload-socket\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.893421 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.893377 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istio-data\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.893484 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.893468 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istiod-ca-cert\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.893536 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.893498 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-credential-socket\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.895078 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.895062 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istio-envoy\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.895541 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.895526 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istio-podinfo\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.912229 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.912179 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg9vq\" (UniqueName: \"kubernetes.io/projected/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-kube-api-access-zg9vq\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.913498 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.913478 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istio-token\") pod \"e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:25.976538 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:25.976510 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:26.112919 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:26.112892 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2"] Jul 15 23:05:26.114382 ip-10-0-132-45 kubenswrapper[2560]: W0715 23:05:26.114351 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ced9b3_7b9b_4e6c_bd29_eeb3a51fea23.slice/crio-36fc8cbc871b4b7a6ef8602d5ea7b7772bd11488330be034bf4c5c5b79f34c78 WatchSource:0}: Error finding container 36fc8cbc871b4b7a6ef8602d5ea7b7772bd11488330be034bf4c5c5b79f34c78: Status 404 returned error can't find the container with id 36fc8cbc871b4b7a6ef8602d5ea7b7772bd11488330be034bf4c5c5b79f34c78 Jul 15 23:05:26.116494 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:26.116463 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:05:26.116582 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:26.116524 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:05:26.116582 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:26.116563 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:05:26.591044 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:26.591005 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" event={"ID":"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23","Type":"ContainerStarted","Data":"e89f14c0c25b6e9b144ac1903334afd389335986f28c47e7bf24860f8343c0b3"} Jul 15 23:05:26.591219 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:26.591074 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" event={"ID":"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23","Type":"ContainerStarted","Data":"36fc8cbc871b4b7a6ef8602d5ea7b7772bd11488330be034bf4c5c5b79f34c78"} Jul 15 23:05:26.608901 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:26.608823 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" podStartSLOduration=1.608803508 podStartE2EDuration="1.608803508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:05:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:05:26.607935414 +0000 UTC m=+1936.315733003" watchObservedRunningTime="2026-07-15 23:05:26.608803508 +0000 UTC m=+1936.316601098" Jul 15 23:05:26.977323 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:26.977295 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:27.572586 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:27.572560 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf" Jul 15 23:05:27.982825 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:27.982798 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:28.607875 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:28.607825 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:28.611982 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:28.611954 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:36.595987 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:36.595945 2560 patch_prober.go:28] interesting pod/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 15 23:05:36.596357 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:36.596037 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" podUID="57406989-3c30-4fc6-a823-99e21c5495e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 15 23:05:37.660014 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:37.659925 2560 generic.go:356] "Generic (PLEG): container finished" podID="57406989-3c30-4fc6-a823-99e21c5495e9" containerID="dd64397072a8828c2b00477eb2c776f72d960092942e752a2bd7e390830c6e49" exitCode=0 Jul 15 23:05:37.660014 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:37.659999 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" event={"ID":"57406989-3c30-4fc6-a823-99e21c5495e9","Type":"ContainerDied","Data":"dd64397072a8828c2b00477eb2c776f72d960092942e752a2bd7e390830c6e49"} Jul 15 23:05:37.660427 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:37.660369 2560 scope.go:117] "RemoveContainer" containerID="dd64397072a8828c2b00477eb2c776f72d960092942e752a2bd7e390830c6e49" Jul 15 23:05:37.661398 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:37.661369 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:05:37.661458 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:37.661438 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:05:37.661498 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:37.661474 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:05:38.676390 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:38.676340 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" event={"ID":"57406989-3c30-4fc6-a823-99e21c5495e9","Type":"ContainerStarted","Data":"eee7d8e7e6a74ee1550afc78231ead5822c29f56740c9106fc48fae13bf583d1"} Jul 15 23:05:38.936438 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:38.936358 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:38.936646 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:38.936613 2560 patch_prober.go:28] interesting pod/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 15 23:05:38.936768 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:38.936679 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" podUID="57406989-3c30-4fc6-a823-99e21c5495e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 15 23:05:39.935885 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:39.935837 2560 patch_prober.go:28] interesting pod/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 15 23:05:39.936297 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:39.935915 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" podUID="57406989-3c30-4fc6-a823-99e21c5495e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 15 23:05:40.935992 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:40.935959 2560 patch_prober.go:28] interesting pod/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 15 23:05:40.936380 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:40.936008 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" podUID="57406989-3c30-4fc6-a823-99e21c5495e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 15 23:05:41.936867 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:41.936810 2560 patch_prober.go:28] interesting pod/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 15 23:05:41.937291 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:41.936889 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" podUID="57406989-3c30-4fc6-a823-99e21c5495e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 15 23:05:42.939845 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:42.939815 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:42.940339 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:42.940316 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:42.941073 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:42.941055 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:44.650017 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:44.649977 2560 patch_prober.go:28] interesting pod/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 15 23:05:44.650393 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:44.650034 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" podUID="40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 15 23:05:45.731787 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:45.731757 2560 generic.go:356] "Generic (PLEG): container finished" podID="40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" containerID="e89f14c0c25b6e9b144ac1903334afd389335986f28c47e7bf24860f8343c0b3" exitCode=0 Jul 15 23:05:45.732201 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:45.731827 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" event={"ID":"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23","Type":"ContainerDied","Data":"e89f14c0c25b6e9b144ac1903334afd389335986f28c47e7bf24860f8343c0b3"} Jul 15 23:05:45.732256 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:45.732216 2560 scope.go:117] "RemoveContainer" containerID="e89f14c0c25b6e9b144ac1903334afd389335986f28c47e7bf24860f8343c0b3" Jul 15 23:05:45.733176 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:45.733149 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:05:45.733302 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:45.733227 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:05:45.733302 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:45.733278 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:05:46.744835 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:46.744797 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" event={"ID":"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23","Type":"ContainerStarted","Data":"f05deea54a9488dbdacc4310517167decab1ac9c451685aab549a37148fcc32a"} Jul 15 23:05:46.976791 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:46.976754 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:46.977063 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:46.977040 2560 patch_prober.go:28] interesting pod/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 15 23:05:46.977127 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:46.977095 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" podUID="40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 15 23:05:47.977960 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:47.977921 2560 patch_prober.go:28] interesting pod/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 15 23:05:47.978375 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:47.977980 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" podUID="40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 15 23:05:48.977642 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:48.977603 2560 patch_prober.go:28] interesting pod/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 15 23:05:48.977900 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:48.977663 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" podUID="40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 15 23:05:49.977178 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:49.977145 2560 patch_prober.go:28] interesting pod/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 15 23:05:49.977586 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:49.977202 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" podUID="40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 15 23:05:50.980915 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:50.980884 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:50.981386 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:50.981311 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:50.982060 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:50.982040 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:05:52.644383 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:52.644350 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb"] Jul 15 23:05:52.644885 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:52.644573 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" podUID="57406989-3c30-4fc6-a823-99e21c5495e9" containerName="istio-proxy" containerID="cri-o://eee7d8e7e6a74ee1550afc78231ead5822c29f56740c9106fc48fae13bf583d1" gracePeriod=30 Jul 15 23:05:57.813109 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:57.813076 2560 generic.go:356] "Generic (PLEG): container finished" podID="57406989-3c30-4fc6-a823-99e21c5495e9" containerID="eee7d8e7e6a74ee1550afc78231ead5822c29f56740c9106fc48fae13bf583d1" exitCode=0 Jul 15 23:05:57.813491 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:57.813161 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" event={"ID":"57406989-3c30-4fc6-a823-99e21c5495e9","Type":"ContainerDied","Data":"eee7d8e7e6a74ee1550afc78231ead5822c29f56740c9106fc48fae13bf583d1"} Jul 15 23:05:57.813491 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:57.813222 2560 scope.go:117] "RemoveContainer" containerID="dd64397072a8828c2b00477eb2c776f72d960092942e752a2bd7e390830c6e49" Jul 15 23:05:57.898810 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:57.898786 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:57.997612 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:57.997579 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57406989-3c30-4fc6-a823-99e21c5495e9-istiod-ca-cert\") pod \"57406989-3c30-4fc6-a823-99e21c5495e9\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " Jul 15 23:05:57.997813 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:57.997659 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bc6vp\" (UniqueName: \"kubernetes.io/projected/57406989-3c30-4fc6-a823-99e21c5495e9-kube-api-access-bc6vp\") pod \"57406989-3c30-4fc6-a823-99e21c5495e9\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " Jul 15 23:05:57.997813 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:57.997681 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-istio-envoy\") pod \"57406989-3c30-4fc6-a823-99e21c5495e9\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " Jul 15 23:05:57.997813 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:57.997701 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-istio-data\") pod \"57406989-3c30-4fc6-a823-99e21c5495e9\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " Jul 15 23:05:57.997813 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:57.997719 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-workload-socket\") pod \"57406989-3c30-4fc6-a823-99e21c5495e9\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " Jul 15 23:05:57.997813 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:57.997743 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-credential-socket\") pod \"57406989-3c30-4fc6-a823-99e21c5495e9\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " Jul 15 23:05:57.997813 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:57.997806 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57406989-3c30-4fc6-a823-99e21c5495e9-istio-podinfo\") pod \"57406989-3c30-4fc6-a823-99e21c5495e9\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " Jul 15 23:05:57.998164 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:57.997832 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-workload-certs\") pod \"57406989-3c30-4fc6-a823-99e21c5495e9\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " Jul 15 23:05:57.998164 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:57.997879 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57406989-3c30-4fc6-a823-99e21c5495e9-istio-token\") pod \"57406989-3c30-4fc6-a823-99e21c5495e9\" (UID: \"57406989-3c30-4fc6-a823-99e21c5495e9\") " Jul 15 23:05:57.998164 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:57.998123 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "57406989-3c30-4fc6-a823-99e21c5495e9" (UID: "57406989-3c30-4fc6-a823-99e21c5495e9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:05:57.998164 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:57.998136 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "57406989-3c30-4fc6-a823-99e21c5495e9" (UID: "57406989-3c30-4fc6-a823-99e21c5495e9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:05:57.998363 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:57.998319 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "57406989-3c30-4fc6-a823-99e21c5495e9" (UID: "57406989-3c30-4fc6-a823-99e21c5495e9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:05:57.998438 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:57.998413 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57406989-3c30-4fc6-a823-99e21c5495e9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "57406989-3c30-4fc6-a823-99e21c5495e9" (UID: "57406989-3c30-4fc6-a823-99e21c5495e9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 23:05:57.998692 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:57.998655 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-istio-data" (OuterVolumeSpecName: "istio-data") pod "57406989-3c30-4fc6-a823-99e21c5495e9" (UID: "57406989-3c30-4fc6-a823-99e21c5495e9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:05:58.000082 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:58.000050 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57406989-3c30-4fc6-a823-99e21c5495e9-kube-api-access-bc6vp" (OuterVolumeSpecName: "kube-api-access-bc6vp") pod "57406989-3c30-4fc6-a823-99e21c5495e9" (UID: "57406989-3c30-4fc6-a823-99e21c5495e9"). InnerVolumeSpecName "kube-api-access-bc6vp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:05:58.000230 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:58.000214 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57406989-3c30-4fc6-a823-99e21c5495e9-istio-token" (OuterVolumeSpecName: "istio-token") pod "57406989-3c30-4fc6-a823-99e21c5495e9" (UID: "57406989-3c30-4fc6-a823-99e21c5495e9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:05:58.000468 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:58.000442 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/57406989-3c30-4fc6-a823-99e21c5495e9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "57406989-3c30-4fc6-a823-99e21c5495e9" (UID: "57406989-3c30-4fc6-a823-99e21c5495e9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 23:05:58.000468 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:58.000450 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "57406989-3c30-4fc6-a823-99e21c5495e9" (UID: "57406989-3c30-4fc6-a823-99e21c5495e9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:05:58.099509 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:58.099478 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57406989-3c30-4fc6-a823-99e21c5495e9-istiod-ca-cert\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:58.099509 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:58.099505 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bc6vp\" (UniqueName: \"kubernetes.io/projected/57406989-3c30-4fc6-a823-99e21c5495e9-kube-api-access-bc6vp\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:58.099509 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:58.099515 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-istio-envoy\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:58.099732 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:58.099524 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-istio-data\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:58.099732 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:58.099532 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-workload-socket\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:58.099732 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:58.099539 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-credential-socket\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:58.099732 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:58.099547 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57406989-3c30-4fc6-a823-99e21c5495e9-istio-podinfo\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:58.099732 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:58.099554 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57406989-3c30-4fc6-a823-99e21c5495e9-workload-certs\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:58.099732 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:58.099561 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57406989-3c30-4fc6-a823-99e21c5495e9-istio-token\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:05:58.820113 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:58.820088 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" Jul 15 23:05:58.820463 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:58.820086 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb" event={"ID":"57406989-3c30-4fc6-a823-99e21c5495e9","Type":"ContainerDied","Data":"b1cfd2c913953005dd939d2083f8fcbe6e8dfa5bedd7ae006c7bcc57b5c3c4f6"} Jul 15 23:05:58.820463 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:58.820234 2560 scope.go:117] "RemoveContainer" containerID="eee7d8e7e6a74ee1550afc78231ead5822c29f56740c9106fc48fae13bf583d1" Jul 15 23:05:58.842221 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:58.842194 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb"] Jul 15 23:05:58.844353 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:05:58.844327 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-9171f6-openshift-default-799c5f95bc-ll7vb"] Jul 15 23:06:00.839587 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:00.839557 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57406989-3c30-4fc6-a823-99e21c5495e9" path="/var/lib/kubelet/pods/57406989-3c30-4fc6-a823-99e21c5495e9/volumes" Jul 15 23:06:04.808931 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:04.808825 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2"] Jul 15 23:06:04.809357 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:04.809082 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" podUID="40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" containerName="istio-proxy" containerID="cri-o://f05deea54a9488dbdacc4310517167decab1ac9c451685aab549a37148fcc32a" gracePeriod=30 Jul 15 23:06:05.644890 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.644836 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9"] Jul 15 23:06:05.645259 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.645244 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57406989-3c30-4fc6-a823-99e21c5495e9" containerName="istio-proxy" Jul 15 23:06:05.645259 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.645259 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="57406989-3c30-4fc6-a823-99e21c5495e9" containerName="istio-proxy" Jul 15 23:06:05.645398 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.645342 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="57406989-3c30-4fc6-a823-99e21c5495e9" containerName="istio-proxy" Jul 15 23:06:05.645398 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.645353 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="57406989-3c30-4fc6-a823-99e21c5495e9" containerName="istio-proxy" Jul 15 23:06:05.648237 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.648217 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.650219 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.650198 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-ab95dd-openshift-default-dockercfg-nwl6p\"" Jul 15 23:06:05.659516 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.659492 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9"] Jul 15 23:06:05.760561 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.760534 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b454bd8-958d-47b5-aa99-afd70ab14b16-istio-podinfo\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.760690 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.760570 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b454bd8-958d-47b5-aa99-afd70ab14b16-istio-token\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.760690 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.760602 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-istio-envoy\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.760690 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.760664 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c94d9\" (UniqueName: \"kubernetes.io/projected/1b454bd8-958d-47b5-aa99-afd70ab14b16-kube-api-access-c94d9\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.760792 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.760704 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b454bd8-958d-47b5-aa99-afd70ab14b16-istiod-ca-cert\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.760792 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.760743 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-istio-data\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.760792 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.760765 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-workload-socket\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.760907 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.760846 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-workload-certs\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.760907 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.760900 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-credential-socket\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.861520 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.861485 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b454bd8-958d-47b5-aa99-afd70ab14b16-istiod-ca-cert\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.862018 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.861545 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-istio-data\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.862018 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.861575 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-workload-socket\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.862018 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.861618 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-workload-certs\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.862018 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.861653 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-credential-socket\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.862018 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.861707 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b454bd8-958d-47b5-aa99-afd70ab14b16-istio-podinfo\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.862018 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.861741 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b454bd8-958d-47b5-aa99-afd70ab14b16-istio-token\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.862018 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.861775 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-istio-envoy\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.862018 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.861814 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c94d9\" (UniqueName: \"kubernetes.io/projected/1b454bd8-958d-47b5-aa99-afd70ab14b16-kube-api-access-c94d9\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.862370 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.862079 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-workload-certs\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.862370 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.862112 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-istio-data\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.862370 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.862142 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-workload-socket\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.862370 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.862241 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-credential-socket\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.862370 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.862300 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b454bd8-958d-47b5-aa99-afd70ab14b16-istiod-ca-cert\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.864242 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.864223 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-istio-envoy\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.864412 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.864390 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b454bd8-958d-47b5-aa99-afd70ab14b16-istio-podinfo\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.870191 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.870165 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c94d9\" (UniqueName: \"kubernetes.io/projected/1b454bd8-958d-47b5-aa99-afd70ab14b16-kube-api-access-c94d9\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.870371 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.870354 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b454bd8-958d-47b5-aa99-afd70ab14b16-istio-token\") pod \"e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.958643 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.958610 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:05.983519 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.983493 2560 patch_prober.go:28] interesting pod/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 23:06:05.983615 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:05.983548 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" podUID="40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 23:06:06.094790 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:06.094765 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9"] Jul 15 23:06:06.096553 ip-10-0-132-45 kubenswrapper[2560]: W0715 23:06:06.096524 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b454bd8_958d_47b5_aa99_afd70ab14b16.slice/crio-d7fcbe6224cbe49de0f337b1b047d84e6362c45230921c3f39b8f9e24c6e7e02 WatchSource:0}: Error finding container d7fcbe6224cbe49de0f337b1b047d84e6362c45230921c3f39b8f9e24c6e7e02: Status 404 returned error can't find the container with id d7fcbe6224cbe49de0f337b1b047d84e6362c45230921c3f39b8f9e24c6e7e02 Jul 15 23:06:06.098710 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:06.098680 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:06:06.098777 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:06.098739 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:06:06.098777 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:06.098765 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:06:06.864521 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:06.864486 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" event={"ID":"1b454bd8-958d-47b5-aa99-afd70ab14b16","Type":"ContainerStarted","Data":"9b550b6de660c57daf727a1ff9cfd968316bb8212cfedd2f7c7040aeb9355a75"} Jul 15 23:06:06.865088 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:06.864530 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" event={"ID":"1b454bd8-958d-47b5-aa99-afd70ab14b16","Type":"ContainerStarted","Data":"d7fcbe6224cbe49de0f337b1b047d84e6362c45230921c3f39b8f9e24c6e7e02"} Jul 15 23:06:06.884152 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:06.884105 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" podStartSLOduration=1.884090133 podStartE2EDuration="1.884090133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:06:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:06:06.88170507 +0000 UTC m=+1976.589502660" watchObservedRunningTime="2026-07-15 23:06:06.884090133 +0000 UTC m=+1976.591887722" Jul 15 23:06:06.959673 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:06.959642 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:07.804841 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:07.804806 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf"] Jul 15 23:06:07.805310 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:07.805292 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57406989-3c30-4fc6-a823-99e21c5495e9" containerName="istio-proxy" Jul 15 23:06:07.805364 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:07.805313 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="57406989-3c30-4fc6-a823-99e21c5495e9" containerName="istio-proxy" Jul 15 23:06:07.807475 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:07.807455 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf" Jul 15 23:06:07.809769 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:07.809749 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-ab95dd-serving-cert\"" Jul 15 23:06:07.817834 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:07.817811 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf"] Jul 15 23:06:07.882199 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:07.882167 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc48n\" (UniqueName: \"kubernetes.io/projected/4d249ed2-9503-4bd9-91f7-e86068a35c69-kube-api-access-mc48n\") pod \"maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf\" (UID: \"4d249ed2-9503-4bd9-91f7-e86068a35c69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf" Jul 15 23:06:07.882606 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:07.882222 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d249ed2-9503-4bd9-91f7-e86068a35c69-maas-api-tls\") pod \"maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf\" (UID: \"4d249ed2-9503-4bd9-91f7-e86068a35c69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf" Jul 15 23:06:07.882606 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:07.882246 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d249ed2-9503-4bd9-91f7-e86068a35c69-openshift-service-ca\") pod \"maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf\" (UID: \"4d249ed2-9503-4bd9-91f7-e86068a35c69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf" Jul 15 23:06:07.964097 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:07.964067 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:07.983210 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:07.983175 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d249ed2-9503-4bd9-91f7-e86068a35c69-openshift-service-ca\") pod \"maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf\" (UID: \"4d249ed2-9503-4bd9-91f7-e86068a35c69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf" Jul 15 23:06:07.983362 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:07.983272 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc48n\" (UniqueName: \"kubernetes.io/projected/4d249ed2-9503-4bd9-91f7-e86068a35c69-kube-api-access-mc48n\") pod \"maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf\" (UID: \"4d249ed2-9503-4bd9-91f7-e86068a35c69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf" Jul 15 23:06:07.989904 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:07.984165 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d249ed2-9503-4bd9-91f7-e86068a35c69-maas-api-tls\") pod \"maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf\" (UID: \"4d249ed2-9503-4bd9-91f7-e86068a35c69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf" Jul 15 23:06:07.989904 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:07.985015 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d249ed2-9503-4bd9-91f7-e86068a35c69-openshift-service-ca\") pod \"maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf\" (UID: \"4d249ed2-9503-4bd9-91f7-e86068a35c69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf" Jul 15 23:06:07.989904 ip-10-0-132-45 kubenswrapper[2560]: E0715 23:06:07.985157 2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-ab95dd-serving-cert: secret "maas-api-e2e-shared-a-ab95dd-serving-cert" not found Jul 15 23:06:07.989904 ip-10-0-132-45 kubenswrapper[2560]: E0715 23:06:07.985530 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d249ed2-9503-4bd9-91f7-e86068a35c69-maas-api-tls podName:4d249ed2-9503-4bd9-91f7-e86068a35c69 nodeName:}" failed. No retries permitted until 2026-07-15 23:06:08.485452187 +0000 UTC m=+1978.193249756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4d249ed2-9503-4bd9-91f7-e86068a35c69-maas-api-tls") pod "maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf" (UID: "4d249ed2-9503-4bd9-91f7-e86068a35c69") : secret "maas-api-e2e-shared-a-ab95dd-serving-cert" not found Jul 15 23:06:07.992368 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:07.992142 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc48n\" (UniqueName: \"kubernetes.io/projected/4d249ed2-9503-4bd9-91f7-e86068a35c69-kube-api-access-mc48n\") pod \"maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf\" (UID: \"4d249ed2-9503-4bd9-91f7-e86068a35c69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf" Jul 15 23:06:08.489217 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:08.489184 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d249ed2-9503-4bd9-91f7-e86068a35c69-maas-api-tls\") pod \"maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf\" (UID: \"4d249ed2-9503-4bd9-91f7-e86068a35c69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf" Jul 15 23:06:08.491728 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:08.491707 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d249ed2-9503-4bd9-91f7-e86068a35c69-maas-api-tls\") pod \"maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf\" (UID: \"4d249ed2-9503-4bd9-91f7-e86068a35c69\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf" Jul 15 23:06:08.719181 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:08.719149 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf" Jul 15 23:06:08.851249 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:08.851222 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf"] Jul 15 23:06:08.852929 ip-10-0-132-45 kubenswrapper[2560]: W0715 23:06:08.852903 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d249ed2_9503_4bd9_91f7_e86068a35c69.slice/crio-2498ba554bd0e0f5f462c0b84898b2d771c3690ad27a93583a71f21e56c9e685 WatchSource:0}: Error finding container 2498ba554bd0e0f5f462c0b84898b2d771c3690ad27a93583a71f21e56c9e685: Status 404 returned error can't find the container with id 2498ba554bd0e0f5f462c0b84898b2d771c3690ad27a93583a71f21e56c9e685 Jul 15 23:06:08.877348 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:08.877320 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf" event={"ID":"4d249ed2-9503-4bd9-91f7-e86068a35c69","Type":"ContainerStarted","Data":"2498ba554bd0e0f5f462c0b84898b2d771c3690ad27a93583a71f21e56c9e685"} Jul 15 23:06:08.877530 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:08.877506 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:08.878409 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:08.878393 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:09.884126 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:09.884089 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf" event={"ID":"4d249ed2-9503-4bd9-91f7-e86068a35c69","Type":"ContainerStarted","Data":"c00b1cd1c6468053e72eba106154ecbbda90455a2693d7e762aa164922f756e0"} Jul 15 23:06:09.900549 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:09.900499 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf" podStartSLOduration=2.535833202 podStartE2EDuration="2.900485698s" totalImagesPullingTime="364.652496ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:06:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:06:09.898728981 +0000 UTC m=+1979.606526573" watchObservedRunningTime="2026-07-15 23:06:09.900485698 +0000 UTC m=+1979.608283287" Jul 15 23:06:10.061842 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.061816 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:06:10.204067 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.204041 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istio-envoy\") pod \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " Jul 15 23:06:10.204223 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.204104 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-credential-socket\") pod \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " Jul 15 23:06:10.204223 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.204155 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-workload-socket\") pod \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " Jul 15 23:06:10.204223 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.204196 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istio-podinfo\") pod \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " Jul 15 23:06:10.204374 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.204224 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istiod-ca-cert\") pod \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " Jul 15 23:06:10.204374 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.204247 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istio-data\") pod \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " Jul 15 23:06:10.204374 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.204275 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istio-token\") pod \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " Jul 15 23:06:10.204374 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.204311 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zg9vq\" (UniqueName: \"kubernetes.io/projected/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-kube-api-access-zg9vq\") pod \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " Jul 15 23:06:10.204374 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.204337 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-workload-certs\") pod \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\" (UID: \"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23\") " Jul 15 23:06:10.204623 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.204388 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" (UID: "40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:06:10.204623 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.204438 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" (UID: "40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:06:10.204729 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.204645 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" (UID: "40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:06:10.204784 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.204722 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-credential-socket\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:06:10.204784 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.204745 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-workload-socket\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:06:10.205078 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.204805 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" (UID: "40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 23:06:10.205254 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.205236 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istio-data" (OuterVolumeSpecName: "istio-data") pod "40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" (UID: "40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:06:10.206495 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.206472 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" (UID: "40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 23:06:10.206612 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.206543 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-kube-api-access-zg9vq" (OuterVolumeSpecName: "kube-api-access-zg9vq") pod "40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" (UID: "40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23"). InnerVolumeSpecName "kube-api-access-zg9vq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:06:10.206791 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.206774 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" (UID: "40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:06:10.206835 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.206789 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istio-token" (OuterVolumeSpecName: "istio-token") pod "40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" (UID: "40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:06:10.305384 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.305361 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istio-token\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:06:10.305384 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.305385 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zg9vq\" (UniqueName: \"kubernetes.io/projected/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-kube-api-access-zg9vq\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:06:10.305530 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.305397 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-workload-certs\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:06:10.305530 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.305408 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istio-envoy\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:06:10.305530 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.305419 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istio-podinfo\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:06:10.305530 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.305430 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istiod-ca-cert\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:06:10.305530 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.305440 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23-istio-data\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:06:10.890710 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.890614 2560 generic.go:356] "Generic (PLEG): container finished" podID="40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" containerID="f05deea54a9488dbdacc4310517167decab1ac9c451685aab549a37148fcc32a" exitCode=0 Jul 15 23:06:10.890710 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.890670 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" Jul 15 23:06:10.890710 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.890693 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" event={"ID":"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23","Type":"ContainerDied","Data":"f05deea54a9488dbdacc4310517167decab1ac9c451685aab549a37148fcc32a"} Jul 15 23:06:10.891311 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.890747 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2" event={"ID":"40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23","Type":"ContainerDied","Data":"36fc8cbc871b4b7a6ef8602d5ea7b7772bd11488330be034bf4c5c5b79f34c78"} Jul 15 23:06:10.891311 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.890790 2560 scope.go:117] "RemoveContainer" containerID="f05deea54a9488dbdacc4310517167decab1ac9c451685aab549a37148fcc32a" Jul 15 23:06:10.891311 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.891018 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf" Jul 15 23:06:10.900217 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.900201 2560 scope.go:117] "RemoveContainer" containerID="e89f14c0c25b6e9b144ac1903334afd389335986f28c47e7bf24860f8343c0b3" Jul 15 23:06:10.908442 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.908419 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2"] Jul 15 23:06:10.910995 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.910976 2560 scope.go:117] "RemoveContainer" containerID="f05deea54a9488dbdacc4310517167decab1ac9c451685aab549a37148fcc32a" Jul 15 23:06:10.911283 ip-10-0-132-45 kubenswrapper[2560]: E0715 23:06:10.911264 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f05deea54a9488dbdacc4310517167decab1ac9c451685aab549a37148fcc32a\": container with ID starting with f05deea54a9488dbdacc4310517167decab1ac9c451685aab549a37148fcc32a not found: ID does not exist" containerID="f05deea54a9488dbdacc4310517167decab1ac9c451685aab549a37148fcc32a" Jul 15 23:06:10.911354 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.911289 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f05deea54a9488dbdacc4310517167decab1ac9c451685aab549a37148fcc32a"} err="failed to get container status \"f05deea54a9488dbdacc4310517167decab1ac9c451685aab549a37148fcc32a\": rpc error: code = NotFound desc = could not find container \"f05deea54a9488dbdacc4310517167decab1ac9c451685aab549a37148fcc32a\": container with ID starting with f05deea54a9488dbdacc4310517167decab1ac9c451685aab549a37148fcc32a not found: ID does not exist" Jul 15 23:06:10.911354 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.911306 2560 scope.go:117] "RemoveContainer" containerID="e89f14c0c25b6e9b144ac1903334afd389335986f28c47e7bf24860f8343c0b3" Jul 15 23:06:10.911565 ip-10-0-132-45 kubenswrapper[2560]: E0715 23:06:10.911539 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e89f14c0c25b6e9b144ac1903334afd389335986f28c47e7bf24860f8343c0b3\": container with ID starting with e89f14c0c25b6e9b144ac1903334afd389335986f28c47e7bf24860f8343c0b3 not found: ID does not exist" containerID="e89f14c0c25b6e9b144ac1903334afd389335986f28c47e7bf24860f8343c0b3" Jul 15 23:06:10.911619 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.911575 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e89f14c0c25b6e9b144ac1903334afd389335986f28c47e7bf24860f8343c0b3"} err="failed to get container status \"e89f14c0c25b6e9b144ac1903334afd389335986f28c47e7bf24860f8343c0b3\": rpc error: code = NotFound desc = could not find container \"e89f14c0c25b6e9b144ac1903334afd389335986f28c47e7bf24860f8343c0b3\": container with ID starting with e89f14c0c25b6e9b144ac1903334afd389335986f28c47e7bf24860f8343c0b3 not found: ID does not exist" Jul 15 23:06:10.913072 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:10.913055 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-e81434-openshift-default-7bc9447c8c-gdsn2"] Jul 15 23:06:12.844255 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:12.841709 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" path="/var/lib/kubelet/pods/40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23/volumes" Jul 15 23:06:13.824328 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:13.824295 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg"] Jul 15 23:06:13.824713 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:13.824688 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" containerName="istio-proxy" Jul 15 23:06:13.824713 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:13.824708 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" containerName="istio-proxy" Jul 15 23:06:13.824939 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:13.824805 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" containerName="istio-proxy" Jul 15 23:06:13.827810 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:13.827786 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:13.829912 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:13.829891 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-c6dbd3-openshift-default-dockercfg-v59fb\"" Jul 15 23:06:13.839589 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:13.839568 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg"] Jul 15 23:06:13.939464 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:13.939418 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istio-podinfo\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:13.939955 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:13.939486 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-workload-socket\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:13.939955 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:13.939519 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-workload-certs\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:13.939955 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:13.939557 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istio-token\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:13.939955 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:13.939595 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istio-envoy\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:13.939955 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:13.939625 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istiod-ca-cert\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:13.939955 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:13.939648 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istio-data\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:13.939955 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:13.939672 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-credential-socket\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:13.939955 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:13.939728 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vlhb\" (UniqueName: \"kubernetes.io/projected/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-kube-api-access-4vlhb\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:14.040926 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.040888 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istio-podinfo\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:14.041117 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.040942 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-workload-socket\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:14.041117 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.041062 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-workload-certs\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:14.041117 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.041110 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istio-token\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:14.041291 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.041140 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istio-envoy\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:14.041291 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.041160 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istiod-ca-cert\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:14.041291 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.041178 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istio-data\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:14.041291 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.041201 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-credential-socket\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:14.041291 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.041259 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vlhb\" (UniqueName: \"kubernetes.io/projected/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-kube-api-access-4vlhb\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:14.041540 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.041314 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-workload-socket\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:14.041540 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.041360 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-workload-certs\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:14.041636 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.041584 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-credential-socket\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:14.041636 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.041615 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istio-data\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:14.041953 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.041933 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istiod-ca-cert\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:14.043470 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.043448 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istio-envoy\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:14.043658 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.043639 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istio-podinfo\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:14.048159 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.048135 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istio-token\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:14.048455 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.048432 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vlhb\" (UniqueName: \"kubernetes.io/projected/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-kube-api-access-4vlhb\") pod \"e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:14.138248 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.138169 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:14.287108 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.287069 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg"] Jul 15 23:06:14.290193 ip-10-0-132-45 kubenswrapper[2560]: W0715 23:06:14.290165 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a41b7d7_a37f_4ee5_9672_c1f7beb76bf5.slice/crio-2bfd6a2b34e4da93f8271ab94ef49e6ef2baee1de6d91db9c9906a976577d14e WatchSource:0}: Error finding container 2bfd6a2b34e4da93f8271ab94ef49e6ef2baee1de6d91db9c9906a976577d14e: Status 404 returned error can't find the container with id 2bfd6a2b34e4da93f8271ab94ef49e6ef2baee1de6d91db9c9906a976577d14e Jul 15 23:06:14.292768 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.292739 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:06:14.292886 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.292867 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:06:14.292944 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.292914 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:06:14.915657 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.915620 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" event={"ID":"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5","Type":"ContainerStarted","Data":"015894d3bc042bd5de99106e712bc67f2c385cfbd7ae363011d3a253a9c8a035"} Jul 15 23:06:14.915844 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.915684 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" event={"ID":"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5","Type":"ContainerStarted","Data":"2bfd6a2b34e4da93f8271ab94ef49e6ef2baee1de6d91db9c9906a976577d14e"} Jul 15 23:06:14.934225 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:14.934174 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" podStartSLOduration=1.934159879 podStartE2EDuration="1.934159879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:06:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:06:14.933467859 +0000 UTC m=+1984.641265450" watchObservedRunningTime="2026-07-15 23:06:14.934159879 +0000 UTC m=+1984.641957469" Jul 15 23:06:15.138657 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:15.138622 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:15.143471 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:15.143448 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:15.920822 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:15.920796 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:15.921845 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:15.921820 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:16.901359 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:16.901334 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf" Jul 15 23:06:24.603720 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:24.603245 2560 patch_prober.go:28] interesting pod/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": read tcp 10.133.0.2:52470->10.133.0.55:15021: read: connection reset by peer" start-of-body= Jul 15 23:06:24.603720 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:24.603329 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" podUID="1b454bd8-958d-47b5-aa99-afd70ab14b16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": read tcp 10.133.0.2:52470->10.133.0.55:15021: read: connection reset by peer" Jul 15 23:06:24.972789 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:24.972753 2560 generic.go:356] "Generic (PLEG): container finished" podID="1b454bd8-958d-47b5-aa99-afd70ab14b16" containerID="9b550b6de660c57daf727a1ff9cfd968316bb8212cfedd2f7c7040aeb9355a75" exitCode=0 Jul 15 23:06:24.973008 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:24.972804 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" event={"ID":"1b454bd8-958d-47b5-aa99-afd70ab14b16","Type":"ContainerDied","Data":"9b550b6de660c57daf727a1ff9cfd968316bb8212cfedd2f7c7040aeb9355a75"} Jul 15 23:06:24.973276 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:24.973259 2560 scope.go:117] "RemoveContainer" containerID="9b550b6de660c57daf727a1ff9cfd968316bb8212cfedd2f7c7040aeb9355a75" Jul 15 23:06:24.974290 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:24.974259 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:06:24.974384 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:24.974328 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:06:24.974384 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:24.974358 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:06:25.983060 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:25.983025 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" event={"ID":"1b454bd8-958d-47b5-aa99-afd70ab14b16","Type":"ContainerStarted","Data":"fa3a8830eb589c9a12036c15e4e23d63b6e43163f9c001d37474736486b39fe5"} Jul 15 23:06:26.958989 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:26.958954 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:26.959446 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:26.959420 2560 patch_prober.go:28] interesting pod/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 15 23:06:26.959715 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:26.959663 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" podUID="1b454bd8-958d-47b5-aa99-afd70ab14b16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 15 23:06:27.959977 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:27.959935 2560 patch_prober.go:28] interesting pod/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 15 23:06:27.960488 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:27.960006 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" podUID="1b454bd8-958d-47b5-aa99-afd70ab14b16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 15 23:06:28.959869 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:28.959804 2560 patch_prober.go:28] interesting pod/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 15 23:06:28.960101 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:28.959919 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" podUID="1b454bd8-958d-47b5-aa99-afd70ab14b16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 15 23:06:29.960343 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:29.959895 2560 patch_prober.go:28] interesting pod/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 15 23:06:29.960343 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:29.959961 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" podUID="1b454bd8-958d-47b5-aa99-afd70ab14b16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 15 23:06:30.963674 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:30.963643 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:30.964135 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:30.964066 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:30.964906 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:30.964881 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:06:31.962984 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:31.962949 2560 patch_prober.go:28] interesting pod/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 15 23:06:31.963150 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:31.963008 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" podUID="5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 15 23:06:33.032245 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:33.032211 2560 generic.go:356] "Generic (PLEG): container finished" podID="5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5" containerID="015894d3bc042bd5de99106e712bc67f2c385cfbd7ae363011d3a253a9c8a035" exitCode=0 Jul 15 23:06:33.032728 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:33.032265 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" event={"ID":"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5","Type":"ContainerDied","Data":"015894d3bc042bd5de99106e712bc67f2c385cfbd7ae363011d3a253a9c8a035"} Jul 15 23:06:33.032728 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:33.032710 2560 scope.go:117] "RemoveContainer" containerID="015894d3bc042bd5de99106e712bc67f2c385cfbd7ae363011d3a253a9c8a035" Jul 15 23:06:33.033716 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:33.033690 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:06:33.033834 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:33.033755 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:06:33.033834 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:33.033793 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 15 23:06:34.040070 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:34.040035 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" event={"ID":"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5","Type":"ContainerStarted","Data":"03220c858529b4b8d531d71ac25b8be13a09c10941f6951c14a2139934b47f09"} Jul 15 23:06:34.138887 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:34.138827 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:34.139105 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:34.139082 2560 patch_prober.go:28] interesting pod/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 15 23:06:34.139194 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:34.139138 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" podUID="5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 15 23:06:35.139545 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:35.139509 2560 patch_prober.go:28] interesting pod/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 15 23:06:35.139967 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:35.139568 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" podUID="5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 15 23:06:36.138531 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:36.138496 2560 patch_prober.go:28] interesting pod/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 15 23:06:36.138711 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:36.138558 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" podUID="5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 15 23:06:37.139010 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:37.138961 2560 patch_prober.go:28] interesting pod/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 15 23:06:37.139393 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:37.139044 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" podUID="5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 15 23:06:38.154412 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:38.154374 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:38.154816 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:38.154771 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:06:38.155473 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:06:38.155454 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:07:10.992672 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:07:10.992636 2560 scope.go:117] "RemoveContainer" containerID="1a294ff18a851d11844907724d5b64aa01317fa188f17014f0432be11b585fd2" Jul 15 23:08:10.926909 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:08:10.926879 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5q8kf_d57dc934-8cdc-4f82-8ee8-527f9cc60a41/console-operator/1.log" Jul 15 23:08:10.931158 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:08:10.931138 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/ovn-acl-logging/0.log" Jul 15 23:08:10.932471 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:08:10.932439 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5q8kf_d57dc934-8cdc-4f82-8ee8-527f9cc60a41/console-operator/1.log" Jul 15 23:08:10.936696 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:08:10.936678 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/ovn-acl-logging/0.log" Jul 15 23:13:08.800715 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:08.800672 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9"] Jul 15 23:13:08.801236 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:08.800908 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" podUID="1b454bd8-958d-47b5-aa99-afd70ab14b16" containerName="istio-proxy" containerID="cri-o://fa3a8830eb589c9a12036c15e4e23d63b6e43163f9c001d37474736486b39fe5" gracePeriod=30 Jul 15 23:13:10.965635 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:10.965609 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5q8kf_d57dc934-8cdc-4f82-8ee8-527f9cc60a41/console-operator/1.log" Jul 15 23:13:10.970302 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:10.970277 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/ovn-acl-logging/0.log" Jul 15 23:13:10.972422 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:10.972397 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5q8kf_d57dc934-8cdc-4f82-8ee8-527f9cc60a41/console-operator/1.log" Jul 15 23:13:10.976073 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:10.976054 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/ovn-acl-logging/0.log" Jul 15 23:13:14.050975 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.050948 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:13:14.187697 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.187667 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b454bd8-958d-47b5-aa99-afd70ab14b16-istio-podinfo\") pod \"1b454bd8-958d-47b5-aa99-afd70ab14b16\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " Jul 15 23:13:14.187891 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.187752 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-credential-socket\") pod \"1b454bd8-958d-47b5-aa99-afd70ab14b16\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " Jul 15 23:13:14.187891 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.187774 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b454bd8-958d-47b5-aa99-afd70ab14b16-istio-token\") pod \"1b454bd8-958d-47b5-aa99-afd70ab14b16\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " Jul 15 23:13:14.187891 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.187789 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-workload-certs\") pod \"1b454bd8-958d-47b5-aa99-afd70ab14b16\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " Jul 15 23:13:14.187891 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.187838 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-istio-data\") pod \"1b454bd8-958d-47b5-aa99-afd70ab14b16\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " Jul 15 23:13:14.188174 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.187918 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-istio-envoy\") pod \"1b454bd8-958d-47b5-aa99-afd70ab14b16\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " Jul 15 23:13:14.188174 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.187949 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c94d9\" (UniqueName: \"kubernetes.io/projected/1b454bd8-958d-47b5-aa99-afd70ab14b16-kube-api-access-c94d9\") pod \"1b454bd8-958d-47b5-aa99-afd70ab14b16\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " Jul 15 23:13:14.188174 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.187984 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b454bd8-958d-47b5-aa99-afd70ab14b16-istiod-ca-cert\") pod \"1b454bd8-958d-47b5-aa99-afd70ab14b16\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " Jul 15 23:13:14.188174 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.188017 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-workload-socket\") pod \"1b454bd8-958d-47b5-aa99-afd70ab14b16\" (UID: \"1b454bd8-958d-47b5-aa99-afd70ab14b16\") " Jul 15 23:13:14.188174 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.188139 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1b454bd8-958d-47b5-aa99-afd70ab14b16" (UID: "1b454bd8-958d-47b5-aa99-afd70ab14b16"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:13:14.188436 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.188363 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-workload-certs\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:13:14.188492 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.188384 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1b454bd8-958d-47b5-aa99-afd70ab14b16" (UID: "1b454bd8-958d-47b5-aa99-afd70ab14b16"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:13:14.188561 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.188540 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1b454bd8-958d-47b5-aa99-afd70ab14b16" (UID: "1b454bd8-958d-47b5-aa99-afd70ab14b16"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:13:14.188615 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.188447 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b454bd8-958d-47b5-aa99-afd70ab14b16-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1b454bd8-958d-47b5-aa99-afd70ab14b16" (UID: "1b454bd8-958d-47b5-aa99-afd70ab14b16"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 23:13:14.188938 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.188912 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-istio-data" (OuterVolumeSpecName: "istio-data") pod "1b454bd8-958d-47b5-aa99-afd70ab14b16" (UID: "1b454bd8-958d-47b5-aa99-afd70ab14b16"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:13:14.190160 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.190131 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1b454bd8-958d-47b5-aa99-afd70ab14b16-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1b454bd8-958d-47b5-aa99-afd70ab14b16" (UID: "1b454bd8-958d-47b5-aa99-afd70ab14b16"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 23:13:14.190374 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.190351 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b454bd8-958d-47b5-aa99-afd70ab14b16-kube-api-access-c94d9" (OuterVolumeSpecName: "kube-api-access-c94d9") pod "1b454bd8-958d-47b5-aa99-afd70ab14b16" (UID: "1b454bd8-958d-47b5-aa99-afd70ab14b16"). InnerVolumeSpecName "kube-api-access-c94d9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:13:14.190550 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.190515 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b454bd8-958d-47b5-aa99-afd70ab14b16-istio-token" (OuterVolumeSpecName: "istio-token") pod "1b454bd8-958d-47b5-aa99-afd70ab14b16" (UID: "1b454bd8-958d-47b5-aa99-afd70ab14b16"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:13:14.190550 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.190537 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1b454bd8-958d-47b5-aa99-afd70ab14b16" (UID: "1b454bd8-958d-47b5-aa99-afd70ab14b16"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:13:14.227462 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.227430 2560 generic.go:356] "Generic (PLEG): container finished" podID="1b454bd8-958d-47b5-aa99-afd70ab14b16" containerID="fa3a8830eb589c9a12036c15e4e23d63b6e43163f9c001d37474736486b39fe5" exitCode=0 Jul 15 23:13:14.227568 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.227480 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" Jul 15 23:13:14.227568 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.227487 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" event={"ID":"1b454bd8-958d-47b5-aa99-afd70ab14b16","Type":"ContainerDied","Data":"fa3a8830eb589c9a12036c15e4e23d63b6e43163f9c001d37474736486b39fe5"} Jul 15 23:13:14.227568 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.227538 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9" event={"ID":"1b454bd8-958d-47b5-aa99-afd70ab14b16","Type":"ContainerDied","Data":"d7fcbe6224cbe49de0f337b1b047d84e6362c45230921c3f39b8f9e24c6e7e02"} Jul 15 23:13:14.227568 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.227561 2560 scope.go:117] "RemoveContainer" containerID="fa3a8830eb589c9a12036c15e4e23d63b6e43163f9c001d37474736486b39fe5" Jul 15 23:13:14.237277 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.237261 2560 scope.go:117] "RemoveContainer" containerID="9b550b6de660c57daf727a1ff9cfd968316bb8212cfedd2f7c7040aeb9355a75" Jul 15 23:13:14.245342 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.245327 2560 scope.go:117] "RemoveContainer" containerID="fa3a8830eb589c9a12036c15e4e23d63b6e43163f9c001d37474736486b39fe5" Jul 15 23:13:14.245613 ip-10-0-132-45 kubenswrapper[2560]: E0715 23:13:14.245591 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa3a8830eb589c9a12036c15e4e23d63b6e43163f9c001d37474736486b39fe5\": container with ID starting with fa3a8830eb589c9a12036c15e4e23d63b6e43163f9c001d37474736486b39fe5 not found: ID does not exist" containerID="fa3a8830eb589c9a12036c15e4e23d63b6e43163f9c001d37474736486b39fe5" Jul 15 23:13:14.245674 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.245620 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa3a8830eb589c9a12036c15e4e23d63b6e43163f9c001d37474736486b39fe5"} err="failed to get container status \"fa3a8830eb589c9a12036c15e4e23d63b6e43163f9c001d37474736486b39fe5\": rpc error: code = NotFound desc = could not find container \"fa3a8830eb589c9a12036c15e4e23d63b6e43163f9c001d37474736486b39fe5\": container with ID starting with fa3a8830eb589c9a12036c15e4e23d63b6e43163f9c001d37474736486b39fe5 not found: ID does not exist" Jul 15 23:13:14.245674 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.245637 2560 scope.go:117] "RemoveContainer" containerID="9b550b6de660c57daf727a1ff9cfd968316bb8212cfedd2f7c7040aeb9355a75" Jul 15 23:13:14.245971 ip-10-0-132-45 kubenswrapper[2560]: E0715 23:13:14.245946 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b550b6de660c57daf727a1ff9cfd968316bb8212cfedd2f7c7040aeb9355a75\": container with ID starting with 9b550b6de660c57daf727a1ff9cfd968316bb8212cfedd2f7c7040aeb9355a75 not found: ID does not exist" containerID="9b550b6de660c57daf727a1ff9cfd968316bb8212cfedd2f7c7040aeb9355a75" Jul 15 23:13:14.246068 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.245979 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b550b6de660c57daf727a1ff9cfd968316bb8212cfedd2f7c7040aeb9355a75"} err="failed to get container status \"9b550b6de660c57daf727a1ff9cfd968316bb8212cfedd2f7c7040aeb9355a75\": rpc error: code = NotFound desc = could not find container \"9b550b6de660c57daf727a1ff9cfd968316bb8212cfedd2f7c7040aeb9355a75\": container with ID starting with 9b550b6de660c57daf727a1ff9cfd968316bb8212cfedd2f7c7040aeb9355a75 not found: ID does not exist" Jul 15 23:13:14.249512 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.249492 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9"] Jul 15 23:13:14.252868 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.252830 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-ab95dd-openshift-default-5bc458b99f-ffzz9"] Jul 15 23:13:14.289128 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.289104 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-credential-socket\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:13:14.289128 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.289126 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b454bd8-958d-47b5-aa99-afd70ab14b16-istio-token\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:13:14.289243 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.289136 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-istio-data\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:13:14.289243 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.289145 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-istio-envoy\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:13:14.289243 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.289152 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c94d9\" (UniqueName: \"kubernetes.io/projected/1b454bd8-958d-47b5-aa99-afd70ab14b16-kube-api-access-c94d9\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:13:14.289243 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.289162 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b454bd8-958d-47b5-aa99-afd70ab14b16-istiod-ca-cert\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:13:14.289243 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.289170 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b454bd8-958d-47b5-aa99-afd70ab14b16-workload-socket\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:13:14.289243 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.289177 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b454bd8-958d-47b5-aa99-afd70ab14b16-istio-podinfo\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:13:14.841595 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:14.841564 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b454bd8-958d-47b5-aa99-afd70ab14b16" path="/var/lib/kubelet/pods/1b454bd8-958d-47b5-aa99-afd70ab14b16/volumes" Jul 15 23:13:15.454522 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:15.454489 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg"] Jul 15 23:13:15.454954 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:15.454719 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" podUID="5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5" containerName="istio-proxy" containerID="cri-o://03220c858529b4b8d531d71ac25b8be13a09c10941f6951c14a2139934b47f09" gracePeriod=30 Jul 15 23:13:20.705333 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.705309 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:13:20.850362 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.850285 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istio-podinfo\") pod \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " Jul 15 23:13:20.850362 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.850327 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-workload-certs\") pod \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " Jul 15 23:13:20.850615 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.850377 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vlhb\" (UniqueName: \"kubernetes.io/projected/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-kube-api-access-4vlhb\") pod \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " Jul 15 23:13:20.850615 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.850405 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istiod-ca-cert\") pod \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " Jul 15 23:13:20.850615 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.850438 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istio-envoy\") pod \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " Jul 15 23:13:20.850615 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.850496 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istio-data\") pod \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " Jul 15 23:13:20.850615 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.850537 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istio-token\") pod \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " Jul 15 23:13:20.850615 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.850562 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-credential-socket\") pod \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " Jul 15 23:13:20.850957 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.850638 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-workload-socket\") pod \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\" (UID: \"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5\") " Jul 15 23:13:20.850957 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.850707 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5" (UID: "5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:13:20.850957 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.850809 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5" (UID: "5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 23:13:20.851099 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.850999 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5" (UID: "5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:13:20.851099 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.851057 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5" (UID: "5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:13:20.851214 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.851117 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-credential-socket\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:13:20.851214 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.851142 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-workload-certs\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:13:20.851214 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.851156 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istiod-ca-cert\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:13:20.851929 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.851896 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istio-data" (OuterVolumeSpecName: "istio-data") pod "5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5" (UID: "5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:13:20.852659 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.852638 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5" (UID: "5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 23:13:20.852827 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.852806 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istio-token" (OuterVolumeSpecName: "istio-token") pod "5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5" (UID: "5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:13:20.852919 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.852830 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-kube-api-access-4vlhb" (OuterVolumeSpecName: "kube-api-access-4vlhb") pod "5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5" (UID: "5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5"). InnerVolumeSpecName "kube-api-access-4vlhb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:13:20.853023 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.853008 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5" (UID: "5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 23:13:20.951791 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.951759 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istio-data\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:13:20.951791 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.951790 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istio-token\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:13:20.952003 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.951805 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-workload-socket\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:13:20.952003 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.951817 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istio-podinfo\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:13:20.952003 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.951831 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vlhb\" (UniqueName: \"kubernetes.io/projected/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-kube-api-access-4vlhb\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:13:20.952003 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:20.951845 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5-istio-envoy\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jul 15 23:13:21.266639 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:21.266600 2560 generic.go:356] "Generic (PLEG): container finished" podID="5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5" containerID="03220c858529b4b8d531d71ac25b8be13a09c10941f6951c14a2139934b47f09" exitCode=0 Jul 15 23:13:21.266805 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:21.266656 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" Jul 15 23:13:21.266805 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:21.266686 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" event={"ID":"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5","Type":"ContainerDied","Data":"03220c858529b4b8d531d71ac25b8be13a09c10941f6951c14a2139934b47f09"} Jul 15 23:13:21.266805 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:21.266743 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg" event={"ID":"5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5","Type":"ContainerDied","Data":"2bfd6a2b34e4da93f8271ab94ef49e6ef2baee1de6d91db9c9906a976577d14e"} Jul 15 23:13:21.266805 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:21.266767 2560 scope.go:117] "RemoveContainer" containerID="03220c858529b4b8d531d71ac25b8be13a09c10941f6951c14a2139934b47f09" Jul 15 23:13:21.279509 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:21.279493 2560 scope.go:117] "RemoveContainer" containerID="015894d3bc042bd5de99106e712bc67f2c385cfbd7ae363011d3a253a9c8a035" Jul 15 23:13:21.288167 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:21.288148 2560 scope.go:117] "RemoveContainer" containerID="03220c858529b4b8d531d71ac25b8be13a09c10941f6951c14a2139934b47f09" Jul 15 23:13:21.288451 ip-10-0-132-45 kubenswrapper[2560]: E0715 23:13:21.288427 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03220c858529b4b8d531d71ac25b8be13a09c10941f6951c14a2139934b47f09\": container with ID starting with 03220c858529b4b8d531d71ac25b8be13a09c10941f6951c14a2139934b47f09 not found: ID does not exist" containerID="03220c858529b4b8d531d71ac25b8be13a09c10941f6951c14a2139934b47f09" Jul 15 23:13:21.288495 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:21.288464 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03220c858529b4b8d531d71ac25b8be13a09c10941f6951c14a2139934b47f09"} err="failed to get container status \"03220c858529b4b8d531d71ac25b8be13a09c10941f6951c14a2139934b47f09\": rpc error: code = NotFound desc = could not find container \"03220c858529b4b8d531d71ac25b8be13a09c10941f6951c14a2139934b47f09\": container with ID starting with 03220c858529b4b8d531d71ac25b8be13a09c10941f6951c14a2139934b47f09 not found: ID does not exist" Jul 15 23:13:21.288495 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:21.288484 2560 scope.go:117] "RemoveContainer" containerID="015894d3bc042bd5de99106e712bc67f2c385cfbd7ae363011d3a253a9c8a035" Jul 15 23:13:21.288694 ip-10-0-132-45 kubenswrapper[2560]: E0715 23:13:21.288675 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"015894d3bc042bd5de99106e712bc67f2c385cfbd7ae363011d3a253a9c8a035\": container with ID starting with 015894d3bc042bd5de99106e712bc67f2c385cfbd7ae363011d3a253a9c8a035 not found: ID does not exist" containerID="015894d3bc042bd5de99106e712bc67f2c385cfbd7ae363011d3a253a9c8a035" Jul 15 23:13:21.288738 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:21.288703 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"015894d3bc042bd5de99106e712bc67f2c385cfbd7ae363011d3a253a9c8a035"} err="failed to get container status \"015894d3bc042bd5de99106e712bc67f2c385cfbd7ae363011d3a253a9c8a035\": rpc error: code = NotFound desc = could not find container \"015894d3bc042bd5de99106e712bc67f2c385cfbd7ae363011d3a253a9c8a035\": container with ID starting with 015894d3bc042bd5de99106e712bc67f2c385cfbd7ae363011d3a253a9c8a035 not found: ID does not exist" Jul 15 23:13:21.289452 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:21.289432 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg"] Jul 15 23:13:21.292781 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:21.292762 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-c6dbd3-openshift-default-677796d79f-gn9jg"] Jul 15 23:13:21.817179 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:21.817155 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7db6597b7c-2kg49_769689a2-3327-4fee-8cc4-e2315eb39c97/copy-manifests/0.log" Jul 15 23:13:21.823300 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:21.823281 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7db6597b7c-2kg49_769689a2-3327-4fee-8cc4-e2315eb39c97/manager/0.log" Jul 15 23:13:22.613986 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:22.613961 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-api-a-9171f6-7946bbcbb9-hw6xf_4dca009a-6fc9-4b2d-af9e-316a693f73b6/maas-api/0.log" Jul 15 23:13:22.841183 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:22.841150 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5" path="/var/lib/kubelet/pods/5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5/volumes" Jul 15 23:13:22.955745 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:22.955723 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-inf-a-83ad46-c68cbdb4d-vxw5h_0291c7d1-5d95-405b-bbca-832b5eabda26/maas-api/0.log" Jul 15 23:13:23.064038 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:23.064017 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-inf-b-2b485c-664f799997-nbtj6_6a891ec6-b8bf-4dc7-b86a-e6ed0f06597a/maas-api/0.log" Jul 15 23:13:23.283423 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:23.283368 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-mt-03f59fb7-9669c4486-s6xwn_4a4e6f69-6521-405c-87d9-ee7354f0c293/maas-api/0.log" Jul 15 23:13:23.392892 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:23.392867 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-shared-a-ab95dd-69f74dcbfc-jkjnf_4d249ed2-9503-4bd9-91f7-e86068a35c69/maas-api/0.log" Jul 15 23:13:23.610551 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:23.610489 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735925-l9hlx_bc715354-656b-4a25-a000-2d7720ddc424/cleanup/0.log" Jul 15 23:13:23.716241 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:23.716224 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735940-wwqnv_14cab98b-eca1-4b62-978e-bda3b0fbdbb5/cleanup/0.log" Jul 15 23:13:23.930310 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:23.930293 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-migrate-56f79d48-29735940-6s5tk_feda4e44-6dc3-4cd4-828a-74997f3fb5e3/cleanup/0.log" Jul 15 23:13:24.786500 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:24.786472 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg_50199233-8839-4d21-a9bd-e30c547381fe/util/0.log" Jul 15 23:13:24.792076 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:24.792053 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg_50199233-8839-4d21-a9bd-e30c547381fe/pull/0.log" Jul 15 23:13:24.797468 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:24.797450 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg_50199233-8839-4d21-a9bd-e30c547381fe/extract/0.log" Jul 15 23:13:24.903737 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:24.903715 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs_2aa1654d-ba81-40a7-a2ba-cd59d28b751e/util/0.log" Jul 15 23:13:24.909905 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:24.909886 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs_2aa1654d-ba81-40a7-a2ba-cd59d28b751e/pull/0.log" Jul 15 23:13:24.915832 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:24.915816 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs_2aa1654d-ba81-40a7-a2ba-cd59d28b751e/extract/0.log" Jul 15 23:13:25.025211 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:25.025190 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl_9ea01b42-fb4e-46fa-a95e-4fe3b2a52453/util/0.log" Jul 15 23:13:25.031178 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:25.031155 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl_9ea01b42-fb4e-46fa-a95e-4fe3b2a52453/pull/0.log" Jul 15 23:13:25.036831 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:25.036779 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl_9ea01b42-fb4e-46fa-a95e-4fe3b2a52453/extract/0.log" Jul 15 23:13:25.145745 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:25.145727 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l_8e2dd678-b2be-494b-bc03-77515a86e1e3/util/0.log" Jul 15 23:13:25.152951 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:25.152927 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l_8e2dd678-b2be-494b-bc03-77515a86e1e3/pull/0.log" Jul 15 23:13:25.158901 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:25.158878 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l_8e2dd678-b2be-494b-bc03-77515a86e1e3/extract/0.log" Jul 15 23:13:26.405189 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:26.405158 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4c8dfn_7b953d31-cbb1-44e8-99bd-4d41029dd395/istio-proxy/0.log" Jul 15 23:13:26.520998 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:26.520968 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8g8bz_f600a088-10a7-4e79-a519-8a3a18839563/discovery/0.log" Jul 15 23:13:26.857967 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:26.857937 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r59t7_1048ac31-134e-427d-bb33-020f726ff1ca/istio-proxy/1.log" Jul 15 23:13:27.193307 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:27.193281 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-648694dcdd-k656d_f4c8e27d-68fe-4f3e-be10-c9995397ce75/router/0.log" Jul 15 23:13:27.539437 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:27.539366 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-pw8ln_c6ddaa05-1572-4875-b8c8-96e53d9f00a3/main/0.log" Jul 15 23:13:27.764895 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:27.764871 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-cntcb_badb4898-5807-49a0-9648-ab8deca6f1ac/main/0.log" Jul 15 23:13:36.272663 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:36.272591 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dvf88_23a965f4-47c0-432e-9676-53861bba6186/global-pull-secret-syncer/0.log" Jul 15 23:13:36.462248 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:36.462219 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xgqq7_c60b5390-688d-46bb-a3f8-70b746073689/konnectivity-agent/0.log" Jul 15 23:13:36.501353 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:36.501305 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-45.ec2.internal_d92af667d32b12b1c5e1720a5f8568a2/haproxy/0.log" Jul 15 23:13:40.065997 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:40.065966 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg_50199233-8839-4d21-a9bd-e30c547381fe/extract/0.log" Jul 15 23:13:40.093400 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:40.093375 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg_50199233-8839-4d21-a9bd-e30c547381fe/util/0.log" Jul 15 23:13:40.122152 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:40.122124 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ds5fg_50199233-8839-4d21-a9bd-e30c547381fe/pull/0.log" Jul 15 23:13:40.188537 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:40.188510 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs_2aa1654d-ba81-40a7-a2ba-cd59d28b751e/extract/0.log" Jul 15 23:13:40.212776 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:40.212750 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs_2aa1654d-ba81-40a7-a2ba-cd59d28b751e/util/0.log" Jul 15 23:13:40.238968 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:40.238934 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082vhs_2aa1654d-ba81-40a7-a2ba-cd59d28b751e/pull/0.log" Jul 15 23:13:40.276810 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:40.276782 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl_9ea01b42-fb4e-46fa-a95e-4fe3b2a52453/extract/0.log" Jul 15 23:13:40.327536 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:40.327487 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl_9ea01b42-fb4e-46fa-a95e-4fe3b2a52453/util/0.log" Jul 15 23:13:40.354365 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:40.354343 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wkjzl_9ea01b42-fb4e-46fa-a95e-4fe3b2a52453/pull/0.log" Jul 15 23:13:40.387101 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:40.387080 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l_8e2dd678-b2be-494b-bc03-77515a86e1e3/extract/0.log" Jul 15 23:13:40.408407 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:40.408379 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l_8e2dd678-b2be-494b-bc03-77515a86e1e3/util/0.log" Jul 15 23:13:40.435617 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:40.435601 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6p2l_8e2dd678-b2be-494b-bc03-77515a86e1e3/pull/0.log" Jul 15 23:13:43.080979 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:43.080950 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-h7fk8_737eff29-32ba-455b-9797-2f28637bc394/cluster-monitoring-operator/0.log" Jul 15 23:13:43.318698 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:43.318659 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ql8wq_3e897562-13f1-476a-aca0-2f505457e71e/node-exporter/0.log" Jul 15 23:13:43.338748 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:43.338685 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ql8wq_3e897562-13f1-476a-aca0-2f505457e71e/kube-rbac-proxy/0.log" Jul 15 23:13:43.363014 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:43.362985 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ql8wq_3e897562-13f1-476a-aca0-2f505457e71e/init-textfile/0.log" Jul 15 23:13:45.671736 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:45.671707 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-qrbzd_c52ad677-93ac-46bf-ab02-65226d1863a2/networking-console-plugin/0.log" Jul 15 23:13:46.298666 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:46.298640 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5q8kf_d57dc934-8cdc-4f82-8ee8-527f9cc60a41/console-operator/1.log" Jul 15 23:13:46.303686 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:46.303667 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5q8kf_d57dc934-8cdc-4f82-8ee8-527f9cc60a41/console-operator/2.log" Jul 15 23:13:47.501066 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:47.501034 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-9wb62_8cf4b329-d324-41a2-8c29-455e212189df/volume-data-source-validator/0.log" Jul 15 23:13:48.521412 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:48.521379 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kxgqn_ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c/dns/0.log" Jul 15 23:13:48.542706 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:48.542681 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kxgqn_ca0fceae-7b24-4c57-b6cd-5f9ce395ea6c/kube-rbac-proxy/0.log" Jul 15 23:13:48.654729 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:48.654703 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vnktr_2909cc24-d826-42da-9d30-14a4ec63267d/dns-node-resolver/0.log" Jul 15 23:13:49.238342 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:49.238317 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jgsqh_ad4d4e81-c00a-4d74-b409-2c7ec97c3002/node-ca/0.log" Jul 15 23:13:50.160193 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.160164 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4c8dfn_7b953d31-cbb1-44e8-99bd-4d41029dd395/istio-proxy/0.log" Jul 15 23:13:50.257364 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.257333 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8g8bz_f600a088-10a7-4e79-a519-8a3a18839563/discovery/0.log" Jul 15 23:13:50.332332 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.332304 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r59t7_1048ac31-134e-427d-bb33-020f726ff1ca/istio-proxy/0.log" Jul 15 23:13:50.363989 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.363964 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r59t7_1048ac31-134e-427d-bb33-020f726ff1ca/istio-proxy/1.log" Jul 15 23:13:50.407639 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.407616 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp"] Jul 15 23:13:50.408016 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.408004 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" containerName="istio-proxy" Jul 15 23:13:50.408065 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.408018 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" containerName="istio-proxy" Jul 15 23:13:50.408065 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.408028 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5" containerName="istio-proxy" Jul 15 23:13:50.408065 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.408033 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5" containerName="istio-proxy" Jul 15 23:13:50.408065 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.408048 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5" containerName="istio-proxy" Jul 15 23:13:50.408065 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.408054 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5" containerName="istio-proxy" Jul 15 23:13:50.408215 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.408070 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b454bd8-958d-47b5-aa99-afd70ab14b16" containerName="istio-proxy" Jul 15 23:13:50.408215 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.408076 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b454bd8-958d-47b5-aa99-afd70ab14b16" containerName="istio-proxy" Jul 15 23:13:50.408215 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.408083 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b454bd8-958d-47b5-aa99-afd70ab14b16" containerName="istio-proxy" Jul 15 23:13:50.408215 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.408087 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b454bd8-958d-47b5-aa99-afd70ab14b16" containerName="istio-proxy" Jul 15 23:13:50.408215 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.408143 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5" containerName="istio-proxy" Jul 15 23:13:50.408215 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.408151 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="40ced9b3-7b9b-4e6c-bd29-eeb3a51fea23" containerName="istio-proxy" Jul 15 23:13:50.408215 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.408159 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a41b7d7-a37f-4ee5-9672-c1f7beb76bf5" containerName="istio-proxy" Jul 15 23:13:50.408215 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.408166 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b454bd8-958d-47b5-aa99-afd70ab14b16" containerName="istio-proxy" Jul 15 23:13:50.408215 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.408172 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b454bd8-958d-47b5-aa99-afd70ab14b16" containerName="istio-proxy" Jul 15 23:13:50.410238 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.410197 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp" Jul 15 23:13:50.412216 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.412197 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wh22x\"/\"openshift-service-ca.crt\"" Jul 15 23:13:50.412332 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.412197 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wh22x\"/\"kube-root-ca.crt\"" Jul 15 23:13:50.412927 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.412843 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wh22x\"/\"default-dockercfg-77s8m\"" Jul 15 23:13:50.421704 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.421681 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp"] Jul 15 23:13:50.463011 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.462992 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-648694dcdd-k656d_f4c8e27d-68fe-4f3e-be10-c9995397ce75/router/0.log" Jul 15 23:13:50.491349 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.491317 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxm9g\" (UniqueName: \"kubernetes.io/projected/fc685d84-3a45-4a4d-90b1-07dd46e3e7c3-kube-api-access-fxm9g\") pod \"perf-node-gather-daemonset-sdlcp\" (UID: \"fc685d84-3a45-4a4d-90b1-07dd46e3e7c3\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp" Jul 15 23:13:50.491485 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.491363 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc685d84-3a45-4a4d-90b1-07dd46e3e7c3-sys\") pod \"perf-node-gather-daemonset-sdlcp\" (UID: \"fc685d84-3a45-4a4d-90b1-07dd46e3e7c3\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp" Jul 15 23:13:50.491485 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.491381 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc685d84-3a45-4a4d-90b1-07dd46e3e7c3-proc\") pod \"perf-node-gather-daemonset-sdlcp\" (UID: \"fc685d84-3a45-4a4d-90b1-07dd46e3e7c3\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp" Jul 15 23:13:50.491485 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.491436 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc685d84-3a45-4a4d-90b1-07dd46e3e7c3-lib-modules\") pod \"perf-node-gather-daemonset-sdlcp\" (UID: \"fc685d84-3a45-4a4d-90b1-07dd46e3e7c3\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp" Jul 15 23:13:50.491485 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.491477 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc685d84-3a45-4a4d-90b1-07dd46e3e7c3-podres\") pod \"perf-node-gather-daemonset-sdlcp\" (UID: \"fc685d84-3a45-4a4d-90b1-07dd46e3e7c3\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp" Jul 15 23:13:50.592624 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.592596 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxm9g\" (UniqueName: \"kubernetes.io/projected/fc685d84-3a45-4a4d-90b1-07dd46e3e7c3-kube-api-access-fxm9g\") pod \"perf-node-gather-daemonset-sdlcp\" (UID: \"fc685d84-3a45-4a4d-90b1-07dd46e3e7c3\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp" Jul 15 23:13:50.592743 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.592636 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc685d84-3a45-4a4d-90b1-07dd46e3e7c3-sys\") pod \"perf-node-gather-daemonset-sdlcp\" (UID: \"fc685d84-3a45-4a4d-90b1-07dd46e3e7c3\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp" Jul 15 23:13:50.592743 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.592651 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc685d84-3a45-4a4d-90b1-07dd46e3e7c3-proc\") pod \"perf-node-gather-daemonset-sdlcp\" (UID: \"fc685d84-3a45-4a4d-90b1-07dd46e3e7c3\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp" Jul 15 23:13:50.592743 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.592673 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc685d84-3a45-4a4d-90b1-07dd46e3e7c3-lib-modules\") pod \"perf-node-gather-daemonset-sdlcp\" (UID: \"fc685d84-3a45-4a4d-90b1-07dd46e3e7c3\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp" Jul 15 23:13:50.592743 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.592700 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc685d84-3a45-4a4d-90b1-07dd46e3e7c3-podres\") pod \"perf-node-gather-daemonset-sdlcp\" (UID: \"fc685d84-3a45-4a4d-90b1-07dd46e3e7c3\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp" Jul 15 23:13:50.592964 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.592742 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc685d84-3a45-4a4d-90b1-07dd46e3e7c3-proc\") pod \"perf-node-gather-daemonset-sdlcp\" (UID: \"fc685d84-3a45-4a4d-90b1-07dd46e3e7c3\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp" Jul 15 23:13:50.592964 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.592742 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc685d84-3a45-4a4d-90b1-07dd46e3e7c3-sys\") pod \"perf-node-gather-daemonset-sdlcp\" (UID: \"fc685d84-3a45-4a4d-90b1-07dd46e3e7c3\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp" Jul 15 23:13:50.592964 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.592825 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc685d84-3a45-4a4d-90b1-07dd46e3e7c3-podres\") pod \"perf-node-gather-daemonset-sdlcp\" (UID: \"fc685d84-3a45-4a4d-90b1-07dd46e3e7c3\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp" Jul 15 23:13:50.592964 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.592840 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc685d84-3a45-4a4d-90b1-07dd46e3e7c3-lib-modules\") pod \"perf-node-gather-daemonset-sdlcp\" (UID: \"fc685d84-3a45-4a4d-90b1-07dd46e3e7c3\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp" Jul 15 23:13:50.599739 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.599714 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxm9g\" (UniqueName: \"kubernetes.io/projected/fc685d84-3a45-4a4d-90b1-07dd46e3e7c3-kube-api-access-fxm9g\") pod \"perf-node-gather-daemonset-sdlcp\" (UID: \"fc685d84-3a45-4a4d-90b1-07dd46e3e7c3\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp" Jul 15 23:13:50.721352 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.721331 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp" Jul 15 23:13:50.854455 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:50.854430 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp"] Jul 15 23:13:50.856335 ip-10-0-132-45 kubenswrapper[2560]: W0715 23:13:50.856296 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfc685d84_3a45_4a4d_90b1_07dd46e3e7c3.slice/crio-e7de258363b900e8c99fe1c945e36bc7618d50c91a1f8c5383cd131a89a7bbca WatchSource:0}: Error finding container e7de258363b900e8c99fe1c945e36bc7618d50c91a1f8c5383cd131a89a7bbca: Status 404 returned error can't find the container with id e7de258363b900e8c99fe1c945e36bc7618d50c91a1f8c5383cd131a89a7bbca Jul 15 23:13:51.203720 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:51.203691 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jfckj_977c5892-fbf7-4dbe-9e69-7b084b7095bf/serve-healthcheck-canary/0.log" Jul 15 23:13:51.428542 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:51.428507 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp" event={"ID":"fc685d84-3a45-4a4d-90b1-07dd46e3e7c3","Type":"ContainerStarted","Data":"71445e14b5d3c83db2967c3b083424e402a0adbb0213334d9809e5a652dda7fc"} Jul 15 23:13:51.428707 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:51.428564 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp" event={"ID":"fc685d84-3a45-4a4d-90b1-07dd46e3e7c3","Type":"ContainerStarted","Data":"e7de258363b900e8c99fe1c945e36bc7618d50c91a1f8c5383cd131a89a7bbca"} Jul 15 23:13:51.428707 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:51.428647 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp" Jul 15 23:13:51.442904 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:51.442825 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp" podStartSLOduration=1.442808405 podStartE2EDuration="1.442808405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:13:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:13:51.441934629 +0000 UTC m=+2441.149732224" watchObservedRunningTime="2026-07-15 23:13:51.442808405 +0000 UTC m=+2441.150606000" Jul 15 23:13:51.663333 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:51.663248 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-slh2k_1e0e4204-98b9-48ae-b4c6-f0fba1e4d854/insights-operator/0.log" Jul 15 23:13:51.664189 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:51.664165 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-slh2k_1e0e4204-98b9-48ae-b4c6-f0fba1e4d854/insights-operator/1.log" Jul 15 23:13:51.686270 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:51.686250 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h6hhv_abd7af7a-164e-4d37-a0d5-9c19c66ac07c/kube-rbac-proxy/0.log" Jul 15 23:13:51.706362 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:51.706340 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h6hhv_abd7af7a-164e-4d37-a0d5-9c19c66ac07c/exporter/0.log" Jul 15 23:13:51.725646 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:51.725624 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h6hhv_abd7af7a-164e-4d37-a0d5-9c19c66ac07c/extractor/0.log" Jul 15 23:13:54.289183 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:54.289157 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7db6597b7c-2kg49_769689a2-3327-4fee-8cc4-e2315eb39c97/manager/0.log" Jul 15 23:13:54.309220 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:54.309195 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7db6597b7c-2kg49_769689a2-3327-4fee-8cc4-e2315eb39c97/copy-manifests/0.log" Jul 15 23:13:55.601235 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:55.601206 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5cf7bf55db-gl6gk_e7dc3722-9db7-4478-97db-5f5763140b16/manager/0.log" Jul 15 23:13:56.775050 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:56.775016 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4c8dfn_7b953d31-cbb1-44e8-99bd-4d41029dd395/istio-proxy/0.log" Jul 15 23:13:56.868505 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:56.868476 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8g8bz_f600a088-10a7-4e79-a519-8a3a18839563/discovery/0.log" Jul 15 23:13:56.912286 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:56.912260 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r59t7_1048ac31-134e-427d-bb33-020f726ff1ca/istio-proxy/0.log" Jul 15 23:13:56.938539 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:56.938508 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r59t7_1048ac31-134e-427d-bb33-020f726ff1ca/istio-proxy/1.log" Jul 15 23:13:56.988501 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:56.988480 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-648694dcdd-k656d_f4c8e27d-68fe-4f3e-be10-c9995397ce75/router/0.log" Jul 15 23:13:57.444485 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:57.444458 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-sdlcp" Jul 15 23:13:58.080321 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:58.080294 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4c8dfn_7b953d31-cbb1-44e8-99bd-4d41029dd395/istio-proxy/0.log" Jul 15 23:13:58.175153 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:58.175124 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8g8bz_f600a088-10a7-4e79-a519-8a3a18839563/discovery/0.log" Jul 15 23:13:58.236149 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:58.236125 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r59t7_1048ac31-134e-427d-bb33-020f726ff1ca/istio-proxy/0.log" Jul 15 23:13:58.264274 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:58.264247 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r59t7_1048ac31-134e-427d-bb33-020f726ff1ca/istio-proxy/1.log" Jul 15 23:13:58.322632 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:13:58.322611 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-648694dcdd-k656d_f4c8e27d-68fe-4f3e-be10-c9995397ce75/router/0.log" Jul 15 23:14:01.006607 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:01.006571 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-rm49r_c457296e-9f39-44cf-850d-f0c2de93e13a/kube-storage-version-migrator-operator/1.log" Jul 15 23:14:01.007568 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:01.007545 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-rm49r_c457296e-9f39-44cf-850d-f0c2de93e13a/kube-storage-version-migrator-operator/0.log" Jul 15 23:14:02.404160 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:02.404134 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6wpj_163d94d1-6930-4f2d-9fdf-3414a8d0071e/kube-multus-additional-cni-plugins/0.log" Jul 15 23:14:02.423388 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:02.423364 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6wpj_163d94d1-6930-4f2d-9fdf-3414a8d0071e/egress-router-binary-copy/0.log" Jul 15 23:14:02.442471 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:02.442449 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6wpj_163d94d1-6930-4f2d-9fdf-3414a8d0071e/cni-plugins/0.log" Jul 15 23:14:02.462746 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:02.462718 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6wpj_163d94d1-6930-4f2d-9fdf-3414a8d0071e/bond-cni-plugin/0.log" Jul 15 23:14:02.481705 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:02.481687 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6wpj_163d94d1-6930-4f2d-9fdf-3414a8d0071e/routeoverride-cni/0.log" Jul 15 23:14:02.501887 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:02.501847 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6wpj_163d94d1-6930-4f2d-9fdf-3414a8d0071e/whereabouts-cni-bincopy/0.log" Jul 15 23:14:02.520984 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:02.520958 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6wpj_163d94d1-6930-4f2d-9fdf-3414a8d0071e/whereabouts-cni/0.log" Jul 15 23:14:02.558656 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:02.558637 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-km6gb_7c1ed5d4-21de-48c5-8484-c48f03cc84f4/kube-multus/0.log" Jul 15 23:14:02.752152 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:02.752121 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qmvbm_ff68c09e-7343-4947-8750-7fa6e793287c/network-metrics-daemon/0.log" Jul 15 23:14:02.775294 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:02.775266 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qmvbm_ff68c09e-7343-4947-8750-7fa6e793287c/kube-rbac-proxy/0.log" Jul 15 23:14:03.744094 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:03.744065 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/ovn-controller/0.log" Jul 15 23:14:03.764168 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:03.764141 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/ovn-acl-logging/1.log" Jul 15 23:14:03.764298 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:03.764177 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/ovn-acl-logging/0.log" Jul 15 23:14:03.782943 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:03.782921 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/kube-rbac-proxy-node/0.log" Jul 15 23:14:03.807208 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:03.807188 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/kube-rbac-proxy-ovn-metrics/0.log" Jul 15 23:14:03.830382 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:03.830363 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/northd/0.log" Jul 15 23:14:03.872639 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:03.872618 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/nbdb/0.log" Jul 15 23:14:03.905447 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:03.905254 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/sbdb/0.log" Jul 15 23:14:03.961195 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:03.961173 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f7fk4_162185e2-da05-43cd-9b88-f2fa765a4a55/ovnkube-controller/0.log" Jul 15 23:14:05.446284 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:05.446256 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-869dcfcdcd-wslf7_a9449068-86e9-4d65-b4bb-5e547dce7a53/check-endpoints/0.log" Jul 15 23:14:05.517914 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:05.517884 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-x64tv_6fe341c4-845e-4412-a026-ea8463d7191c/network-check-target-container/0.log" Jul 15 23:14:06.584155 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:06.584123 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-xk42n_292fa64f-5495-4b75-8ac8-8d4893320cc1/iptables-alerter/0.log" Jul 15 23:14:07.296901 ip-10-0-132-45 kubenswrapper[2560]: I0715 23:14:07.296846 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-rgnf2_273e80ff-3bbf-4a4f-ab09-4a1c3e1f4d2a/tuned/0.log"