Jul 15 13:27:12.231201 ip-10-0-129-45 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 15 13:27:12.231214 ip-10-0-129-45 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 15 13:27:12.231223 ip-10-0-129-45 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 15 13:27:12.231532 ip-10-0-129-45 systemd[1]: Failed to start Kubernetes Kubelet. Jul 15 13:27:22.480770 ip-10-0-129-45 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 15 13:27:22.480793 ip-10-0-129-45 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 46de2ba6c2034b08879a81137d8f87cd -- Jul 15 13:28:59.746994 ip-10-0-129-45 systemd[1]: Starting Kubernetes Kubelet... Jul 15 13:29:00.255072 ip-10-0-129-45 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 13:29:00.255072 ip-10-0-129-45 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 13:29:00.255072 ip-10-0-129-45 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 13:29:00.255072 ip-10-0-129-45 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 13:29:00.255072 ip-10-0-129-45 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 13:29:00.255072 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.204932 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 13:29:00.255072 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210582 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 13:29:00.255072 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210595 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 13:29:00.255072 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210616 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 13:29:00.255072 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210619 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 13:29:00.255072 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210622 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 13:29:00.255072 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210625 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 13:29:00.255072 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210627 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 13:29:00.255072 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210634 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 13:29:00.552128 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210637 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 13:29:00.552128 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210640 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 13:29:00.552128 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210643 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 13:29:00.552128 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210645 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 13:29:00.552128 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210648 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 13:29:00.552128 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210650 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 13:29:00.552128 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210653 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 13:29:00.552128 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210656 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 13:29:00.552128 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210659 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 13:29:00.552128 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210661 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 13:29:00.552128 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210664 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 13:29:00.552128 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210667 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 13:29:00.552128 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210669 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 13:29:00.552128 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210672 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 13:29:00.552128 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210675 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 13:29:00.552128 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210677 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 13:29:00.552128 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210680 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 13:29:00.552128 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210682 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 13:29:00.552128 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210685 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 13:29:00.552128 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210687 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 13:29:00.300895 ip-10-0-129-45 systemd[1]: Started Kubernetes Kubelet. Jul 15 13:29:00.554144 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210691 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 13:29:00.554144 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210693 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 13:29:00.554144 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210697 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 13:29:00.554144 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210699 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 13:29:00.554144 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210703 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 13:29:00.554144 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210707 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 13:29:00.554144 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210711 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 13:29:00.554144 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210714 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 13:29:00.554144 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210716 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 13:29:00.554144 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210719 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 13:29:00.554144 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210722 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 13:29:00.554144 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210725 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 13:29:00.554144 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210727 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 13:29:00.554144 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210730 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 13:29:00.554144 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210733 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 13:29:00.554144 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210735 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 13:29:00.554144 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210738 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 13:29:00.554144 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210740 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 13:29:00.554144 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210743 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 13:29:00.555126 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210745 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 13:29:00.555126 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210748 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 13:29:00.555126 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210750 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 13:29:00.555126 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210753 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 13:29:00.555126 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210756 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 13:29:00.555126 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210758 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 13:29:00.555126 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210761 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 13:29:00.555126 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210765 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 13:29:00.555126 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210768 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 13:29:00.555126 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210772 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 13:29:00.555126 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210774 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 13:29:00.555126 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210779 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 13:29:00.555126 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210782 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 13:29:00.555126 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210785 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 13:29:00.555126 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210789 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 13:29:00.555126 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210792 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 13:29:00.555126 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210795 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 13:29:00.555126 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210797 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 13:29:00.555126 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210800 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 13:29:00.556978 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210803 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 13:29:00.556978 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210806 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 13:29:00.556978 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210808 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 13:29:00.556978 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210810 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 13:29:00.556978 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210813 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 13:29:00.556978 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210817 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 13:29:00.556978 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210819 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 13:29:00.556978 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210822 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 13:29:00.556978 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210825 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 13:29:00.556978 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210827 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 15 13:29:00.556978 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210830 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 13:29:00.556978 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210832 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 13:29:00.556978 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210835 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 13:29:00.556978 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210837 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 13:29:00.556978 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210841 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 13:29:00.556978 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210843 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 13:29:00.556978 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210846 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 13:29:00.556978 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210848 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 13:29:00.556978 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210851 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 13:29:00.556978 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210854 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 13:29:00.558391 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210856 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 13:29:00.558391 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210862 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 13:29:00.558391 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210865 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 13:29:00.558391 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210867 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 13:29:00.558391 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210870 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 13:29:00.558391 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210873 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 13:29:00.558391 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210875 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 13:29:00.558391 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210878 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 13:29:00.558391 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210880 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 13:29:00.558391 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210883 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 13:29:00.558391 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210885 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 13:29:00.558391 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210887 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 13:29:00.558391 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.210890 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 13:29:00.558391 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211581 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 13:29:00.558391 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211587 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 13:29:00.558391 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211590 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 13:29:00.558391 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211593 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 13:29:00.558391 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211611 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 13:29:00.558391 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211616 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 13:29:00.558391 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211618 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 13:29:00.559230 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211622 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 13:29:00.559230 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211626 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 13:29:00.559230 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211629 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 13:29:00.559230 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211632 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 13:29:00.559230 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211635 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 13:29:00.559230 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211638 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 13:29:00.559230 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211641 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 13:29:00.559230 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211645 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 13:29:00.559230 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211647 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 13:29:00.559230 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211650 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 13:29:00.559230 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211653 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 13:29:00.559230 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211655 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 13:29:00.559230 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211658 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 13:29:00.559230 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211663 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 13:29:00.559230 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211665 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 13:29:00.559230 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211668 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 13:29:00.559230 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211671 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 13:29:00.559230 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211673 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 13:29:00.559230 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211676 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 13:29:00.559230 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211678 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 13:29:00.560062 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211682 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 13:29:00.560062 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211684 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 13:29:00.560062 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211687 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 13:29:00.560062 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211690 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 13:29:00.560062 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211692 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 13:29:00.560062 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211695 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 13:29:00.560062 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211698 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 13:29:00.560062 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211700 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 13:29:00.560062 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211703 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 13:29:00.560062 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211706 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 13:29:00.560062 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211708 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 13:29:00.560062 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211712 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 13:29:00.560062 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211716 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 13:29:00.560062 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211720 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 13:29:00.560062 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211723 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 13:29:00.560062 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211725 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 13:29:00.560062 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211728 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 13:29:00.560062 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211731 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 13:29:00.560062 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211734 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 13:29:00.560913 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211736 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 13:29:00.560913 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211739 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 13:29:00.560913 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211741 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 13:29:00.560913 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211744 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 13:29:00.560913 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211746 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 13:29:00.560913 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211749 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 13:29:00.560913 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211753 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 13:29:00.560913 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211756 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 13:29:00.560913 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211760 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 13:29:00.560913 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211763 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 13:29:00.560913 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211766 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 13:29:00.560913 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211769 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 13:29:00.560913 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211772 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 13:29:00.560913 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211775 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 13:29:00.560913 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211778 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 13:29:00.560913 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211783 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 13:29:00.560913 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211785 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 13:29:00.560913 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211788 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 13:29:00.560913 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211791 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 13:29:00.560913 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211793 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 13:29:00.561507 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211796 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 13:29:00.561507 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211799 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 13:29:00.561507 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211802 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 13:29:00.561507 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211804 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 13:29:00.561507 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211807 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 13:29:00.561507 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211810 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 13:29:00.561507 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211813 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 13:29:00.561507 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211815 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 13:29:00.561507 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211818 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 15 13:29:00.561507 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211820 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 13:29:00.561507 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211823 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 13:29:00.561507 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211825 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 13:29:00.561507 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211828 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 13:29:00.561507 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211831 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 13:29:00.561507 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211833 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 13:29:00.561507 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211835 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 13:29:00.561507 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211838 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 13:29:00.561507 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211841 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 13:29:00.561507 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211844 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 13:29:00.561507 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211847 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 13:29:00.562330 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211849 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 13:29:00.562330 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211852 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 13:29:00.562330 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211854 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 13:29:00.562330 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211857 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 13:29:00.562330 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211860 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 13:29:00.562330 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211862 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 13:29:00.562330 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211865 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 13:29:00.562330 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211869 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 13:29:00.562330 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211872 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 13:29:00.562330 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211874 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 13:29:00.562330 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211877 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 13:29:00.562330 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211879 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 13:29:00.562330 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.211882 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 13:29:00.562330 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212258 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 13:29:00.562330 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212262 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 13:29:00.562330 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212265 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 13:29:00.562330 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212267 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 13:29:00.562330 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212271 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 13:29:00.562330 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212274 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 13:29:00.562330 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212277 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 13:29:00.562937 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212280 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 13:29:00.562937 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212282 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 13:29:00.562937 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212285 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 13:29:00.562937 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212288 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 13:29:00.562937 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212290 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 13:29:00.562937 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212293 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 13:29:00.562937 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212295 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 13:29:00.562937 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212297 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 13:29:00.562937 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212300 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 13:29:00.562937 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212302 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 13:29:00.562937 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212307 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 13:29:00.562937 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212309 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 13:29:00.562937 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212312 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 13:29:00.562937 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212314 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 13:29:00.562937 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212317 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 13:29:00.562937 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212320 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 13:29:00.562937 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212322 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 13:29:00.562937 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212325 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 13:29:00.562937 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212328 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 13:29:00.562937 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212331 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 13:29:00.563555 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212335 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 13:29:00.563555 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212337 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 13:29:00.563555 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212340 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 13:29:00.563555 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212342 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 13:29:00.563555 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212345 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 13:29:00.563555 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212347 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 13:29:00.563555 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212350 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 13:29:00.563555 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212352 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 13:29:00.563555 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212355 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 13:29:00.563555 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212357 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 13:29:00.563555 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212360 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 13:29:00.563555 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212363 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 13:29:00.563555 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212365 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 13:29:00.563555 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212368 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 13:29:00.563555 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212370 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 13:29:00.563555 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212373 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 13:29:00.563555 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212375 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 13:29:00.563555 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212378 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 13:29:00.563555 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212380 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 13:29:00.564118 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212382 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 13:29:00.564118 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212385 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 13:29:00.564118 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212387 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 13:29:00.564118 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212391 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 13:29:00.564118 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212393 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 13:29:00.564118 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212396 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 13:29:00.564118 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212398 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 13:29:00.564118 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212401 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 13:29:00.564118 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212403 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 13:29:00.564118 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212406 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 13:29:00.564118 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212409 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 13:29:00.564118 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212412 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 13:29:00.564118 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212416 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 13:29:00.564118 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212418 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 13:29:00.564118 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212422 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 13:29:00.564118 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212426 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 13:29:00.564118 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212429 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 13:29:00.564118 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212431 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 13:29:00.564118 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212434 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 13:29:00.564118 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212437 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 13:29:00.564750 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212440 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 13:29:00.564750 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212442 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 13:29:00.564750 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212445 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 13:29:00.564750 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212447 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 13:29:00.564750 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212450 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 13:29:00.564750 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212453 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 13:29:00.564750 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212455 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 15 13:29:00.564750 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212458 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 13:29:00.564750 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212462 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 13:29:00.564750 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212466 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 13:29:00.564750 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212470 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 13:29:00.564750 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212474 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 13:29:00.564750 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212477 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 13:29:00.564750 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212479 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 13:29:00.564750 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212482 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 13:29:00.564750 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212485 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 13:29:00.564750 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212488 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 13:29:00.564750 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212490 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 13:29:00.564750 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212493 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 13:29:00.565255 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212495 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 13:29:00.565255 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212498 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 13:29:00.565255 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212500 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 13:29:00.565255 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212503 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 13:29:00.565255 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212505 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 13:29:00.565255 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212509 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 13:29:00.565255 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212511 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 13:29:00.565255 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212514 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 13:29:00.565255 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212516 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 13:29:00.565255 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212519 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 13:29:00.565255 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212521 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 13:29:00.565255 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212524 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 13:29:00.565255 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212526 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 13:29:00.565255 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.212529 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 13:29:00.565255 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212617 2558 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 13:29:00.565255 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212639 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 13:29:00.565255 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212646 2558 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 13:29:00.565255 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212650 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 13:29:00.565255 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212655 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 13:29:00.565255 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212659 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 13:29:00.565255 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212663 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 13:29:00.565854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212667 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 13:29:00.565854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212670 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 13:29:00.565854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212673 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 13:29:00.565854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212676 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 13:29:00.565854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212679 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 13:29:00.565854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212682 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 13:29:00.565854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212685 2558 flags.go:64] FLAG: --cgroup-root="" Jul 15 13:29:00.565854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212690 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 13:29:00.565854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212693 2558 flags.go:64] FLAG: --client-ca-file="" Jul 15 13:29:00.565854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212695 2558 flags.go:64] FLAG: --cloud-provider="external" Jul 15 13:29:00.565854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212698 2558 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 13:29:00.565854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212703 2558 flags.go:64] FLAG: --cluster-domain="" Jul 15 13:29:00.565854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212705 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 13:29:00.565854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212708 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 13:29:00.565854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212711 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 13:29:00.565854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212715 2558 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 13:29:00.565854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212720 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 13:29:00.565854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212724 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 13:29:00.565854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212727 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 13:29:00.565854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212730 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 13:29:00.565854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212733 2558 flags.go:64] FLAG: --contention-profiling="false" Jul 15 13:29:00.565854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212736 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 13:29:00.565854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212739 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 13:29:00.565854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212742 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212745 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212749 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212752 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212755 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212758 2558 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212761 2558 flags.go:64] FLAG: --enable-server="true" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212764 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212769 2558 flags.go:64] FLAG: --event-burst="100" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212772 2558 flags.go:64] FLAG: --event-qps="50" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212774 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212777 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212780 2558 flags.go:64] FLAG: --eviction-hard="" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212784 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212787 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212790 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212794 2558 flags.go:64] FLAG: --eviction-soft="" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212797 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212800 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212803 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212806 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212809 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212811 2558 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212814 2558 flags.go:64] FLAG: --feature-gates="" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212818 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 13:29:00.566484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212822 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 13:29:00.567236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212825 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 13:29:00.567236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212828 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 13:29:00.567236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212831 2558 flags.go:64] FLAG: --healthz-port="10248" Jul 15 13:29:00.567236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212834 2558 flags.go:64] FLAG: --help="false" Jul 15 13:29:00.567236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212837 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-129-45.ec2.internal" Jul 15 13:29:00.567236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212840 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 13:29:00.567236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212843 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 13:29:00.567236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212845 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 13:29:00.567236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212849 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 13:29:00.567236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212852 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 13:29:00.567236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212855 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 13:29:00.567236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212858 2558 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 13:29:00.567236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212861 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 13:29:00.567236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212863 2558 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 13:29:00.567236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212866 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 13:29:00.567236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212870 2558 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 13:29:00.567236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212873 2558 flags.go:64] FLAG: --kube-reserved="" Jul 15 13:29:00.567236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212875 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 13:29:00.567236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212878 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 13:29:00.567236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212881 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 13:29:00.567236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212884 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 13:29:00.567236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212886 2558 flags.go:64] FLAG: --lock-file="" Jul 15 13:29:00.567236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212890 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 13:29:00.567236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212893 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 13:29:00.567878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212896 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 13:29:00.567878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212901 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 13:29:00.567878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212904 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 13:29:00.567878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212907 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 13:29:00.567878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212910 2558 flags.go:64] FLAG: --logging-format="text" Jul 15 13:29:00.567878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212913 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 13:29:00.567878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212916 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 13:29:00.567878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212921 2558 flags.go:64] FLAG: --manifest-url="" Jul 15 13:29:00.567878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212924 2558 flags.go:64] FLAG: --manifest-url-header="" Jul 15 13:29:00.567878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212929 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 13:29:00.567878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212931 2558 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 13:29:00.567878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212936 2558 flags.go:64] FLAG: --max-pods="110" Jul 15 13:29:00.567878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212938 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 13:29:00.567878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212942 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 13:29:00.567878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212944 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 13:29:00.567878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212947 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 13:29:00.567878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212950 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 13:29:00.567878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212953 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 13:29:00.567878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212956 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 13:29:00.567878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212962 2558 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 13:29:00.567878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212966 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 13:29:00.567878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212968 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 13:29:00.567878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212971 2558 flags.go:64] FLAG: --pod-cidr="" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212974 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212980 2558 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212983 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212986 2558 flags.go:64] FLAG: --pods-per-core="0" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212989 2558 flags.go:64] FLAG: --port="10250" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212992 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212995 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e441ee5d886c8b38" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.212998 2558 flags.go:64] FLAG: --qos-reserved="" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213002 2558 flags.go:64] FLAG: --read-only-port="10255" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213004 2558 flags.go:64] FLAG: --register-node="true" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213007 2558 flags.go:64] FLAG: --register-with-taints="" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213011 2558 flags.go:64] FLAG: --registry-burst="10" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213014 2558 flags.go:64] FLAG: --registry-qps="5" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213016 2558 flags.go:64] FLAG: --reserved-cpus="" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213019 2558 flags.go:64] FLAG: --reserved-memory="" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213023 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213027 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213030 2558 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213033 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213036 2558 flags.go:64] FLAG: --runonce="false" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213039 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213041 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213044 2558 flags.go:64] FLAG: --seccomp-default="false" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213047 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 13:29:00.568516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213050 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213053 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213056 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213059 2558 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213061 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213064 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213067 2558 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213070 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213073 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213076 2558 flags.go:64] FLAG: --system-cgroups="" Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213079 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213084 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213087 2558 flags.go:64] FLAG: --tls-cert-file="" Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213090 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213094 2558 flags.go:64] FLAG: --tls-min-version="" Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213096 2558 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213101 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213103 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213106 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213109 2558 flags.go:64] FLAG: --v="2" Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213113 2558 flags.go:64] FLAG: --version="false" Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213117 2558 flags.go:64] FLAG: --vmodule="" Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213120 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.213124 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213240 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 13:29:00.569623 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213243 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 13:29:00.570542 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213246 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 13:29:00.570542 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213248 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 13:29:00.570542 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213253 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 13:29:00.570542 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213257 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 13:29:00.570542 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213260 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 13:29:00.570542 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213263 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 13:29:00.570542 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213266 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 13:29:00.570542 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213269 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 13:29:00.570542 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213271 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 13:29:00.570542 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213274 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 13:29:00.570542 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213277 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 13:29:00.570542 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213279 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 13:29:00.570542 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213282 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 13:29:00.570542 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213285 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 13:29:00.570542 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213287 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 13:29:00.570542 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213290 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 13:29:00.570542 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213293 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 13:29:00.570542 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213296 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 13:29:00.570542 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213299 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 13:29:00.712252 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213301 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 13:29:00.712252 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213304 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 13:29:00.712252 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213306 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 13:29:00.712252 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213310 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 13:29:00.712252 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213313 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 13:29:00.712252 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213316 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 13:29:00.712252 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213318 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 13:29:00.712252 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213321 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 13:29:00.712252 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213323 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 13:29:00.712252 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213326 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 13:29:00.712252 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213328 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 13:29:00.712252 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213332 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 13:29:00.712252 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213335 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 13:29:00.712252 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213337 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 13:29:00.712252 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213340 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 13:29:00.712252 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213343 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 13:29:00.712252 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213345 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 13:29:00.712252 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213348 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 13:29:00.712252 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213350 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 13:29:00.712252 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213353 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 13:29:00.712950 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213355 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 13:29:00.712950 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213358 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 13:29:00.712950 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213360 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 13:29:00.712950 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213363 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 13:29:00.712950 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213365 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 13:29:00.712950 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213368 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 13:29:00.712950 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213370 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 13:29:00.712950 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213372 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 13:29:00.712950 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213375 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 13:29:00.712950 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213377 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 13:29:00.712950 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213380 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 13:29:00.712950 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213383 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 13:29:00.712950 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213385 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 13:29:00.712950 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213388 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 13:29:00.712950 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213390 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 13:29:00.712950 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213394 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 13:29:00.712950 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213397 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 13:29:00.712950 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213399 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 13:29:00.712950 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213402 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 13:29:00.712950 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213405 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 13:29:00.713539 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213407 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 13:29:00.713539 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213410 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 13:29:00.713539 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213412 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 13:29:00.713539 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213416 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 13:29:00.713539 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213418 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 13:29:00.713539 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213421 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 13:29:00.713539 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213424 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 15 13:29:00.713539 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213426 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 13:29:00.713539 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213429 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 13:29:00.713539 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213431 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 13:29:00.713539 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213434 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 13:29:00.713539 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213436 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 13:29:00.713539 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213440 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 13:29:00.713539 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213444 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 13:29:00.713539 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213447 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 13:29:00.713539 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213450 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 13:29:00.713539 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213454 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 13:29:00.713539 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213456 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 13:29:00.713539 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213459 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 13:29:00.713539 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213461 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 13:29:00.714121 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213464 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 13:29:00.714121 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213466 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 13:29:00.714121 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213469 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 13:29:00.714121 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213472 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 13:29:00.714121 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213475 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 13:29:00.714121 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213477 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 13:29:00.714121 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213480 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 13:29:00.714121 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213485 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 13:29:00.714121 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213488 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 13:29:00.714121 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213490 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 13:29:00.714121 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213493 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 13:29:00.714121 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213495 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 13:29:00.714121 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213498 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 13:29:00.714121 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213500 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 13:29:00.714121 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213503 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 13:29:00.714121 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213507 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 13:29:00.714121 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213509 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 13:29:00.714121 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.213513 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 13:29:00.714622 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.214619 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 13:29:00.714622 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.223430 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 13:29:00.714622 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.223451 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 13:29:00.714622 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.224405 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 13:29:00.714622 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.224415 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 13:29:00.714622 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224480 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 13:29:00.714622 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224486 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 13:29:00.714622 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224490 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 13:29:00.714622 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224493 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 13:29:00.714622 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224496 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 15 13:29:00.714622 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224498 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 13:29:00.714622 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224501 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 13:29:00.714622 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224504 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 13:29:00.714622 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224507 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 13:29:00.714622 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224510 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 13:29:00.715088 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224513 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 13:29:00.715088 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224515 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 13:29:00.715088 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224518 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 13:29:00.715088 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224520 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 13:29:00.715088 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224523 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 13:29:00.715088 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224526 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 13:29:00.715088 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224529 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 13:29:00.715088 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224532 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 13:29:00.715088 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224534 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 13:29:00.715088 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224537 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 13:29:00.715088 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224539 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 13:29:00.715088 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224543 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 13:29:00.715088 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224548 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 13:29:00.715088 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224551 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 13:29:00.715088 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224553 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 13:29:00.715088 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224556 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 13:29:00.715088 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224559 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 13:29:00.715088 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224562 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 13:29:00.715088 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224565 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 13:29:00.715088 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224568 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 13:29:00.715613 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224571 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 13:29:00.715613 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224573 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 13:29:00.715613 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224576 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 13:29:00.715613 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224579 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 13:29:00.715613 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224581 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 13:29:00.715613 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224584 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 13:29:00.715613 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224586 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 13:29:00.715613 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224589 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 13:29:00.715613 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224592 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 13:29:00.715613 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224595 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 13:29:00.715613 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224615 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 13:29:00.715613 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224618 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 13:29:00.715613 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224621 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 13:29:00.715613 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224623 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 13:29:00.715613 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224626 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 13:29:00.715613 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224629 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 13:29:00.715613 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224633 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 13:29:00.715613 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224636 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 13:29:00.715613 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224639 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 13:29:00.715613 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224641 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 13:29:00.716182 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224644 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 13:29:00.716182 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224647 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 13:29:00.716182 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224649 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 13:29:00.716182 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224652 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 13:29:00.716182 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224655 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 13:29:00.716182 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224657 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 13:29:00.716182 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224660 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 13:29:00.716182 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224663 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 13:29:00.716182 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224665 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 13:29:00.716182 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224669 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 13:29:00.716182 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224674 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 13:29:00.716182 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224677 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 13:29:00.716182 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224679 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 13:29:00.716182 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224682 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 13:29:00.716182 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224685 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 13:29:00.716182 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224687 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 13:29:00.716182 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224690 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 13:29:00.716182 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224693 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 13:29:00.716182 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224695 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 13:29:00.716701 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224698 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 13:29:00.716701 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224700 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 13:29:00.716701 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224703 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 13:29:00.716701 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224705 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 13:29:00.716701 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224708 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 13:29:00.716701 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224710 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 13:29:00.716701 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224713 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 13:29:00.716701 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224718 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 13:29:00.716701 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224721 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 13:29:00.716701 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224725 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 13:29:00.716701 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224728 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 13:29:00.716701 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224731 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 13:29:00.716701 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224735 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 13:29:00.716701 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224738 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 13:29:00.716701 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224741 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 13:29:00.716701 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224745 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 13:29:00.716701 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224747 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 13:29:00.716701 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224750 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 13:29:00.716701 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224753 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 13:29:00.717253 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224756 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 13:29:00.717253 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224758 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 13:29:00.717253 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224761 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 13:29:00.717253 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224763 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 13:29:00.717253 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224766 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 13:29:00.717253 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224769 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 13:29:00.717253 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224771 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 13:29:00.717253 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224774 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 13:29:00.717253 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224777 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 13:29:00.717253 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224779 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 13:29:00.717253 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224782 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 13:29:00.717253 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.224788 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 13:29:00.717253 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224904 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 13:29:00.717253 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224908 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 13:29:00.717652 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224911 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 13:29:00.717652 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224915 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 13:29:00.717652 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224919 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 13:29:00.717652 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224922 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 13:29:00.717652 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224925 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 13:29:00.717652 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224928 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 13:29:00.717652 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224931 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 13:29:00.717652 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224935 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 13:29:00.717652 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224939 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 13:29:00.717652 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224942 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 15 13:29:00.717652 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224945 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 13:29:00.717652 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224947 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 13:29:00.717652 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224950 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 13:29:00.717652 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224952 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 13:29:00.717652 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224955 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 13:29:00.717652 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224957 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 13:29:00.717652 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224960 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 13:29:00.717652 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224963 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 13:29:00.717652 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224965 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 13:29:00.718196 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224968 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 13:29:00.718196 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224970 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 13:29:00.718196 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224973 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 13:29:00.718196 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224976 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 13:29:00.718196 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224979 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 13:29:00.718196 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224981 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 13:29:00.718196 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224984 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 13:29:00.718196 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224986 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 13:29:00.718196 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224989 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 13:29:00.718196 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224991 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 13:29:00.718196 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224993 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 13:29:00.718196 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224996 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 13:29:00.718196 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.224998 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 13:29:00.718196 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225001 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 13:29:00.718196 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225003 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 13:29:00.718196 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225006 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 13:29:00.718196 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225009 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 13:29:00.718196 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225011 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 13:29:00.718196 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225013 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 13:29:00.718196 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225016 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 13:29:00.718742 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225020 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 13:29:00.718742 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225024 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 13:29:00.718742 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225027 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 13:29:00.718742 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225029 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 13:29:00.718742 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225032 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 13:29:00.718742 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225035 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 13:29:00.718742 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225037 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 13:29:00.718742 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225040 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 13:29:00.718742 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225042 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 13:29:00.718742 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225046 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 13:29:00.718742 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225050 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 13:29:00.718742 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225053 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 13:29:00.718742 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225055 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 13:29:00.718742 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225058 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 13:29:00.718742 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225060 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 13:29:00.718742 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225063 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 13:29:00.718742 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225065 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 13:29:00.718742 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225068 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 13:29:00.718742 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225070 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 13:29:00.719286 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225073 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 13:29:00.719286 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225076 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 13:29:00.719286 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225078 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 13:29:00.719286 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225081 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 13:29:00.719286 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225083 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 13:29:00.719286 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225086 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 13:29:00.719286 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225088 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 13:29:00.719286 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225091 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 13:29:00.719286 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225094 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 13:29:00.719286 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225096 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 13:29:00.719286 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225099 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 13:29:00.719286 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225101 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 13:29:00.719286 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225104 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 13:29:00.719286 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225108 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 13:29:00.719286 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225112 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 13:29:00.719286 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225114 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 13:29:00.719286 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225117 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 13:29:00.719286 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225119 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 13:29:00.719286 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225123 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 13:29:00.719286 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225126 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 13:29:00.719822 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225128 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 13:29:00.719822 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225131 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 13:29:00.719822 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225133 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 13:29:00.719822 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225136 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 13:29:00.719822 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225140 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 13:29:00.719822 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225143 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 13:29:00.719822 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225146 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 13:29:00.719822 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225149 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 13:29:00.719822 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225151 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 13:29:00.719822 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225154 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 13:29:00.719822 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225157 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 13:29:00.719822 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225160 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 13:29:00.719822 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225162 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 13:29:00.719822 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225164 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 13:29:00.719822 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225167 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 13:29:00.719822 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225169 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 13:29:00.719822 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225172 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 13:29:00.719822 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225175 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 13:29:00.719822 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:00.225177 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 13:29:00.720383 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.225182 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 13:29:00.720383 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.225307 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 13:29:00.720383 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.228654 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 13:29:00.720383 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.230440 2558 server.go:1019] "Starting client certificate rotation" Jul 15 13:29:00.720383 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.230537 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 13:29:00.720383 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.230576 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 13:29:00.720383 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.233411 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 13:29:00.720383 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.240149 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 13:29:00.720383 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.258616 2558 log.go:25] "Validated CRI v1 runtime API" Jul 15 13:29:00.720383 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.261924 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 13:29:00.720383 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.262044 2558 log.go:25] "Validated CRI v1 image API" Jul 15 13:29:00.720383 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.264840 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 13:29:00.720773 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.268055 2558 fs.go:135] Filesystem UUIDs: map[6cd89515-acbd-4f2a-92c6-db97f6d149b7:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7e70d09d-9cdb-4119-b6b7-ce1a9c1763c5:/dev/nvme0n1p3] Jul 15 13:29:00.720773 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.268071 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 13:29:00.720948 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.274945 2558 manager.go:216] Machine: {Timestamp:2026-07-15 13:29:00.273353853 +0000 UTC m=+0.392915862 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3113698 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26c3adf792d811eabc60df1be62415 SystemUUID:ec26c3ad-f792-d811-eabc-60df1be62415 BootID:46de2ba6-c203-4b08-879a-81137d8f87cd Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:da:c8:a3:f8:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:da:c8:a3:f8:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:bb:1f:c0:b8:be Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 13:29:00.720948 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.275081 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 13:29:00.720948 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.275170 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 13:29:00.720948 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.279224 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 13:29:00.720948 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.279263 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-45.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 13:29:00.720948 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.281744 2558 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 13:29:00.720948 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.281763 2558 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 13:29:00.720948 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.281771 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 13:29:00.720948 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.282564 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 13:29:00.720948 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.284727 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 13:29:00.720948 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.288282 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 15 13:29:00.720948 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.288408 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 13:29:00.720948 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.288436 2558 kubelet.go:486] "Attempting to sync node with API server" Jul 15 13:29:00.720948 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.288453 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 13:29:00.720948 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.288465 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 13:29:00.720948 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.288476 2558 kubelet.go:398] "Adding apiserver pod source" Jul 15 13:29:00.720948 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.288485 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 13:29:00.720948 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.288890 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.288914 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.291595 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.294073 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.294110 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.294929 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.294953 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.294966 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.294974 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.294991 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.295001 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.295017 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.295025 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.295035 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.295044 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.295057 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.295069 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.296823 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.296833 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.300032 2558 server.go:1268] "Started kubelet" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.300125 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.300146 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.300218 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.301418 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-45.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:00.301457 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-45.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:00.301502 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.302364 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.303186 2558 server.go:310] "Adding debug handlers to kubelet server" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:00.306273 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:00.306172 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-45.ec2.internal.18c279a2487dcb6f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-45.ec2.internal,UID:ip-10-0-129-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-45.ec2.internal,},FirstTimestamp:2026-07-15 13:29:00.300004207 +0000 UTC m=+0.419566216,LastTimestamp:2026-07-15 13:29:00.300004207 +0000 UTC m=+0.419566216,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-45.ec2.internal,}" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.310012 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.310016 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:00.310092 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.310809 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.310939 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.310958 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.311083 2558 reconstruct.go:97] "Volume reconstruction finished" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.311092 2558 reconciler.go:29] "Reconciler: start to sync state" Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.311350 2558 factory.go:55] Registering systemd factory Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.311382 2558 factory.go:223] Registration of the systemd container factory successfully Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.312690 2558 factory.go:153] Registering CRI-O factory Jul 15 13:29:00.721488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.312714 2558 factory.go:223] Registration of the crio container factory successfully Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.312823 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.312848 2558 factory.go:103] Registering Raw factory Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.312864 2558 manager.go:1196] Started watching for new ooms in manager Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.314445 2558 manager.go:349] Starting recovery of all containers Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.314571 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jbd2w" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:00.315352 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-45.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:00.315437 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.322957 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jbd2w" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.326952 2558 manager.go:354] Recovery completed Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.333454 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.335419 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.335445 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.335456 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.336002 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.336008 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.336012 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.336027 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.336860 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.336883 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.336902 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.337078 2558 policy_none.go:49] "None policy: Start" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.337090 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.337100 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.338099 2558 policy_none.go:47] "Start" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:00.338055 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-45.ec2.internal.18c279a24a9a6051 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-45.ec2.internal,UID:ip-10-0-129-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-45.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-45.ec2.internal,},FirstTimestamp:2026-07-15 13:29:00.335431761 +0000 UTC m=+0.454993772,LastTimestamp:2026-07-15 13:29:00.335431761 +0000 UTC m=+0.454993772,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-45.ec2.internal,}" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.399289 2558 manager.go:337] "Starting Device Plugin manager" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:00.399324 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.399333 2558 server.go:87] "Starting device plugin registration server" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.399645 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.399657 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.399762 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.399851 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.399861 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:00.400566 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:00.400631 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-45.ec2.internal\" not found" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.471051 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.472306 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.472343 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 13:29:00.724890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.472368 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:00.472404 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.474572 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.500315 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.501288 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.501328 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.501341 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.501364 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-45.ec2.internal" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.510759 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-45.ec2.internal" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:00.510784 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-45.ec2.internal\": node \"ip-10-0-129-45.ec2.internal\" not found" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:00.539311 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.573314 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-45.ec2.internal"] Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.573417 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.574469 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.574492 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.574503 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.575807 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.575964 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.575995 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.576791 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.576812 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.576820 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.577026 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.577036 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.577044 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.578321 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-45.ec2.internal" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.578355 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.579486 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.579509 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.579525 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.613333 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/40dae1498354de2e9db018ec29df6929-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal\" (UID: \"40dae1498354de2e9db018ec29df6929\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.613361 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40dae1498354de2e9db018ec29df6929-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal\" (UID: \"40dae1498354de2e9db018ec29df6929\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.613390 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7f7ac29e3ebd41aa7e117b631fbe0b37-config\") pod \"kube-apiserver-proxy-ip-10-0-129-45.ec2.internal\" (UID: \"7f7ac29e3ebd41aa7e117b631fbe0b37\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-45.ec2.internal" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:00.613459 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-45.ec2.internal\" not found" node="ip-10-0-129-45.ec2.internal" Jul 15 13:29:00.855175 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:00.617794 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-45.ec2.internal\" not found" node="ip-10-0-129-45.ec2.internal" Jul 15 13:29:00.856877 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:00.639423 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jul 15 13:29:00.856877 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.713511 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/40dae1498354de2e9db018ec29df6929-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal\" (UID: \"40dae1498354de2e9db018ec29df6929\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" Jul 15 13:29:00.856877 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.713543 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40dae1498354de2e9db018ec29df6929-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal\" (UID: \"40dae1498354de2e9db018ec29df6929\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" Jul 15 13:29:00.856877 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.713561 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7f7ac29e3ebd41aa7e117b631fbe0b37-config\") pod \"kube-apiserver-proxy-ip-10-0-129-45.ec2.internal\" (UID: \"7f7ac29e3ebd41aa7e117b631fbe0b37\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-45.ec2.internal" Jul 15 13:29:00.856877 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.713623 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7f7ac29e3ebd41aa7e117b631fbe0b37-config\") pod \"kube-apiserver-proxy-ip-10-0-129-45.ec2.internal\" (UID: \"7f7ac29e3ebd41aa7e117b631fbe0b37\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-45.ec2.internal" Jul 15 13:29:00.856877 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.713632 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40dae1498354de2e9db018ec29df6929-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal\" (UID: \"40dae1498354de2e9db018ec29df6929\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" Jul 15 13:29:00.856877 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.713639 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/40dae1498354de2e9db018ec29df6929-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal\" (UID: \"40dae1498354de2e9db018ec29df6929\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" Jul 15 13:29:00.856877 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:00.739832 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jul 15 13:29:00.856877 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:00.840508 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jul 15 13:29:00.995167 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.916350 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" Jul 15 13:29:00.995167 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:00.920021 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-45.ec2.internal" Jul 15 13:29:00.995167 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:00.941660 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jul 15 13:29:01.142901 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:01.043932 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jul 15 13:29:01.146158 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:01.146029 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jul 15 13:29:01.287519 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:01.178867 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 13:29:01.287519 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:01.229571 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 13:29:01.287519 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:01.229756 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 13:29:01.287519 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:01.229762 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 13:29:01.287519 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:01.247168 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jul 15 13:29:01.412539 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:01.330286 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 13:24:00 +0000 UTC" deadline="2028-04-11 12:00:40.30756475 +0000 UTC" Jul 15 13:29:01.412539 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:01.330323 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15262h31m38.977247532s" Jul 15 13:29:01.412539 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:01.348215 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jul 15 13:29:01.521699 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:01.450553 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jul 15 13:29:01.643339 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:01.550700 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jul 15 13:29:01.653973 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:01.651534 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jul 15 13:29:01.769325 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:01.658926 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40dae1498354de2e9db018ec29df6929.slice/crio-5bf8ffd0718c0725464c0e92f180e3a4bc8b2bcf06a2303a71277fec130e7145 WatchSource:0}: Error finding container 5bf8ffd0718c0725464c0e92f180e3a4bc8b2bcf06a2303a71277fec130e7145: Status 404 returned error can't find the container with id 5bf8ffd0718c0725464c0e92f180e3a4bc8b2bcf06a2303a71277fec130e7145 Jul 15 13:29:01.769325 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:01.663122 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 13:29:01.769325 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:01.752330 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jul 15 13:29:01.914109 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:01.783064 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 13:29:01.914109 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:01.785113 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 13:29:01.914109 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:01.811472 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" Jul 15 13:29:01.914109 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:01.835596 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 13:29:01.914109 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:01.837132 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-45.ec2.internal" Jul 15 13:29:01.914109 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:01.848134 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 13:29:02.296731 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.198106 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 13:29:02.296731 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.291825 2558 apiserver.go:52] "Watching apiserver" Jul 15 13:29:02.296731 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:02.295258 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f7ac29e3ebd41aa7e117b631fbe0b37.slice/crio-3d3ed3712260b763bc8d57934efc8d385c336b1a9ff8ec6c5c1e042a1e4130e9 WatchSource:0}: Error finding container 3d3ed3712260b763bc8d57934efc8d385c336b1a9ff8ec6c5c1e042a1e4130e9: Status 404 returned error can't find the container with id 3d3ed3712260b763bc8d57934efc8d385c336b1a9ff8ec6c5c1e042a1e4130e9 Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.311317 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.325763 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.326179 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-8nchk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal","openshift-multus/multus-8khhd","openshift-multus/multus-additional-cni-plugins-lcdbd","openshift-network-operator/iptables-alerter-l2v2m","kube-system/global-pull-secret-syncer-d7hsr","kube-system/kube-apiserver-proxy-ip-10-0-129-45.ec2.internal","openshift-image-registry/node-ca-6zd8z","openshift-multus/network-metrics-daemon-sbjdk","openshift-network-diagnostics/network-check-target-m8n2n","openshift-ovn-kubernetes/ovnkube-node-fkf79","kube-system/konnectivity-agent-hg6dx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd","openshift-cluster-node-tuning-operator/tuned-4zbrw"] Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.328151 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:02.328250 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m8n2n" podUID="d3cd2f3c-8841-43bc-887c-c24ef412ea2f" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.329583 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.329761 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.330971 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.332478 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.332557 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qwzhg\"" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.332478 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.332815 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.332966 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.333393 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.333393 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lczg2\"" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.333587 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.333689 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.333875 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.334550 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l2v2m" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.335890 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:02.335984 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7hsr" podUID="d024b3a4-a62c-4c57-adee-38378835c1c8" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.337186 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:02.337246 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjdk" podUID="1d89f2fe-5910-4b03-afba-b491605dc56a" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.338505 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.340879 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6zd8z" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.342649 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8nchk" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.344007 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.345655 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hg6dx" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.362530 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 13:29:02.378031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.362530 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8lnwl\"" Jul 15 13:29:02.380202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.364271 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 13:29:02.380202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.364578 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 13:29:02.380202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.364579 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 13:29:02.380202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.364742 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-blkbb\"" Jul 15 13:29:02.380202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.364830 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 13:29:02.380202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.364874 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 13:29:02.380202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.364983 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qk7h9\"" Jul 15 13:29:02.380202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.364993 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 13:29:02.380202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.365015 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 13:29:02.380202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.365028 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 13:29:02.380202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.365114 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 13:29:02.380202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.365126 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 13:29:02.380202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.365168 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 13:29:02.380202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.365253 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-htw5m\"" Jul 15 13:29:02.380202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.365311 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 13:29:02.380202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.365411 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z82q7\"" Jul 15 13:29:02.380202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.365468 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 13:29:02.380202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.365636 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 13:29:02.380202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.365793 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nchvk\"" Jul 15 13:29:02.380202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.365933 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 13:29:02.380202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.366068 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 13:29:02.380202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.366140 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 13:29:02.419282 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.419038 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v9qls" Jul 15 13:29:02.419790 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.419766 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 13:29:02.419918 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.419887 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 13:29:02.420306 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.420071 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 13:29:02.420306 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.420167 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v9qls" Jul 15 13:29:02.420477 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.420335 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7pngg\"" Jul 15 13:29:02.424432 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.424408 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d024b3a4-a62c-4c57-adee-38378835c1c8-original-pull-secret\") pod \"global-pull-secret-syncer-d7hsr\" (UID: \"d024b3a4-a62c-4c57-adee-38378835c1c8\") " pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:02.424589 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.424447 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-cni-binary-copy\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.424589 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.424488 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.424589 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.424526 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4b463d4-4fda-4a24-8ee4-c6a14089e80b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lcdbd\" (UID: \"f4b463d4-4fda-4a24-8ee4-c6a14089e80b\") " pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.424589 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.424556 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0869c56d-e6bf-4183-a388-6ad52c497fef-iptables-alerter-script\") pod \"iptables-alerter-l2v2m\" (UID: \"0869c56d-e6bf-4183-a388-6ad52c497fef\") " pod="openshift-network-operator/iptables-alerter-l2v2m" Jul 15 13:29:02.424840 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.424582 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1cea0d8a-b836-4477-96b5-515bdde845d5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-czhsd\" (UID: \"1cea0d8a-b836-4477-96b5-515bdde845d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" Jul 15 13:29:02.424840 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.424626 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1cea0d8a-b836-4477-96b5-515bdde845d5-etc-selinux\") pod \"aws-ebs-csi-driver-node-czhsd\" (UID: \"1cea0d8a-b836-4477-96b5-515bdde845d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" Jul 15 13:29:02.424840 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.424657 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-lib-modules\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.424840 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.424709 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-run-systemd\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.424840 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.424744 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-run-ovn\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.424840 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.424771 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvc5p\" (UniqueName: \"kubernetes.io/projected/f4b463d4-4fda-4a24-8ee4-c6a14089e80b-kube-api-access-cvc5p\") pod \"multus-additional-cni-plugins-lcdbd\" (UID: \"f4b463d4-4fda-4a24-8ee4-c6a14089e80b\") " pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.424840 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.424811 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d89f2fe-5910-4b03-afba-b491605dc56a-metrics-certs\") pod \"network-metrics-daemon-sbjdk\" (UID: \"1d89f2fe-5910-4b03-afba-b491605dc56a\") " pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:02.424840 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.424840 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgw5m\" (UniqueName: \"kubernetes.io/projected/1d89f2fe-5910-4b03-afba-b491605dc56a-kube-api-access-jgw5m\") pod \"network-metrics-daemon-sbjdk\" (UID: \"1d89f2fe-5910-4b03-afba-b491605dc56a\") " pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:02.425233 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.424867 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1cea0d8a-b836-4477-96b5-515bdde845d5-registration-dir\") pod \"aws-ebs-csi-driver-node-czhsd\" (UID: \"1cea0d8a-b836-4477-96b5-515bdde845d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" Jul 15 13:29:02.425233 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.424894 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-multus-daemon-config\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.425233 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.424920 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-etc-modprobe-d\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.425233 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.424970 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/42a1082a-1cc4-4ca5-9291-9b5c86fcebfa-serviceca\") pod \"node-ca-6zd8z\" (UID: \"42a1082a-1cc4-4ca5-9291-9b5c86fcebfa\") " pod="openshift-image-registry/node-ca-6zd8z" Jul 15 13:29:02.425233 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425013 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-var-lib-openvswitch\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.425233 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425040 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d024b3a4-a62c-4c57-adee-38378835c1c8-dbus\") pod \"global-pull-secret-syncer-d7hsr\" (UID: \"d024b3a4-a62c-4c57-adee-38378835c1c8\") " pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:02.425233 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425065 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-system-cni-dir\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.425233 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425095 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-host-var-lib-cni-bin\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.425233 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425120 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gssrv\" (UniqueName: \"kubernetes.io/projected/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-kube-api-access-gssrv\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.425233 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425144 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-sys\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.425233 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425168 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42a1082a-1cc4-4ca5-9291-9b5c86fcebfa-host\") pod \"node-ca-6zd8z\" (UID: \"42a1082a-1cc4-4ca5-9291-9b5c86fcebfa\") " pod="openshift-image-registry/node-ca-6zd8z" Jul 15 13:29:02.425233 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425191 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-etc-openvswitch\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.425233 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425214 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-host-var-lib-cni-multus\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.425233 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425234 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-systemd-units\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.426123 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425253 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-node-log\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.426123 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425298 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c92079f2-6ca8-4000-b0b8-128ba9dccd98-ovnkube-config\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.426123 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425315 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c92079f2-6ca8-4000-b0b8-128ba9dccd98-ovnkube-script-lib\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.426123 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425351 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cffkn\" (UniqueName: \"kubernetes.io/projected/c92079f2-6ca8-4000-b0b8-128ba9dccd98-kube-api-access-cffkn\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.426123 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425440 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4b463d4-4fda-4a24-8ee4-c6a14089e80b-cni-binary-copy\") pod \"multus-additional-cni-plugins-lcdbd\" (UID: \"f4b463d4-4fda-4a24-8ee4-c6a14089e80b\") " pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.426123 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425536 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c8sq\" (UniqueName: \"kubernetes.io/projected/1cea0d8a-b836-4477-96b5-515bdde845d5-kube-api-access-6c8sq\") pod \"aws-ebs-csi-driver-node-czhsd\" (UID: \"1cea0d8a-b836-4477-96b5-515bdde845d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" Jul 15 13:29:02.426123 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425582 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1cea0d8a-b836-4477-96b5-515bdde845d5-device-dir\") pod \"aws-ebs-csi-driver-node-czhsd\" (UID: \"1cea0d8a-b836-4477-96b5-515bdde845d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" Jul 15 13:29:02.426123 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425622 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4b463d4-4fda-4a24-8ee4-c6a14089e80b-cnibin\") pod \"multus-additional-cni-plugins-lcdbd\" (UID: \"f4b463d4-4fda-4a24-8ee4-c6a14089e80b\") " pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.426123 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425739 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-host-run-netns\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.426123 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425777 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-host-var-lib-kubelet\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.426123 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425800 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c92079f2-6ca8-4000-b0b8-128ba9dccd98-env-overrides\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.426123 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425829 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtg6x\" (UniqueName: \"kubernetes.io/projected/0869c56d-e6bf-4183-a388-6ad52c497fef-kube-api-access-dtg6x\") pod \"iptables-alerter-l2v2m\" (UID: \"0869c56d-e6bf-4183-a388-6ad52c497fef\") " pod="openshift-network-operator/iptables-alerter-l2v2m" Jul 15 13:29:02.426123 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425864 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dplcw\" (UniqueName: \"kubernetes.io/projected/96eceb11-871f-4522-a3c1-c2795c533360-kube-api-access-dplcw\") pod \"node-resolver-8nchk\" (UID: \"96eceb11-871f-4522-a3c1-c2795c533360\") " pod="openshift-dns/node-resolver-8nchk" Jul 15 13:29:02.426123 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425913 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-etc-sysctl-d\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.426123 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425938 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-etc-systemd\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.426123 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.425964 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-var-lib-kubelet\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.426834 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426010 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clvl4\" (UniqueName: \"kubernetes.io/projected/42a1082a-1cc4-4ca5-9291-9b5c86fcebfa-kube-api-access-clvl4\") pod \"node-ca-6zd8z\" (UID: \"42a1082a-1cc4-4ca5-9291-9b5c86fcebfa\") " pod="openshift-image-registry/node-ca-6zd8z" Jul 15 13:29:02.426834 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426043 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-host-slash\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.426834 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426061 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4b463d4-4fda-4a24-8ee4-c6a14089e80b-system-cni-dir\") pod \"multus-additional-cni-plugins-lcdbd\" (UID: \"f4b463d4-4fda-4a24-8ee4-c6a14089e80b\") " pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.426834 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426078 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f4b463d4-4fda-4a24-8ee4-c6a14089e80b-os-release\") pod \"multus-additional-cni-plugins-lcdbd\" (UID: \"f4b463d4-4fda-4a24-8ee4-c6a14089e80b\") " pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.426834 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426093 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0869c56d-e6bf-4183-a388-6ad52c497fef-host-slash\") pod \"iptables-alerter-l2v2m\" (UID: \"0869c56d-e6bf-4183-a388-6ad52c497fef\") " pod="openshift-network-operator/iptables-alerter-l2v2m" Jul 15 13:29:02.426834 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426109 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1cea0d8a-b836-4477-96b5-515bdde845d5-socket-dir\") pod \"aws-ebs-csi-driver-node-czhsd\" (UID: \"1cea0d8a-b836-4477-96b5-515bdde845d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" Jul 15 13:29:02.426834 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426123 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-run\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.426834 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426158 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-etc-tuned\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.426834 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426182 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-tmp\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.426834 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426209 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzmgq\" (UniqueName: \"kubernetes.io/projected/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-kube-api-access-zzmgq\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.426834 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426235 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-cnibin\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.426834 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426259 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-etc-kubernetes\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.426834 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426286 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-host-run-netns\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.426834 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426312 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1da889f2-18e0-4f9d-b932-38d83ef3bd43-agent-certs\") pod \"konnectivity-agent-hg6dx\" (UID: \"1da889f2-18e0-4f9d-b932-38d83ef3bd43\") " pod="kube-system/konnectivity-agent-hg6dx" Jul 15 13:29:02.426834 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426336 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1da889f2-18e0-4f9d-b932-38d83ef3bd43-konnectivity-ca\") pod \"konnectivity-agent-hg6dx\" (UID: \"1da889f2-18e0-4f9d-b932-38d83ef3bd43\") " pod="kube-system/konnectivity-agent-hg6dx" Jul 15 13:29:02.426834 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426362 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4b463d4-4fda-4a24-8ee4-c6a14089e80b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lcdbd\" (UID: \"f4b463d4-4fda-4a24-8ee4-c6a14089e80b\") " pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.427554 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426387 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96eceb11-871f-4522-a3c1-c2795c533360-tmp-dir\") pod \"node-resolver-8nchk\" (UID: \"96eceb11-871f-4522-a3c1-c2795c533360\") " pod="openshift-dns/node-resolver-8nchk" Jul 15 13:29:02.427554 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426413 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-host-run-k8s-cni-cncf-io\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.427554 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426438 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-hostroot\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.427554 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426462 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-multus-conf-dir\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.427554 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426482 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1cea0d8a-b836-4477-96b5-515bdde845d5-sys-fs\") pod \"aws-ebs-csi-driver-node-czhsd\" (UID: \"1cea0d8a-b836-4477-96b5-515bdde845d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" Jul 15 13:29:02.427554 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426510 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-host-run-multus-certs\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.427554 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426533 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-etc-sysconfig\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.427554 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426556 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-log-socket\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.427554 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426579 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-host-cni-bin\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.427554 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426615 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhbnn\" (UniqueName: \"kubernetes.io/projected/d3cd2f3c-8841-43bc-887c-c24ef412ea2f-kube-api-access-hhbnn\") pod \"network-check-target-m8n2n\" (UID: \"d3cd2f3c-8841-43bc-887c-c24ef412ea2f\") " pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:02.427554 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426668 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4b463d4-4fda-4a24-8ee4-c6a14089e80b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lcdbd\" (UID: \"f4b463d4-4fda-4a24-8ee4-c6a14089e80b\") " pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.427554 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426687 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-host-run-ovn-kubernetes\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.427554 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426706 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/96eceb11-871f-4522-a3c1-c2795c533360-hosts-file\") pod \"node-resolver-8nchk\" (UID: \"96eceb11-871f-4522-a3c1-c2795c533360\") " pod="openshift-dns/node-resolver-8nchk" Jul 15 13:29:02.427554 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426725 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-etc-sysctl-conf\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.427554 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426742 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c92079f2-6ca8-4000-b0b8-128ba9dccd98-ovn-node-metrics-cert\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.427554 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426757 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d024b3a4-a62c-4c57-adee-38378835c1c8-kubelet-config\") pod \"global-pull-secret-syncer-d7hsr\" (UID: \"d024b3a4-a62c-4c57-adee-38378835c1c8\") " pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:02.428308 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.426779 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-multus-cni-dir\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.428308 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.427004 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-etc-kubernetes\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.428308 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.427119 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-host-kubelet\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.428308 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.427169 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-run-openvswitch\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.428308 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.427196 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-os-release\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.428308 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.427225 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-multus-socket-dir-parent\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.428308 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.427249 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-host\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.428308 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.427276 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-host-cni-netd\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.477575 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.477502 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-45.ec2.internal" event={"ID":"7f7ac29e3ebd41aa7e117b631fbe0b37","Type":"ContainerStarted","Data":"3d3ed3712260b763bc8d57934efc8d385c336b1a9ff8ec6c5c1e042a1e4130e9"} Jul 15 13:29:02.478915 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.478879 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" event={"ID":"40dae1498354de2e9db018ec29df6929","Type":"ContainerStarted","Data":"5bf8ffd0718c0725464c0e92f180e3a4bc8b2bcf06a2303a71277fec130e7145"} Jul 15 13:29:02.528330 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528284 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-multus-conf-dir\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.528330 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528325 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1cea0d8a-b836-4477-96b5-515bdde845d5-sys-fs\") pod \"aws-ebs-csi-driver-node-czhsd\" (UID: \"1cea0d8a-b836-4477-96b5-515bdde845d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" Jul 15 13:29:02.528583 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528354 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-host-run-multus-certs\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.528583 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528372 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-etc-sysconfig\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.528583 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528464 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-etc-sysconfig\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.528583 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528462 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1cea0d8a-b836-4477-96b5-515bdde845d5-sys-fs\") pod \"aws-ebs-csi-driver-node-czhsd\" (UID: \"1cea0d8a-b836-4477-96b5-515bdde845d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" Jul 15 13:29:02.528583 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528464 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-host-run-multus-certs\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.528583 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528500 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-log-socket\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.528583 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528540 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-host-cni-bin\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.528583 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528468 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-multus-conf-dir\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.528583 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528570 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhbnn\" (UniqueName: \"kubernetes.io/projected/d3cd2f3c-8841-43bc-887c-c24ef412ea2f-kube-api-access-hhbnn\") pod \"network-check-target-m8n2n\" (UID: \"d3cd2f3c-8841-43bc-887c-c24ef412ea2f\") " pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:02.529048 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528600 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4b463d4-4fda-4a24-8ee4-c6a14089e80b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lcdbd\" (UID: \"f4b463d4-4fda-4a24-8ee4-c6a14089e80b\") " pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.529048 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528634 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-log-socket\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.529048 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528645 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-host-run-ovn-kubernetes\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.529048 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528648 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-host-cni-bin\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.529048 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528677 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/96eceb11-871f-4522-a3c1-c2795c533360-hosts-file\") pod \"node-resolver-8nchk\" (UID: \"96eceb11-871f-4522-a3c1-c2795c533360\") " pod="openshift-dns/node-resolver-8nchk" Jul 15 13:29:02.529048 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528709 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-etc-sysctl-conf\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.529048 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528737 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/96eceb11-871f-4522-a3c1-c2795c533360-hosts-file\") pod \"node-resolver-8nchk\" (UID: \"96eceb11-871f-4522-a3c1-c2795c533360\") " pod="openshift-dns/node-resolver-8nchk" Jul 15 13:29:02.529048 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528754 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c92079f2-6ca8-4000-b0b8-128ba9dccd98-ovn-node-metrics-cert\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.529048 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528759 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-host-run-ovn-kubernetes\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.529048 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528793 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d024b3a4-a62c-4c57-adee-38378835c1c8-kubelet-config\") pod \"global-pull-secret-syncer-d7hsr\" (UID: \"d024b3a4-a62c-4c57-adee-38378835c1c8\") " pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:02.529048 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528821 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-multus-cni-dir\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.529048 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528848 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-etc-kubernetes\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.529048 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528873 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-host-kubelet\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.529048 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528880 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-etc-sysctl-conf\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.529048 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528901 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-run-openvswitch\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.529048 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528926 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-os-release\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.529048 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528951 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-multus-socket-dir-parent\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.529048 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528959 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-host-kubelet\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.529884 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.528977 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-host\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.529884 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529002 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-host-cni-netd\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.529884 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529015 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-etc-kubernetes\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.529884 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529030 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d024b3a4-a62c-4c57-adee-38378835c1c8-original-pull-secret\") pod \"global-pull-secret-syncer-d7hsr\" (UID: \"d024b3a4-a62c-4c57-adee-38378835c1c8\") " pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:02.529884 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529054 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-multus-cni-dir\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.529884 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529058 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-cni-binary-copy\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.529884 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529073 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-multus-socket-dir-parent\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.529884 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529090 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d024b3a4-a62c-4c57-adee-38378835c1c8-kubelet-config\") pod \"global-pull-secret-syncer-d7hsr\" (UID: \"d024b3a4-a62c-4c57-adee-38378835c1c8\") " pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:02.529884 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529089 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.529884 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529107 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-run-openvswitch\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.529884 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529120 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-host-cni-netd\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.529884 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529121 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4b463d4-4fda-4a24-8ee4-c6a14089e80b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lcdbd\" (UID: \"f4b463d4-4fda-4a24-8ee4-c6a14089e80b\") " pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.529884 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529148 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0869c56d-e6bf-4183-a388-6ad52c497fef-iptables-alerter-script\") pod \"iptables-alerter-l2v2m\" (UID: \"0869c56d-e6bf-4183-a388-6ad52c497fef\") " pod="openshift-network-operator/iptables-alerter-l2v2m" Jul 15 13:29:02.529884 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529153 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-host\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.529884 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529175 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1cea0d8a-b836-4477-96b5-515bdde845d5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-czhsd\" (UID: \"1cea0d8a-b836-4477-96b5-515bdde845d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" Jul 15 13:29:02.529884 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529205 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-os-release\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.529884 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529205 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1cea0d8a-b836-4477-96b5-515bdde845d5-etc-selinux\") pod \"aws-ebs-csi-driver-node-czhsd\" (UID: \"1cea0d8a-b836-4477-96b5-515bdde845d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" Jul 15 13:29:02.530671 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529247 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-lib-modules\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.530671 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529239 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 13:29:02.530671 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529298 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1cea0d8a-b836-4477-96b5-515bdde845d5-etc-selinux\") pod \"aws-ebs-csi-driver-node-czhsd\" (UID: \"1cea0d8a-b836-4477-96b5-515bdde845d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" Jul 15 13:29:02.530671 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529359 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1cea0d8a-b836-4477-96b5-515bdde845d5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-czhsd\" (UID: \"1cea0d8a-b836-4477-96b5-515bdde845d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" Jul 15 13:29:02.530671 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529410 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.530671 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529435 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-lib-modules\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.530671 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:02.529461 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:29:02.530671 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529480 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-run-systemd\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.530671 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529445 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-run-systemd\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.530671 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:02.529584 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d024b3a4-a62c-4c57-adee-38378835c1c8-original-pull-secret podName:d024b3a4-a62c-4c57-adee-38378835c1c8 nodeName:}" failed. No retries permitted until 2026-07-15 13:29:03.029532916 +0000 UTC m=+3.149094939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d024b3a4-a62c-4c57-adee-38378835c1c8-original-pull-secret") pod "global-pull-secret-syncer-d7hsr" (UID: "d024b3a4-a62c-4c57-adee-38378835c1c8") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:29:02.530671 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529647 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-run-ovn\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.530671 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529680 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvc5p\" (UniqueName: \"kubernetes.io/projected/f4b463d4-4fda-4a24-8ee4-c6a14089e80b-kube-api-access-cvc5p\") pod \"multus-additional-cni-plugins-lcdbd\" (UID: \"f4b463d4-4fda-4a24-8ee4-c6a14089e80b\") " pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.530671 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529710 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-cni-binary-copy\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.530671 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529716 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d89f2fe-5910-4b03-afba-b491605dc56a-metrics-certs\") pod \"network-metrics-daemon-sbjdk\" (UID: \"1d89f2fe-5910-4b03-afba-b491605dc56a\") " pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:02.530671 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529746 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgw5m\" (UniqueName: \"kubernetes.io/projected/1d89f2fe-5910-4b03-afba-b491605dc56a-kube-api-access-jgw5m\") pod \"network-metrics-daemon-sbjdk\" (UID: \"1d89f2fe-5910-4b03-afba-b491605dc56a\") " pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:02.530671 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529756 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-run-ovn\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.530671 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529771 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1cea0d8a-b836-4477-96b5-515bdde845d5-registration-dir\") pod \"aws-ebs-csi-driver-node-czhsd\" (UID: \"1cea0d8a-b836-4477-96b5-515bdde845d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" Jul 15 13:29:02.531581 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529797 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-multus-daemon-config\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.531581 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529820 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-etc-modprobe-d\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.531581 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529843 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/42a1082a-1cc4-4ca5-9291-9b5c86fcebfa-serviceca\") pod \"node-ca-6zd8z\" (UID: \"42a1082a-1cc4-4ca5-9291-9b5c86fcebfa\") " pod="openshift-image-registry/node-ca-6zd8z" Jul 15 13:29:02.531581 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529844 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0869c56d-e6bf-4183-a388-6ad52c497fef-iptables-alerter-script\") pod \"iptables-alerter-l2v2m\" (UID: \"0869c56d-e6bf-4183-a388-6ad52c497fef\") " pod="openshift-network-operator/iptables-alerter-l2v2m" Jul 15 13:29:02.531581 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529849 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4b463d4-4fda-4a24-8ee4-c6a14089e80b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lcdbd\" (UID: \"f4b463d4-4fda-4a24-8ee4-c6a14089e80b\") " pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.531581 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529865 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-var-lib-openvswitch\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.531581 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529909 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d024b3a4-a62c-4c57-adee-38378835c1c8-dbus\") pod \"global-pull-secret-syncer-d7hsr\" (UID: \"d024b3a4-a62c-4c57-adee-38378835c1c8\") " pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:02.531581 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529938 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-system-cni-dir\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.531581 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529942 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-var-lib-openvswitch\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.531581 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:02.529956 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:29:02.531581 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.529914 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1cea0d8a-b836-4477-96b5-515bdde845d5-registration-dir\") pod \"aws-ebs-csi-driver-node-czhsd\" (UID: \"1cea0d8a-b836-4477-96b5-515bdde845d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" Jul 15 13:29:02.531581 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:02.530012 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d89f2fe-5910-4b03-afba-b491605dc56a-metrics-certs podName:1d89f2fe-5910-4b03-afba-b491605dc56a nodeName:}" failed. No retries permitted until 2026-07-15 13:29:03.029997259 +0000 UTC m=+3.149559274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d89f2fe-5910-4b03-afba-b491605dc56a-metrics-certs") pod "network-metrics-daemon-sbjdk" (UID: "1d89f2fe-5910-4b03-afba-b491605dc56a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:29:02.531581 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530058 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-system-cni-dir\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.531581 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530079 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-etc-modprobe-d\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.531581 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530090 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-host-var-lib-cni-bin\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.531581 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530118 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gssrv\" (UniqueName: \"kubernetes.io/projected/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-kube-api-access-gssrv\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.531581 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530136 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d024b3a4-a62c-4c57-adee-38378835c1c8-dbus\") pod \"global-pull-secret-syncer-d7hsr\" (UID: \"d024b3a4-a62c-4c57-adee-38378835c1c8\") " pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:02.532498 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530143 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-sys\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.532498 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530148 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4b463d4-4fda-4a24-8ee4-c6a14089e80b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lcdbd\" (UID: \"f4b463d4-4fda-4a24-8ee4-c6a14089e80b\") " pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.532498 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530168 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42a1082a-1cc4-4ca5-9291-9b5c86fcebfa-host\") pod \"node-ca-6zd8z\" (UID: \"42a1082a-1cc4-4ca5-9291-9b5c86fcebfa\") " pod="openshift-image-registry/node-ca-6zd8z" Jul 15 13:29:02.532498 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530184 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-host-var-lib-cni-bin\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.532498 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530202 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-etc-openvswitch\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.532498 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530207 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-sys\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.532498 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530235 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-host-var-lib-cni-multus\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.532498 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530247 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-etc-openvswitch\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.532498 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530210 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42a1082a-1cc4-4ca5-9291-9b5c86fcebfa-host\") pod \"node-ca-6zd8z\" (UID: \"42a1082a-1cc4-4ca5-9291-9b5c86fcebfa\") " pod="openshift-image-registry/node-ca-6zd8z" Jul 15 13:29:02.532498 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530275 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-systemd-units\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.532498 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530314 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-systemd-units\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.532498 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530278 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-host-var-lib-cni-multus\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.532498 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530325 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-node-log\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.532498 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530356 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c92079f2-6ca8-4000-b0b8-128ba9dccd98-ovnkube-config\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.532498 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530367 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-node-log\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.532498 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530389 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c92079f2-6ca8-4000-b0b8-128ba9dccd98-ovnkube-script-lib\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.532498 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530412 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/42a1082a-1cc4-4ca5-9291-9b5c86fcebfa-serviceca\") pod \"node-ca-6zd8z\" (UID: \"42a1082a-1cc4-4ca5-9291-9b5c86fcebfa\") " pod="openshift-image-registry/node-ca-6zd8z" Jul 15 13:29:02.532498 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530417 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cffkn\" (UniqueName: \"kubernetes.io/projected/c92079f2-6ca8-4000-b0b8-128ba9dccd98-kube-api-access-cffkn\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.533366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530447 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4b463d4-4fda-4a24-8ee4-c6a14089e80b-cni-binary-copy\") pod \"multus-additional-cni-plugins-lcdbd\" (UID: \"f4b463d4-4fda-4a24-8ee4-c6a14089e80b\") " pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.533366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530475 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c8sq\" (UniqueName: \"kubernetes.io/projected/1cea0d8a-b836-4477-96b5-515bdde845d5-kube-api-access-6c8sq\") pod \"aws-ebs-csi-driver-node-czhsd\" (UID: \"1cea0d8a-b836-4477-96b5-515bdde845d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" Jul 15 13:29:02.533366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530503 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1cea0d8a-b836-4477-96b5-515bdde845d5-device-dir\") pod \"aws-ebs-csi-driver-node-czhsd\" (UID: \"1cea0d8a-b836-4477-96b5-515bdde845d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" Jul 15 13:29:02.533366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530728 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1cea0d8a-b836-4477-96b5-515bdde845d5-device-dir\") pod \"aws-ebs-csi-driver-node-czhsd\" (UID: \"1cea0d8a-b836-4477-96b5-515bdde845d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" Jul 15 13:29:02.533366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530724 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4b463d4-4fda-4a24-8ee4-c6a14089e80b-cnibin\") pod \"multus-additional-cni-plugins-lcdbd\" (UID: \"f4b463d4-4fda-4a24-8ee4-c6a14089e80b\") " pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.533366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530770 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4b463d4-4fda-4a24-8ee4-c6a14089e80b-cnibin\") pod \"multus-additional-cni-plugins-lcdbd\" (UID: \"f4b463d4-4fda-4a24-8ee4-c6a14089e80b\") " pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.533366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530775 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-host-run-netns\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.533366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530807 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-host-run-netns\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.533366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530815 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-host-var-lib-kubelet\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.533366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530858 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c92079f2-6ca8-4000-b0b8-128ba9dccd98-env-overrides\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.533366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530912 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtg6x\" (UniqueName: \"kubernetes.io/projected/0869c56d-e6bf-4183-a388-6ad52c497fef-kube-api-access-dtg6x\") pod \"iptables-alerter-l2v2m\" (UID: \"0869c56d-e6bf-4183-a388-6ad52c497fef\") " pod="openshift-network-operator/iptables-alerter-l2v2m" Jul 15 13:29:02.533366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530916 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-host-var-lib-kubelet\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.533366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530943 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dplcw\" (UniqueName: \"kubernetes.io/projected/96eceb11-871f-4522-a3c1-c2795c533360-kube-api-access-dplcw\") pod \"node-resolver-8nchk\" (UID: \"96eceb11-871f-4522-a3c1-c2795c533360\") " pod="openshift-dns/node-resolver-8nchk" Jul 15 13:29:02.533366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530972 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-etc-sysctl-d\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.533366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.530979 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-multus-daemon-config\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.533366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531003 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-etc-systemd\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.533366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531012 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4b463d4-4fda-4a24-8ee4-c6a14089e80b-cni-binary-copy\") pod \"multus-additional-cni-plugins-lcdbd\" (UID: \"f4b463d4-4fda-4a24-8ee4-c6a14089e80b\") " pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.534267 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531033 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-var-lib-kubelet\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.534267 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531062 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clvl4\" (UniqueName: \"kubernetes.io/projected/42a1082a-1cc4-4ca5-9291-9b5c86fcebfa-kube-api-access-clvl4\") pod \"node-ca-6zd8z\" (UID: \"42a1082a-1cc4-4ca5-9291-9b5c86fcebfa\") " pod="openshift-image-registry/node-ca-6zd8z" Jul 15 13:29:02.534267 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531088 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-host-slash\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.534267 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531118 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4b463d4-4fda-4a24-8ee4-c6a14089e80b-system-cni-dir\") pod \"multus-additional-cni-plugins-lcdbd\" (UID: \"f4b463d4-4fda-4a24-8ee4-c6a14089e80b\") " pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.534267 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531122 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-etc-sysctl-d\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.534267 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531144 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c92079f2-6ca8-4000-b0b8-128ba9dccd98-ovnkube-config\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.534267 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531149 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f4b463d4-4fda-4a24-8ee4-c6a14089e80b-os-release\") pod \"multus-additional-cni-plugins-lcdbd\" (UID: \"f4b463d4-4fda-4a24-8ee4-c6a14089e80b\") " pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.534267 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531199 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0869c56d-e6bf-4183-a388-6ad52c497fef-host-slash\") pod \"iptables-alerter-l2v2m\" (UID: \"0869c56d-e6bf-4183-a388-6ad52c497fef\") " pod="openshift-network-operator/iptables-alerter-l2v2m" Jul 15 13:29:02.534267 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531211 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4b463d4-4fda-4a24-8ee4-c6a14089e80b-system-cni-dir\") pod \"multus-additional-cni-plugins-lcdbd\" (UID: \"f4b463d4-4fda-4a24-8ee4-c6a14089e80b\") " pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.534267 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531228 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f4b463d4-4fda-4a24-8ee4-c6a14089e80b-os-release\") pod \"multus-additional-cni-plugins-lcdbd\" (UID: \"f4b463d4-4fda-4a24-8ee4-c6a14089e80b\") " pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.534267 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531260 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-etc-systemd\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.534267 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531269 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-host-slash\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.534267 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531261 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1cea0d8a-b836-4477-96b5-515bdde845d5-socket-dir\") pod \"aws-ebs-csi-driver-node-czhsd\" (UID: \"1cea0d8a-b836-4477-96b5-515bdde845d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" Jul 15 13:29:02.534267 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531281 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c92079f2-6ca8-4000-b0b8-128ba9dccd98-env-overrides\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.534267 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531312 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-var-lib-kubelet\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.534267 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531320 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0869c56d-e6bf-4183-a388-6ad52c497fef-host-slash\") pod \"iptables-alerter-l2v2m\" (UID: \"0869c56d-e6bf-4183-a388-6ad52c497fef\") " pod="openshift-network-operator/iptables-alerter-l2v2m" Jul 15 13:29:02.534267 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531326 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-run\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.535097 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531356 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1cea0d8a-b836-4477-96b5-515bdde845d5-socket-dir\") pod \"aws-ebs-csi-driver-node-czhsd\" (UID: \"1cea0d8a-b836-4477-96b5-515bdde845d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" Jul 15 13:29:02.535097 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531380 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-run\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.535097 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531425 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-etc-tuned\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.535097 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531484 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-tmp\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.535097 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531561 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzmgq\" (UniqueName: \"kubernetes.io/projected/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-kube-api-access-zzmgq\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.535097 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531588 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-cnibin\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.535097 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531613 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-etc-kubernetes\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.535097 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531651 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-host-run-netns\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.535097 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531672 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1da889f2-18e0-4f9d-b932-38d83ef3bd43-agent-certs\") pod \"konnectivity-agent-hg6dx\" (UID: \"1da889f2-18e0-4f9d-b932-38d83ef3bd43\") " pod="kube-system/konnectivity-agent-hg6dx" Jul 15 13:29:02.535097 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531696 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1da889f2-18e0-4f9d-b932-38d83ef3bd43-konnectivity-ca\") pod \"konnectivity-agent-hg6dx\" (UID: \"1da889f2-18e0-4f9d-b932-38d83ef3bd43\") " pod="kube-system/konnectivity-agent-hg6dx" Jul 15 13:29:02.535097 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531721 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4b463d4-4fda-4a24-8ee4-c6a14089e80b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lcdbd\" (UID: \"f4b463d4-4fda-4a24-8ee4-c6a14089e80b\") " pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.535097 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531748 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96eceb11-871f-4522-a3c1-c2795c533360-tmp-dir\") pod \"node-resolver-8nchk\" (UID: \"96eceb11-871f-4522-a3c1-c2795c533360\") " pod="openshift-dns/node-resolver-8nchk" Jul 15 13:29:02.535097 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531774 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-host-run-k8s-cni-cncf-io\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.535097 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531776 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c92079f2-6ca8-4000-b0b8-128ba9dccd98-host-run-netns\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.535097 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531800 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-hostroot\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.535097 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531883 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-hostroot\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.535097 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531929 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-host-run-k8s-cni-cncf-io\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.535097 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531973 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4b463d4-4fda-4a24-8ee4-c6a14089e80b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lcdbd\" (UID: \"f4b463d4-4fda-4a24-8ee4-c6a14089e80b\") " pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.535947 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.531979 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-cnibin\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.535947 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.532015 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-etc-kubernetes\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.535947 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.532168 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96eceb11-871f-4522-a3c1-c2795c533360-tmp-dir\") pod \"node-resolver-8nchk\" (UID: \"96eceb11-871f-4522-a3c1-c2795c533360\") " pod="openshift-dns/node-resolver-8nchk" Jul 15 13:29:02.535947 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.532299 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c92079f2-6ca8-4000-b0b8-128ba9dccd98-ovnkube-script-lib\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.535947 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.532504 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1da889f2-18e0-4f9d-b932-38d83ef3bd43-konnectivity-ca\") pod \"konnectivity-agent-hg6dx\" (UID: \"1da889f2-18e0-4f9d-b932-38d83ef3bd43\") " pod="kube-system/konnectivity-agent-hg6dx" Jul 15 13:29:02.535947 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.535006 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-etc-tuned\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.536241 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.536127 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1da889f2-18e0-4f9d-b932-38d83ef3bd43-agent-certs\") pod \"konnectivity-agent-hg6dx\" (UID: \"1da889f2-18e0-4f9d-b932-38d83ef3bd43\") " pod="kube-system/konnectivity-agent-hg6dx" Jul 15 13:29:02.536241 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.536163 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c92079f2-6ca8-4000-b0b8-128ba9dccd98-ovn-node-metrics-cert\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.536657 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.536638 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-tmp\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.540043 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:02.539943 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:29:02.540043 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:02.539969 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:29:02.540043 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:02.539983 2558 projected.go:196] Error preparing data for projected volume kube-api-access-hhbnn for pod openshift-network-diagnostics/network-check-target-m8n2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:29:02.540296 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:02.540061 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3cd2f3c-8841-43bc-887c-c24ef412ea2f-kube-api-access-hhbnn podName:d3cd2f3c-8841-43bc-887c-c24ef412ea2f nodeName:}" failed. No retries permitted until 2026-07-15 13:29:03.040042889 +0000 UTC m=+3.159604891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hhbnn" (UniqueName: "kubernetes.io/projected/d3cd2f3c-8841-43bc-887c-c24ef412ea2f-kube-api-access-hhbnn") pod "network-check-target-m8n2n" (UID: "d3cd2f3c-8841-43bc-887c-c24ef412ea2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:29:02.541854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.541829 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgw5m\" (UniqueName: \"kubernetes.io/projected/1d89f2fe-5910-4b03-afba-b491605dc56a-kube-api-access-jgw5m\") pod \"network-metrics-daemon-sbjdk\" (UID: \"1d89f2fe-5910-4b03-afba-b491605dc56a\") " pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:02.542397 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.542358 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvc5p\" (UniqueName: \"kubernetes.io/projected/f4b463d4-4fda-4a24-8ee4-c6a14089e80b-kube-api-access-cvc5p\") pod \"multus-additional-cni-plugins-lcdbd\" (UID: \"f4b463d4-4fda-4a24-8ee4-c6a14089e80b\") " pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.543289 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.543228 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clvl4\" (UniqueName: \"kubernetes.io/projected/42a1082a-1cc4-4ca5-9291-9b5c86fcebfa-kube-api-access-clvl4\") pod \"node-ca-6zd8z\" (UID: \"42a1082a-1cc4-4ca5-9291-9b5c86fcebfa\") " pod="openshift-image-registry/node-ca-6zd8z" Jul 15 13:29:02.543996 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.543907 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dplcw\" (UniqueName: \"kubernetes.io/projected/96eceb11-871f-4522-a3c1-c2795c533360-kube-api-access-dplcw\") pod \"node-resolver-8nchk\" (UID: \"96eceb11-871f-4522-a3c1-c2795c533360\") " pod="openshift-dns/node-resolver-8nchk" Jul 15 13:29:02.544565 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.544517 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtg6x\" (UniqueName: \"kubernetes.io/projected/0869c56d-e6bf-4183-a388-6ad52c497fef-kube-api-access-dtg6x\") pod \"iptables-alerter-l2v2m\" (UID: \"0869c56d-e6bf-4183-a388-6ad52c497fef\") " pod="openshift-network-operator/iptables-alerter-l2v2m" Jul 15 13:29:02.544993 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.544961 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c8sq\" (UniqueName: \"kubernetes.io/projected/1cea0d8a-b836-4477-96b5-515bdde845d5-kube-api-access-6c8sq\") pod \"aws-ebs-csi-driver-node-czhsd\" (UID: \"1cea0d8a-b836-4477-96b5-515bdde845d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" Jul 15 13:29:02.545198 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.545168 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gssrv\" (UniqueName: \"kubernetes.io/projected/63f1c3a8-9aed-4bd9-9111-95b8c2b5805a-kube-api-access-gssrv\") pod \"multus-8khhd\" (UID: \"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a\") " pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.545537 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.545502 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzmgq\" (UniqueName: \"kubernetes.io/projected/9ef73f53-13b9-430c-8456-3f7eaaab7fcb-kube-api-access-zzmgq\") pod \"tuned-4zbrw\" (UID: \"9ef73f53-13b9-430c-8456-3f7eaaab7fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.545919 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.545899 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cffkn\" (UniqueName: \"kubernetes.io/projected/c92079f2-6ca8-4000-b0b8-128ba9dccd98-kube-api-access-cffkn\") pod \"ovnkube-node-fkf79\" (UID: \"c92079f2-6ca8-4000-b0b8-128ba9dccd98\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.669597 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.669493 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" Jul 15 13:29:02.720813 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.720743 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l2v2m" Jul 15 13:29:02.732085 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.732051 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8khhd" Jul 15 13:29:02.738118 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.738085 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lcdbd" Jul 15 13:29:02.745376 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.745351 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" Jul 15 13:29:02.752333 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.752304 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6zd8z" Jul 15 13:29:02.759305 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.759277 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8nchk" Jul 15 13:29:02.767271 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.767243 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:02.771724 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:02.771697 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hg6dx" Jul 15 13:29:03.036830 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:03.036800 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d024b3a4-a62c-4c57-adee-38378835c1c8-original-pull-secret\") pod \"global-pull-secret-syncer-d7hsr\" (UID: \"d024b3a4-a62c-4c57-adee-38378835c1c8\") " pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:03.036967 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:03.036837 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d89f2fe-5910-4b03-afba-b491605dc56a-metrics-certs\") pod \"network-metrics-daemon-sbjdk\" (UID: \"1d89f2fe-5910-4b03-afba-b491605dc56a\") " pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:03.037017 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:03.036963 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:29:03.037067 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:03.037028 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d024b3a4-a62c-4c57-adee-38378835c1c8-original-pull-secret podName:d024b3a4-a62c-4c57-adee-38378835c1c8 nodeName:}" failed. No retries permitted until 2026-07-15 13:29:04.037014904 +0000 UTC m=+4.156576918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d024b3a4-a62c-4c57-adee-38378835c1c8-original-pull-secret") pod "global-pull-secret-syncer-d7hsr" (UID: "d024b3a4-a62c-4c57-adee-38378835c1c8") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:29:03.037067 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:03.036963 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:29:03.037193 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:03.037108 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d89f2fe-5910-4b03-afba-b491605dc56a-metrics-certs podName:1d89f2fe-5910-4b03-afba-b491605dc56a nodeName:}" failed. No retries permitted until 2026-07-15 13:29:04.037094464 +0000 UTC m=+4.156656468 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d89f2fe-5910-4b03-afba-b491605dc56a-metrics-certs") pod "network-metrics-daemon-sbjdk" (UID: "1d89f2fe-5910-4b03-afba-b491605dc56a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:29:03.038847 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:03.038817 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cea0d8a_b836_4477_96b5_515bdde845d5.slice/crio-03d0fb9a5504dafde5912c12c3a8ffdb4009a70bad47b44c5c4d365011cd8053 WatchSource:0}: Error finding container 03d0fb9a5504dafde5912c12c3a8ffdb4009a70bad47b44c5c4d365011cd8053: Status 404 returned error can't find the container with id 03d0fb9a5504dafde5912c12c3a8ffdb4009a70bad47b44c5c4d365011cd8053 Jul 15 13:29:03.046213 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:03.046165 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc92079f2_6ca8_4000_b0b8_128ba9dccd98.slice/crio-dc33f297b6267f8eb636fa4fbfe6636880898d3a180924f6f806fee9f5bd9a54 WatchSource:0}: Error finding container dc33f297b6267f8eb636fa4fbfe6636880898d3a180924f6f806fee9f5bd9a54: Status 404 returned error can't find the container with id dc33f297b6267f8eb636fa4fbfe6636880898d3a180924f6f806fee9f5bd9a54 Jul 15 13:29:03.050152 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:03.050051 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0869c56d_e6bf_4183_a388_6ad52c497fef.slice/crio-5180ceca4314975608fc047f58614c4382e63c48bd3e8040a1b2492ea000c7c6 WatchSource:0}: Error finding container 5180ceca4314975608fc047f58614c4382e63c48bd3e8040a1b2492ea000c7c6: Status 404 returned error can't find the container with id 5180ceca4314975608fc047f58614c4382e63c48bd3e8040a1b2492ea000c7c6 Jul 15 13:29:03.050981 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:03.050955 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63f1c3a8_9aed_4bd9_9111_95b8c2b5805a.slice/crio-82416029170b81832b236dd3f617c673cd1e52e91167dda812487b12b4c2a86b WatchSource:0}: Error finding container 82416029170b81832b236dd3f617c673cd1e52e91167dda812487b12b4c2a86b: Status 404 returned error can't find the container with id 82416029170b81832b236dd3f617c673cd1e52e91167dda812487b12b4c2a86b Jul 15 13:29:03.051803 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:03.051776 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4b463d4_4fda_4a24_8ee4_c6a14089e80b.slice/crio-001759202c9b2f23aa6c726bb2f095d84034d6f88de606883ffb0996a51be8c1 WatchSource:0}: Error finding container 001759202c9b2f23aa6c726bb2f095d84034d6f88de606883ffb0996a51be8c1: Status 404 returned error can't find the container with id 001759202c9b2f23aa6c726bb2f095d84034d6f88de606883ffb0996a51be8c1 Jul 15 13:29:03.052578 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:03.052530 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ef73f53_13b9_430c_8456_3f7eaaab7fcb.slice/crio-53376e322746b400c9fbdb6904a068f719d74457587d4b3a80cc36f4357c7dfb WatchSource:0}: Error finding container 53376e322746b400c9fbdb6904a068f719d74457587d4b3a80cc36f4357c7dfb: Status 404 returned error can't find the container with id 53376e322746b400c9fbdb6904a068f719d74457587d4b3a80cc36f4357c7dfb Jul 15 13:29:03.055448 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:03.054284 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1da889f2_18e0_4f9d_b932_38d83ef3bd43.slice/crio-f499a6f24468df4910dfd169d665dfba324a29f1d7e99c51fa311f40e9de26db WatchSource:0}: Error finding container f499a6f24468df4910dfd169d665dfba324a29f1d7e99c51fa311f40e9de26db: Status 404 returned error can't find the container with id f499a6f24468df4910dfd169d665dfba324a29f1d7e99c51fa311f40e9de26db Jul 15 13:29:03.055448 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:03.055400 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42a1082a_1cc4_4ca5_9291_9b5c86fcebfa.slice/crio-d0b784f94e55af0295e03f364e4c80aeba97d0f2a328f152bc9dbfca615afa90 WatchSource:0}: Error finding container d0b784f94e55af0295e03f364e4c80aeba97d0f2a328f152bc9dbfca615afa90: Status 404 returned error can't find the container with id d0b784f94e55af0295e03f364e4c80aeba97d0f2a328f152bc9dbfca615afa90 Jul 15 13:29:03.137554 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:03.137509 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhbnn\" (UniqueName: \"kubernetes.io/projected/d3cd2f3c-8841-43bc-887c-c24ef412ea2f-kube-api-access-hhbnn\") pod \"network-check-target-m8n2n\" (UID: \"d3cd2f3c-8841-43bc-887c-c24ef412ea2f\") " pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:03.137758 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:03.137739 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:29:03.137834 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:03.137768 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:29:03.137834 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:03.137784 2558 projected.go:196] Error preparing data for projected volume kube-api-access-hhbnn for pod openshift-network-diagnostics/network-check-target-m8n2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:29:03.137929 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:03.137866 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3cd2f3c-8841-43bc-887c-c24ef412ea2f-kube-api-access-hhbnn podName:d3cd2f3c-8841-43bc-887c-c24ef412ea2f nodeName:}" failed. No retries permitted until 2026-07-15 13:29:04.137845396 +0000 UTC m=+4.257407413 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhbnn" (UniqueName: "kubernetes.io/projected/d3cd2f3c-8841-43bc-887c-c24ef412ea2f-kube-api-access-hhbnn") pod "network-check-target-m8n2n" (UID: "d3cd2f3c-8841-43bc-887c-c24ef412ea2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:29:03.349090 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:03.349064 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 13:29:03.423410 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:03.423159 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 13:24:02 +0000 UTC" deadline="2028-01-07 14:10:17.551052941 +0000 UTC" Jul 15 13:29:03.423410 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:03.423402 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12984h41m14.127654478s" Jul 15 13:29:03.473024 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:03.472959 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:03.473228 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:03.473102 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m8n2n" podUID="d3cd2f3c-8841-43bc-887c-c24ef412ea2f" Jul 15 13:29:03.484476 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:03.484417 2558 generic.go:356] "Generic (PLEG): container finished" podID="40dae1498354de2e9db018ec29df6929" containerID="b698ad8ea6bf7867860d7eee3674991171bbd6b8cd271a741ed7f59d06055ff0" exitCode=0 Jul 15 13:29:03.484802 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:03.484732 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" event={"ID":"40dae1498354de2e9db018ec29df6929","Type":"ContainerDied","Data":"b698ad8ea6bf7867860d7eee3674991171bbd6b8cd271a741ed7f59d06055ff0"} Jul 15 13:29:03.486499 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:03.486415 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6zd8z" event={"ID":"42a1082a-1cc4-4ca5-9291-9b5c86fcebfa","Type":"ContainerStarted","Data":"d0b784f94e55af0295e03f364e4c80aeba97d0f2a328f152bc9dbfca615afa90"} Jul 15 13:29:03.488173 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:03.488129 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lcdbd" event={"ID":"f4b463d4-4fda-4a24-8ee4-c6a14089e80b","Type":"ContainerStarted","Data":"001759202c9b2f23aa6c726bb2f095d84034d6f88de606883ffb0996a51be8c1"} Jul 15 13:29:03.489963 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:03.489911 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8khhd" event={"ID":"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a","Type":"ContainerStarted","Data":"82416029170b81832b236dd3f617c673cd1e52e91167dda812487b12b4c2a86b"} Jul 15 13:29:03.491509 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:03.491475 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l2v2m" event={"ID":"0869c56d-e6bf-4183-a388-6ad52c497fef","Type":"ContainerStarted","Data":"5180ceca4314975608fc047f58614c4382e63c48bd3e8040a1b2492ea000c7c6"} Jul 15 13:29:03.493348 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:03.493260 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" event={"ID":"c92079f2-6ca8-4000-b0b8-128ba9dccd98","Type":"ContainerStarted","Data":"dc33f297b6267f8eb636fa4fbfe6636880898d3a180924f6f806fee9f5bd9a54"} Jul 15 13:29:03.496024 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:03.495951 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" event={"ID":"1cea0d8a-b836-4477-96b5-515bdde845d5","Type":"ContainerStarted","Data":"03d0fb9a5504dafde5912c12c3a8ffdb4009a70bad47b44c5c4d365011cd8053"} Jul 15 13:29:03.497519 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:03.497455 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hg6dx" event={"ID":"1da889f2-18e0-4f9d-b932-38d83ef3bd43","Type":"ContainerStarted","Data":"f499a6f24468df4910dfd169d665dfba324a29f1d7e99c51fa311f40e9de26db"} Jul 15 13:29:03.499188 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:03.499119 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" event={"ID":"9ef73f53-13b9-430c-8456-3f7eaaab7fcb","Type":"ContainerStarted","Data":"53376e322746b400c9fbdb6904a068f719d74457587d4b3a80cc36f4357c7dfb"} Jul 15 13:29:03.501775 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:03.501747 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8nchk" event={"ID":"96eceb11-871f-4522-a3c1-c2795c533360","Type":"ContainerStarted","Data":"bb46978c24e5060e729e574af93cccf7e6238a97ec077b4edf164b8f009f3eb7"} Jul 15 13:29:04.045752 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:04.044931 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d024b3a4-a62c-4c57-adee-38378835c1c8-original-pull-secret\") pod \"global-pull-secret-syncer-d7hsr\" (UID: \"d024b3a4-a62c-4c57-adee-38378835c1c8\") " pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:04.045752 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:04.044994 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d89f2fe-5910-4b03-afba-b491605dc56a-metrics-certs\") pod \"network-metrics-daemon-sbjdk\" (UID: \"1d89f2fe-5910-4b03-afba-b491605dc56a\") " pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:04.045752 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:04.045269 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:29:04.045752 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:04.045337 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d024b3a4-a62c-4c57-adee-38378835c1c8-original-pull-secret podName:d024b3a4-a62c-4c57-adee-38378835c1c8 nodeName:}" failed. No retries permitted until 2026-07-15 13:29:06.045317709 +0000 UTC m=+6.164879723 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d024b3a4-a62c-4c57-adee-38378835c1c8-original-pull-secret") pod "global-pull-secret-syncer-d7hsr" (UID: "d024b3a4-a62c-4c57-adee-38378835c1c8") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:29:04.045752 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:04.045403 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:29:04.045752 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:04.045436 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d89f2fe-5910-4b03-afba-b491605dc56a-metrics-certs podName:1d89f2fe-5910-4b03-afba-b491605dc56a nodeName:}" failed. No retries permitted until 2026-07-15 13:29:06.04542526 +0000 UTC m=+6.164987275 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d89f2fe-5910-4b03-afba-b491605dc56a-metrics-certs") pod "network-metrics-daemon-sbjdk" (UID: "1d89f2fe-5910-4b03-afba-b491605dc56a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:29:04.145809 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:04.145761 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhbnn\" (UniqueName: \"kubernetes.io/projected/d3cd2f3c-8841-43bc-887c-c24ef412ea2f-kube-api-access-hhbnn\") pod \"network-check-target-m8n2n\" (UID: \"d3cd2f3c-8841-43bc-887c-c24ef412ea2f\") " pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:04.146014 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:04.145953 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:29:04.146014 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:04.145977 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:29:04.146014 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:04.145992 2558 projected.go:196] Error preparing data for projected volume kube-api-access-hhbnn for pod openshift-network-diagnostics/network-check-target-m8n2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:29:04.146193 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:04.146058 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3cd2f3c-8841-43bc-887c-c24ef412ea2f-kube-api-access-hhbnn podName:d3cd2f3c-8841-43bc-887c-c24ef412ea2f nodeName:}" failed. No retries permitted until 2026-07-15 13:29:06.146037894 +0000 UTC m=+6.265599908 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhbnn" (UniqueName: "kubernetes.io/projected/d3cd2f3c-8841-43bc-887c-c24ef412ea2f-kube-api-access-hhbnn") pod "network-check-target-m8n2n" (UID: "d3cd2f3c-8841-43bc-887c-c24ef412ea2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:29:04.424166 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:04.424024 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 13:24:02 +0000 UTC" deadline="2027-12-17 20:59:45.4851465 +0000 UTC" Jul 15 13:29:04.424166 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:04.424071 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12487h30m41.061081416s" Jul 15 13:29:04.475996 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:04.475269 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:04.475996 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:04.475411 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7hsr" podUID="d024b3a4-a62c-4c57-adee-38378835c1c8" Jul 15 13:29:04.475996 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:04.475829 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:04.475996 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:04.475934 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjdk" podUID="1d89f2fe-5910-4b03-afba-b491605dc56a" Jul 15 13:29:04.517894 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:04.516734 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" event={"ID":"40dae1498354de2e9db018ec29df6929","Type":"ContainerStarted","Data":"d571e435db6f80c20c46f8b2a0ff85aa0987f02b079cb6dd82585e107733b93c"} Jul 15 13:29:05.473524 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:05.473483 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:05.474034 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:05.473634 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m8n2n" podUID="d3cd2f3c-8841-43bc-887c-c24ef412ea2f" Jul 15 13:29:06.069930 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:06.069876 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d024b3a4-a62c-4c57-adee-38378835c1c8-original-pull-secret\") pod \"global-pull-secret-syncer-d7hsr\" (UID: \"d024b3a4-a62c-4c57-adee-38378835c1c8\") " pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:06.070133 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:06.069952 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d89f2fe-5910-4b03-afba-b491605dc56a-metrics-certs\") pod \"network-metrics-daemon-sbjdk\" (UID: \"1d89f2fe-5910-4b03-afba-b491605dc56a\") " pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:06.070133 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:06.070107 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:29:06.070261 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:06.070174 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d89f2fe-5910-4b03-afba-b491605dc56a-metrics-certs podName:1d89f2fe-5910-4b03-afba-b491605dc56a nodeName:}" failed. No retries permitted until 2026-07-15 13:29:10.070153292 +0000 UTC m=+10.189715314 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d89f2fe-5910-4b03-afba-b491605dc56a-metrics-certs") pod "network-metrics-daemon-sbjdk" (UID: "1d89f2fe-5910-4b03-afba-b491605dc56a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:29:06.070668 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:06.070638 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:29:06.070779 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:06.070716 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d024b3a4-a62c-4c57-adee-38378835c1c8-original-pull-secret podName:d024b3a4-a62c-4c57-adee-38378835c1c8 nodeName:}" failed. No retries permitted until 2026-07-15 13:29:10.070698978 +0000 UTC m=+10.190260994 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d024b3a4-a62c-4c57-adee-38378835c1c8-original-pull-secret") pod "global-pull-secret-syncer-d7hsr" (UID: "d024b3a4-a62c-4c57-adee-38378835c1c8") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:29:06.170600 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:06.170546 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhbnn\" (UniqueName: \"kubernetes.io/projected/d3cd2f3c-8841-43bc-887c-c24ef412ea2f-kube-api-access-hhbnn\") pod \"network-check-target-m8n2n\" (UID: \"d3cd2f3c-8841-43bc-887c-c24ef412ea2f\") " pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:06.170812 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:06.170781 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:29:06.170812 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:06.170809 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:29:06.170944 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:06.170831 2558 projected.go:196] Error preparing data for projected volume kube-api-access-hhbnn for pod openshift-network-diagnostics/network-check-target-m8n2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:29:06.170944 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:06.170900 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3cd2f3c-8841-43bc-887c-c24ef412ea2f-kube-api-access-hhbnn podName:d3cd2f3c-8841-43bc-887c-c24ef412ea2f nodeName:}" failed. No retries permitted until 2026-07-15 13:29:10.170879978 +0000 UTC m=+10.290441978 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhbnn" (UniqueName: "kubernetes.io/projected/d3cd2f3c-8841-43bc-887c-c24ef412ea2f-kube-api-access-hhbnn") pod "network-check-target-m8n2n" (UID: "d3cd2f3c-8841-43bc-887c-c24ef412ea2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:29:06.474159 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:06.474058 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:06.474694 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:06.474205 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7hsr" podUID="d024b3a4-a62c-4c57-adee-38378835c1c8" Jul 15 13:29:06.474694 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:06.474636 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:06.474826 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:06.474769 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjdk" podUID="1d89f2fe-5910-4b03-afba-b491605dc56a" Jul 15 13:29:07.473022 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:07.472982 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:07.473209 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:07.473116 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m8n2n" podUID="d3cd2f3c-8841-43bc-887c-c24ef412ea2f" Jul 15 13:29:08.476615 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:08.475874 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:08.476615 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:08.476028 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7hsr" podUID="d024b3a4-a62c-4c57-adee-38378835c1c8" Jul 15 13:29:08.476615 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:08.476443 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:08.476615 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:08.476550 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjdk" podUID="1d89f2fe-5910-4b03-afba-b491605dc56a" Jul 15 13:29:09.473134 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:09.473092 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:09.473340 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:09.473223 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m8n2n" podUID="d3cd2f3c-8841-43bc-887c-c24ef412ea2f" Jul 15 13:29:10.108538 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:10.108500 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d024b3a4-a62c-4c57-adee-38378835c1c8-original-pull-secret\") pod \"global-pull-secret-syncer-d7hsr\" (UID: \"d024b3a4-a62c-4c57-adee-38378835c1c8\") " pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:10.109041 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:10.108560 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d89f2fe-5910-4b03-afba-b491605dc56a-metrics-certs\") pod \"network-metrics-daemon-sbjdk\" (UID: \"1d89f2fe-5910-4b03-afba-b491605dc56a\") " pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:10.109041 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:10.108690 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:29:10.109041 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:10.108736 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:29:10.109041 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:10.108756 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d024b3a4-a62c-4c57-adee-38378835c1c8-original-pull-secret podName:d024b3a4-a62c-4c57-adee-38378835c1c8 nodeName:}" failed. No retries permitted until 2026-07-15 13:29:18.108737545 +0000 UTC m=+18.228299545 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d024b3a4-a62c-4c57-adee-38378835c1c8-original-pull-secret") pod "global-pull-secret-syncer-d7hsr" (UID: "d024b3a4-a62c-4c57-adee-38378835c1c8") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:29:10.109041 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:10.108788 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d89f2fe-5910-4b03-afba-b491605dc56a-metrics-certs podName:1d89f2fe-5910-4b03-afba-b491605dc56a nodeName:}" failed. No retries permitted until 2026-07-15 13:29:18.108772065 +0000 UTC m=+18.228334065 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d89f2fe-5910-4b03-afba-b491605dc56a-metrics-certs") pod "network-metrics-daemon-sbjdk" (UID: "1d89f2fe-5910-4b03-afba-b491605dc56a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:29:10.209437 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:10.209388 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhbnn\" (UniqueName: \"kubernetes.io/projected/d3cd2f3c-8841-43bc-887c-c24ef412ea2f-kube-api-access-hhbnn\") pod \"network-check-target-m8n2n\" (UID: \"d3cd2f3c-8841-43bc-887c-c24ef412ea2f\") " pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:10.209657 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:10.209558 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:29:10.209657 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:10.209589 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:29:10.209657 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:10.209617 2558 projected.go:196] Error preparing data for projected volume kube-api-access-hhbnn for pod openshift-network-diagnostics/network-check-target-m8n2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:29:10.209839 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:10.209684 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3cd2f3c-8841-43bc-887c-c24ef412ea2f-kube-api-access-hhbnn podName:d3cd2f3c-8841-43bc-887c-c24ef412ea2f nodeName:}" failed. No retries permitted until 2026-07-15 13:29:18.209662921 +0000 UTC m=+18.329224931 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhbnn" (UniqueName: "kubernetes.io/projected/d3cd2f3c-8841-43bc-887c-c24ef412ea2f-kube-api-access-hhbnn") pod "network-check-target-m8n2n" (UID: "d3cd2f3c-8841-43bc-887c-c24ef412ea2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:29:10.475294 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:10.474534 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:10.475294 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:10.474696 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7hsr" podUID="d024b3a4-a62c-4c57-adee-38378835c1c8" Jul 15 13:29:10.475294 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:10.475081 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:10.475294 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:10.475194 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjdk" podUID="1d89f2fe-5910-4b03-afba-b491605dc56a" Jul 15 13:29:11.473337 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:11.473296 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:11.473816 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:11.473455 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m8n2n" podUID="d3cd2f3c-8841-43bc-887c-c24ef412ea2f" Jul 15 13:29:12.472986 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:12.472940 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:12.473167 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:12.473091 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7hsr" podUID="d024b3a4-a62c-4c57-adee-38378835c1c8" Jul 15 13:29:12.473451 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:12.473426 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:12.473840 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:12.473555 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjdk" podUID="1d89f2fe-5910-4b03-afba-b491605dc56a" Jul 15 13:29:13.473311 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:13.473275 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:13.473562 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:13.473444 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m8n2n" podUID="d3cd2f3c-8841-43bc-887c-c24ef412ea2f" Jul 15 13:29:14.472644 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:14.472611 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:14.472840 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:14.472595 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:14.472840 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:14.472770 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjdk" podUID="1d89f2fe-5910-4b03-afba-b491605dc56a" Jul 15 13:29:14.473018 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:14.472987 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7hsr" podUID="d024b3a4-a62c-4c57-adee-38378835c1c8" Jul 15 13:29:15.473530 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:15.473428 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:15.474004 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:15.473563 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m8n2n" podUID="d3cd2f3c-8841-43bc-887c-c24ef412ea2f" Jul 15 13:29:16.473400 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:16.473364 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:16.473575 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:16.473364 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:16.473575 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:16.473497 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7hsr" podUID="d024b3a4-a62c-4c57-adee-38378835c1c8" Jul 15 13:29:16.473992 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:16.473624 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjdk" podUID="1d89f2fe-5910-4b03-afba-b491605dc56a" Jul 15 13:29:17.473376 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:17.473333 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:17.473591 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:17.473482 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m8n2n" podUID="d3cd2f3c-8841-43bc-887c-c24ef412ea2f" Jul 15 13:29:18.172779 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:18.172740 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d89f2fe-5910-4b03-afba-b491605dc56a-metrics-certs\") pod \"network-metrics-daemon-sbjdk\" (UID: \"1d89f2fe-5910-4b03-afba-b491605dc56a\") " pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:18.172958 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:18.172849 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d024b3a4-a62c-4c57-adee-38378835c1c8-original-pull-secret\") pod \"global-pull-secret-syncer-d7hsr\" (UID: \"d024b3a4-a62c-4c57-adee-38378835c1c8\") " pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:18.172958 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:18.172920 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:29:18.173052 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:18.172960 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:29:18.173052 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:18.173010 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d89f2fe-5910-4b03-afba-b491605dc56a-metrics-certs podName:1d89f2fe-5910-4b03-afba-b491605dc56a nodeName:}" failed. No retries permitted until 2026-07-15 13:29:34.172986976 +0000 UTC m=+34.292548992 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d89f2fe-5910-4b03-afba-b491605dc56a-metrics-certs") pod "network-metrics-daemon-sbjdk" (UID: "1d89f2fe-5910-4b03-afba-b491605dc56a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:29:18.173052 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:18.173029 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d024b3a4-a62c-4c57-adee-38378835c1c8-original-pull-secret podName:d024b3a4-a62c-4c57-adee-38378835c1c8 nodeName:}" failed. No retries permitted until 2026-07-15 13:29:34.173020676 +0000 UTC m=+34.292582672 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d024b3a4-a62c-4c57-adee-38378835c1c8-original-pull-secret") pod "global-pull-secret-syncer-d7hsr" (UID: "d024b3a4-a62c-4c57-adee-38378835c1c8") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:29:18.273854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:18.273814 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhbnn\" (UniqueName: \"kubernetes.io/projected/d3cd2f3c-8841-43bc-887c-c24ef412ea2f-kube-api-access-hhbnn\") pod \"network-check-target-m8n2n\" (UID: \"d3cd2f3c-8841-43bc-887c-c24ef412ea2f\") " pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:18.274026 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:18.273952 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:29:18.274026 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:18.273969 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:29:18.274026 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:18.273981 2558 projected.go:196] Error preparing data for projected volume kube-api-access-hhbnn for pod openshift-network-diagnostics/network-check-target-m8n2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:29:18.274186 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:18.274039 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3cd2f3c-8841-43bc-887c-c24ef412ea2f-kube-api-access-hhbnn podName:d3cd2f3c-8841-43bc-887c-c24ef412ea2f nodeName:}" failed. No retries permitted until 2026-07-15 13:29:34.274020604 +0000 UTC m=+34.393582620 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhbnn" (UniqueName: "kubernetes.io/projected/d3cd2f3c-8841-43bc-887c-c24ef412ea2f-kube-api-access-hhbnn") pod "network-check-target-m8n2n" (UID: "d3cd2f3c-8841-43bc-887c-c24ef412ea2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:29:18.473376 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:18.473280 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:18.473376 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:18.473335 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:18.473583 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:18.473446 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjdk" podUID="1d89f2fe-5910-4b03-afba-b491605dc56a" Jul 15 13:29:18.473583 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:18.473558 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7hsr" podUID="d024b3a4-a62c-4c57-adee-38378835c1c8" Jul 15 13:29:19.473290 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:19.473256 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:19.473482 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:19.473368 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m8n2n" podUID="d3cd2f3c-8841-43bc-887c-c24ef412ea2f" Jul 15 13:29:20.476259 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:20.476223 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:20.476678 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:20.476337 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjdk" podUID="1d89f2fe-5910-4b03-afba-b491605dc56a" Jul 15 13:29:20.476678 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:20.476393 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:20.476678 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:20.476513 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7hsr" podUID="d024b3a4-a62c-4c57-adee-38378835c1c8" Jul 15 13:29:21.473266 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:21.473223 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:21.473472 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:21.473352 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m8n2n" podUID="d3cd2f3c-8841-43bc-887c-c24ef412ea2f" Jul 15 13:29:22.476216 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:22.476187 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:22.476708 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:22.476329 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjdk" podUID="1d89f2fe-5910-4b03-afba-b491605dc56a" Jul 15 13:29:22.476708 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:22.476349 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:22.476708 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:22.476452 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7hsr" podUID="d024b3a4-a62c-4c57-adee-38378835c1c8" Jul 15 13:29:23.472719 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:23.472685 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:23.472922 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:23.472795 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m8n2n" podUID="d3cd2f3c-8841-43bc-887c-c24ef412ea2f" Jul 15 13:29:24.472884 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.472692 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:24.473762 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:24.472977 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7hsr" podUID="d024b3a4-a62c-4c57-adee-38378835c1c8" Jul 15 13:29:24.473762 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.472699 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:24.473762 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:24.473148 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjdk" podUID="1d89f2fe-5910-4b03-afba-b491605dc56a" Jul 15 13:29:24.566841 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.566794 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-45.ec2.internal" event={"ID":"7f7ac29e3ebd41aa7e117b631fbe0b37","Type":"ContainerStarted","Data":"3cbd281d247e8da28eb8a0f853d79748a9445b754033d105dbd866f3f5b0ff30"} Jul 15 13:29:24.568571 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.568532 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6zd8z" event={"ID":"42a1082a-1cc4-4ca5-9291-9b5c86fcebfa","Type":"ContainerStarted","Data":"b57826a98b2aca3d7d5efea3fc4cae7dd6e2b8301cdb7d79440fcb7b65d46083"} Jul 15 13:29:24.570434 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.570404 2558 generic.go:356] "Generic (PLEG): container finished" podID="f4b463d4-4fda-4a24-8ee4-c6a14089e80b" containerID="5f10d0e8d522d61fb50932f9216ea19ee6be450b74915c52961b8f9acee892bd" exitCode=0 Jul 15 13:29:24.570565 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.570489 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lcdbd" event={"ID":"f4b463d4-4fda-4a24-8ee4-c6a14089e80b","Type":"ContainerDied","Data":"5f10d0e8d522d61fb50932f9216ea19ee6be450b74915c52961b8f9acee892bd"} Jul 15 13:29:24.572614 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.572575 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8khhd" event={"ID":"63f1c3a8-9aed-4bd9-9111-95b8c2b5805a","Type":"ContainerStarted","Data":"e87382c2096d588685b10bed10fba8dd5d5387775c96695b57258992d6dcf736"} Jul 15 13:29:24.575858 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.575840 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkf79_c92079f2-6ca8-4000-b0b8-128ba9dccd98/ovn-acl-logging/0.log" Jul 15 13:29:24.576262 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.576237 2558 generic.go:356] "Generic (PLEG): container finished" podID="c92079f2-6ca8-4000-b0b8-128ba9dccd98" containerID="e545941ea75f7798f49abe5060df441ba66fc2756a9cc28008b8674b9786cfed" exitCode=1 Jul 15 13:29:24.576375 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.576318 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" event={"ID":"c92079f2-6ca8-4000-b0b8-128ba9dccd98","Type":"ContainerStarted","Data":"b321faf89598c55994a8c34ff96a835484c43939972c098434bf6976a17e61b6"} Jul 15 13:29:24.576430 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.576410 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" event={"ID":"c92079f2-6ca8-4000-b0b8-128ba9dccd98","Type":"ContainerStarted","Data":"57c8c06387ea8adbc7292c667d41b923405adf4e27db7d06da7fcc39c03511e7"} Jul 15 13:29:24.576485 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.576469 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" event={"ID":"c92079f2-6ca8-4000-b0b8-128ba9dccd98","Type":"ContainerStarted","Data":"d28af66a227810ce5061ad36144d87dc8e1946ff34d2f9b6558fd89a52d7312f"} Jul 15 13:29:24.576553 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.576518 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" event={"ID":"c92079f2-6ca8-4000-b0b8-128ba9dccd98","Type":"ContainerStarted","Data":"48eb06a7c8503b681a1ab817ce3b8629a973359325047432ce6fd671c205a758"} Jul 15 13:29:24.576623 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.576569 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" event={"ID":"c92079f2-6ca8-4000-b0b8-128ba9dccd98","Type":"ContainerDied","Data":"e545941ea75f7798f49abe5060df441ba66fc2756a9cc28008b8674b9786cfed"} Jul 15 13:29:24.576684 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.576646 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" event={"ID":"c92079f2-6ca8-4000-b0b8-128ba9dccd98","Type":"ContainerStarted","Data":"635e3bdc5638948aafb495e31e2d482ae42fc3540aa6c72d02fadf360f7bc26f"} Jul 15 13:29:24.578826 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.578795 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" event={"ID":"1cea0d8a-b836-4477-96b5-515bdde845d5","Type":"ContainerStarted","Data":"775e69afda9c5dfee19488f8ea902ea779ddf6f51c6e2d986ac5b15aa87d3f66"} Jul 15 13:29:24.580832 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.580777 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hg6dx" event={"ID":"1da889f2-18e0-4f9d-b932-38d83ef3bd43","Type":"ContainerStarted","Data":"d746bbc3589f21cd2e81f8336e5d627bbaa99c66f11457dbee2d118649912c0a"} Jul 15 13:29:24.582674 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.582650 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" event={"ID":"9ef73f53-13b9-430c-8456-3f7eaaab7fcb","Type":"ContainerStarted","Data":"bb53a4aa02d56d4c2bebf51029492bdb8106afc1fac9921d3b58e881bd05e025"} Jul 15 13:29:24.584404 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.584378 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8nchk" event={"ID":"96eceb11-871f-4522-a3c1-c2795c533360","Type":"ContainerStarted","Data":"f66467fa3a1ce8321d168219b7e5239b491d0583b50a4fd63fe0f7ec1e0a93f8"} Jul 15 13:29:24.585227 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.585177 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" podStartSLOduration=22.585160914 podStartE2EDuration="22.585160914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:29:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:29:04.543171062 +0000 UTC m=+4.662733085" watchObservedRunningTime="2026-07-15 13:29:24.585160914 +0000 UTC m=+24.704722934" Jul 15 13:29:24.585636 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.585576 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-45.ec2.internal" podStartSLOduration=22.585567025 podStartE2EDuration="22.585567025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:29:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:29:24.584249024 +0000 UTC m=+24.703811042" watchObservedRunningTime="2026-07-15 13:29:24.585567025 +0000 UTC m=+24.705129045" Jul 15 13:29:24.631729 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.631628 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hg6dx" podStartSLOduration=3.067622952 podStartE2EDuration="23.631589991s" totalImagesPullingTime="20.563967039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:29:24.631425685 +0000 UTC m=+24.750987703" watchObservedRunningTime="2026-07-15 13:29:24.631589991 +0000 UTC m=+24.751152010" Jul 15 13:29:24.651455 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.651404 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8khhd" podStartSLOduration=3.008256698 podStartE2EDuration="23.651389644s" totalImagesPullingTime="20.643132946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:29:24.650903671 +0000 UTC m=+24.770465690" watchObservedRunningTime="2026-07-15 13:29:24.651389644 +0000 UTC m=+24.770951663" Jul 15 13:29:24.669690 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.669635 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4zbrw" podStartSLOduration=3.127578882 podStartE2EDuration="23.669619373s" totalImagesPullingTime="20.542040491s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:29:24.66907236 +0000 UTC m=+24.788634379" watchObservedRunningTime="2026-07-15 13:29:24.669619373 +0000 UTC m=+24.789181384" Jul 15 13:29:24.689405 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.689354 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6zd8z" podStartSLOduration=3.125355413 podStartE2EDuration="23.68933868s" totalImagesPullingTime="20.563983267s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:29:24.689033592 +0000 UTC m=+24.808595612" watchObservedRunningTime="2026-07-15 13:29:24.68933868 +0000 UTC m=+24.808900699" Jul 15 13:29:24.714005 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:24.713950 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8nchk" podStartSLOduration=3.209374798 podStartE2EDuration="23.713935171s" totalImagesPullingTime="20.504560373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:29:24.712516503 +0000 UTC m=+24.832078516" watchObservedRunningTime="2026-07-15 13:29:24.713935171 +0000 UTC m=+24.833497190" Jul 15 13:29:25.072394 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:25.072360 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hg6dx" Jul 15 13:29:25.073144 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:25.073125 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hg6dx" Jul 15 13:29:25.232487 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:25.232455 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 13:29:25.416200 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:25.416103 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T13:29:25.232481896Z","UUID":"7604f286-58dc-4d3b-86c6-ab894368f616","Handler":null,"Name":"","Endpoint":""} Jul 15 13:29:25.417730 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:25.417709 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 13:29:25.417852 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:25.417745 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 13:29:25.473582 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:25.473495 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:25.474085 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:25.473652 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m8n2n" podUID="d3cd2f3c-8841-43bc-887c-c24ef412ea2f" Jul 15 13:29:25.588281 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:25.588234 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l2v2m" event={"ID":"0869c56d-e6bf-4183-a388-6ad52c497fef","Type":"ContainerStarted","Data":"b2753e3ce9b9c031f7e98cf69f476ccc273b27374601df497ba7f8bbfd6e6d00"} Jul 15 13:29:25.590316 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:25.590288 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" event={"ID":"1cea0d8a-b836-4477-96b5-515bdde845d5","Type":"ContainerStarted","Data":"0d1fbb5660ab97db47f3d43d4759c2be4c1ce45d3e5d52d04a57bbf088b9a3ac"} Jul 15 13:29:25.607777 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:25.607710 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l2v2m" podStartSLOduration=4.034453976 podStartE2EDuration="24.607687856s" totalImagesPullingTime="20.57323388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:29:25.607217672 +0000 UTC m=+25.726779692" watchObservedRunningTime="2026-07-15 13:29:25.607687856 +0000 UTC m=+25.727249878" Jul 15 13:29:26.472940 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:26.472894 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:26.473166 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:26.473055 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjdk" podUID="1d89f2fe-5910-4b03-afba-b491605dc56a" Jul 15 13:29:26.473582 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:26.472894 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:26.473715 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:26.473682 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7hsr" podUID="d024b3a4-a62c-4c57-adee-38378835c1c8" Jul 15 13:29:26.595070 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:26.595000 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 15 13:29:26.595258 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:26.595111 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" event={"ID":"1cea0d8a-b836-4477-96b5-515bdde845d5","Type":"ContainerStarted","Data":"6e690d19714cc8b8286057d5a91a6348ebf07570e81c28ec1c810f3d4b71cd1f"} Jul 15 13:29:27.472665 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:27.472624 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:27.472954 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:27.472763 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m8n2n" podUID="d3cd2f3c-8841-43bc-887c-c24ef412ea2f" Jul 15 13:29:27.600630 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:27.600587 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkf79_c92079f2-6ca8-4000-b0b8-128ba9dccd98/ovn-acl-logging/0.log" Jul 15 13:29:27.601093 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:27.601065 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" event={"ID":"c92079f2-6ca8-4000-b0b8-128ba9dccd98","Type":"ContainerStarted","Data":"c3ec3d4f8d568a7b3a0ad11c781ac8bf92333bdb803bc6cf5ef2c406520142d4"} Jul 15 13:29:28.473483 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:28.473296 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:28.473680 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:28.473320 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:28.473680 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:28.473577 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7hsr" podUID="d024b3a4-a62c-4c57-adee-38378835c1c8" Jul 15 13:29:28.473783 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:28.473677 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjdk" podUID="1d89f2fe-5910-4b03-afba-b491605dc56a" Jul 15 13:29:28.618793 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:28.618754 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hg6dx" Jul 15 13:29:28.619251 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:28.618901 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 15 13:29:28.619436 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:28.619404 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hg6dx" Jul 15 13:29:28.638137 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:28.638075 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czhsd" podStartSLOduration=4.763924598 podStartE2EDuration="27.63805618s" totalImagesPullingTime="22.874131582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:29:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:29:26.619650536 +0000 UTC m=+26.739212556" watchObservedRunningTime="2026-07-15 13:29:28.63805618 +0000 UTC m=+28.757618273" Jul 15 13:29:29.473281 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:29.473238 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:29.473469 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:29.473342 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m8n2n" podUID="d3cd2f3c-8841-43bc-887c-c24ef412ea2f" Jul 15 13:29:29.607648 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:29.607595 2558 generic.go:356] "Generic (PLEG): container finished" podID="f4b463d4-4fda-4a24-8ee4-c6a14089e80b" containerID="b9b8cc7ac7959e8989c603a4c01f2e14305a35d7ba3c644230f496e50576ff96" exitCode=0 Jul 15 13:29:29.611097 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:29.607977 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lcdbd" event={"ID":"f4b463d4-4fda-4a24-8ee4-c6a14089e80b","Type":"ContainerDied","Data":"b9b8cc7ac7959e8989c603a4c01f2e14305a35d7ba3c644230f496e50576ff96"} Jul 15 13:29:29.615211 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:29.615190 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkf79_c92079f2-6ca8-4000-b0b8-128ba9dccd98/ovn-acl-logging/0.log" Jul 15 13:29:29.615587 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:29.615552 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" event={"ID":"c92079f2-6ca8-4000-b0b8-128ba9dccd98","Type":"ContainerStarted","Data":"5ca1e149f42b55b5e9ee79852a81f7f944bff2ab469cff7d73ec321a56ffda14"} Jul 15 13:29:29.616098 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:29.616083 2558 scope.go:117] "RemoveContainer" containerID="e545941ea75f7798f49abe5060df441ba66fc2756a9cc28008b8674b9786cfed" Jul 15 13:29:30.474515 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:30.474478 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:30.475297 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:30.474638 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:30.475297 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:30.474657 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjdk" podUID="1d89f2fe-5910-4b03-afba-b491605dc56a" Jul 15 13:29:30.475297 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:30.474721 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7hsr" podUID="d024b3a4-a62c-4c57-adee-38378835c1c8" Jul 15 13:29:30.621993 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:30.621966 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkf79_c92079f2-6ca8-4000-b0b8-128ba9dccd98/ovn-acl-logging/0.log" Jul 15 13:29:30.622325 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:30.622300 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" event={"ID":"c92079f2-6ca8-4000-b0b8-128ba9dccd98","Type":"ContainerStarted","Data":"c97e16d004e53fbdf78a7e4cbcd4c2c10c5629898c16620922b044f0f98d3952"} Jul 15 13:29:30.622538 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:30.622521 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:30.622637 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:30.622618 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:30.622695 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:30.622670 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:30.638649 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:30.638591 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:30.638975 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:30.638960 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:29:30.655208 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:30.655138 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" podStartSLOduration=9.062946575 podStartE2EDuration="29.655113761s" totalImagesPullingTime="20.592167186s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:29:30.652916042 +0000 UTC m=+30.772478330" watchObservedRunningTime="2026-07-15 13:29:30.655113761 +0000 UTC m=+30.774675782" Jul 15 13:29:31.042279 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:31.042184 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m8n2n"] Jul 15 13:29:31.042425 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:31.042343 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:31.042479 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:31.042435 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m8n2n" podUID="d3cd2f3c-8841-43bc-887c-c24ef412ea2f" Jul 15 13:29:31.042793 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:31.042768 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sbjdk"] Jul 15 13:29:31.042892 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:31.042881 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:31.043006 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:31.042986 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjdk" podUID="1d89f2fe-5910-4b03-afba-b491605dc56a" Jul 15 13:29:31.043407 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:31.043385 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d7hsr"] Jul 15 13:29:31.043491 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:31.043478 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:31.043595 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:31.043571 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7hsr" podUID="d024b3a4-a62c-4c57-adee-38378835c1c8" Jul 15 13:29:31.626710 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:31.626671 2558 generic.go:356] "Generic (PLEG): container finished" podID="f4b463d4-4fda-4a24-8ee4-c6a14089e80b" containerID="fbff2cfefaa935a5c46763b9a1dc7965301de9db03ea588cb2ddb53c0f93ed01" exitCode=0 Jul 15 13:29:31.627191 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:31.626764 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lcdbd" event={"ID":"f4b463d4-4fda-4a24-8ee4-c6a14089e80b","Type":"ContainerDied","Data":"fbff2cfefaa935a5c46763b9a1dc7965301de9db03ea588cb2ddb53c0f93ed01"} Jul 15 13:29:32.473173 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:32.473124 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:32.473374 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:32.473124 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:32.473374 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:32.473258 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:32.473374 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:32.473275 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjdk" podUID="1d89f2fe-5910-4b03-afba-b491605dc56a" Jul 15 13:29:32.473535 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:32.473374 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m8n2n" podUID="d3cd2f3c-8841-43bc-887c-c24ef412ea2f" Jul 15 13:29:32.473535 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:32.473466 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7hsr" podUID="d024b3a4-a62c-4c57-adee-38378835c1c8" Jul 15 13:29:33.633392 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:33.633353 2558 generic.go:356] "Generic (PLEG): container finished" podID="f4b463d4-4fda-4a24-8ee4-c6a14089e80b" containerID="b1e8d4890b3f4c8fec550a1bdd2196bd5ccaaf806e4a1eba98571a1e98f28586" exitCode=0 Jul 15 13:29:33.633791 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:33.633417 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lcdbd" event={"ID":"f4b463d4-4fda-4a24-8ee4-c6a14089e80b","Type":"ContainerDied","Data":"b1e8d4890b3f4c8fec550a1bdd2196bd5ccaaf806e4a1eba98571a1e98f28586"} Jul 15 13:29:34.186386 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:34.186345 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d024b3a4-a62c-4c57-adee-38378835c1c8-original-pull-secret\") pod \"global-pull-secret-syncer-d7hsr\" (UID: \"d024b3a4-a62c-4c57-adee-38378835c1c8\") " pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:34.186565 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:34.186394 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d89f2fe-5910-4b03-afba-b491605dc56a-metrics-certs\") pod \"network-metrics-daemon-sbjdk\" (UID: \"1d89f2fe-5910-4b03-afba-b491605dc56a\") " pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:34.186565 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:34.186506 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:29:34.186565 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:34.186510 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:29:34.186565 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:34.186560 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d89f2fe-5910-4b03-afba-b491605dc56a-metrics-certs podName:1d89f2fe-5910-4b03-afba-b491605dc56a nodeName:}" failed. No retries permitted until 2026-07-15 13:30:06.186545189 +0000 UTC m=+66.306107186 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d89f2fe-5910-4b03-afba-b491605dc56a-metrics-certs") pod "network-metrics-daemon-sbjdk" (UID: "1d89f2fe-5910-4b03-afba-b491605dc56a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:29:34.186734 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:34.186573 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d024b3a4-a62c-4c57-adee-38378835c1c8-original-pull-secret podName:d024b3a4-a62c-4c57-adee-38378835c1c8 nodeName:}" failed. No retries permitted until 2026-07-15 13:30:06.186567453 +0000 UTC m=+66.306129451 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d024b3a4-a62c-4c57-adee-38378835c1c8-original-pull-secret") pod "global-pull-secret-syncer-d7hsr" (UID: "d024b3a4-a62c-4c57-adee-38378835c1c8") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:29:34.287481 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:34.287444 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhbnn\" (UniqueName: \"kubernetes.io/projected/d3cd2f3c-8841-43bc-887c-c24ef412ea2f-kube-api-access-hhbnn\") pod \"network-check-target-m8n2n\" (UID: \"d3cd2f3c-8841-43bc-887c-c24ef412ea2f\") " pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:34.287668 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:34.287632 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:29:34.287668 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:34.287655 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:29:34.287750 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:34.287672 2558 projected.go:196] Error preparing data for projected volume kube-api-access-hhbnn for pod openshift-network-diagnostics/network-check-target-m8n2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:29:34.287750 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:34.287726 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3cd2f3c-8841-43bc-887c-c24ef412ea2f-kube-api-access-hhbnn podName:d3cd2f3c-8841-43bc-887c-c24ef412ea2f nodeName:}" failed. No retries permitted until 2026-07-15 13:30:06.28771205 +0000 UTC m=+66.407274048 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhbnn" (UniqueName: "kubernetes.io/projected/d3cd2f3c-8841-43bc-887c-c24ef412ea2f-kube-api-access-hhbnn") pod "network-check-target-m8n2n" (UID: "d3cd2f3c-8841-43bc-887c-c24ef412ea2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:29:34.473345 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:34.473259 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:34.473511 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:34.473259 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:34.473511 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:34.473393 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7hsr" podUID="d024b3a4-a62c-4c57-adee-38378835c1c8" Jul 15 13:29:34.473511 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:34.473408 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:34.473679 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:34.473520 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m8n2n" podUID="d3cd2f3c-8841-43bc-887c-c24ef412ea2f" Jul 15 13:29:34.473679 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:34.473618 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjdk" podUID="1d89f2fe-5910-4b03-afba-b491605dc56a" Jul 15 13:29:36.473526 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:36.473491 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:36.474169 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:36.473491 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:36.474169 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:36.473623 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7hsr" podUID="d024b3a4-a62c-4c57-adee-38378835c1c8" Jul 15 13:29:36.474169 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:36.473501 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:36.474169 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:36.473714 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m8n2n" podUID="d3cd2f3c-8841-43bc-887c-c24ef412ea2f" Jul 15 13:29:36.474169 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:36.473823 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbjdk" podUID="1d89f2fe-5910-4b03-afba-b491605dc56a" Jul 15 13:29:37.658261 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.658026 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeReady" Jul 15 13:29:37.658730 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.658393 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 13:29:37.710036 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.710001 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64dcf47cf-w4dk6"] Jul 15 13:29:37.712823 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.712795 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:37.715761 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:37.715722 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"installation-pull-secrets\" is forbidden: User \"system:node:ip-10-0-129-45.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-129-45.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" type="*v1.Secret" Jul 15 13:29:37.715896 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:37.715830 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"image-registry-private-configuration\" is forbidden: User \"system:node:ip-10-0-129-45.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-129-45.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" type="*v1.Secret" Jul 15 13:29:37.717111 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:37.717068 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"image-registry-64dcf47cf-w4dk6\" is forbidden: User \"system:node:ip-10-0-129-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-129-45.ec2.internal' and this object" podUID="5443e2b6-551d-4366-85bf-e9ae5ec2d5af" pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:37.717275 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:37.717245 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"registry-dockercfg-t7cjq\" is forbidden: User \"system:node:ip-10-0-129-45.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-129-45.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-t7cjq\"" type="*v1.Secret" Jul 15 13:29:37.717365 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:37.717338 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"trusted-ca\" is forbidden: User \"system:node:ip-10-0-129-45.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-129-45.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" type="*v1.ConfigMap" Jul 15 13:29:37.724370 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.724352 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 15 13:29:37.748676 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.748641 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64dcf47cf-w4dk6"] Jul 15 13:29:37.754981 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.754786 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9wnm2"] Jul 15 13:29:37.756842 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.756811 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ztgmx"] Jul 15 13:29:37.756980 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.756962 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9wnm2" Jul 15 13:29:37.758874 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.758847 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z74z6"] Jul 15 13:29:37.758990 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.758959 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ztgmx" Jul 15 13:29:37.759884 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.759776 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-nvhjb\"" Jul 15 13:29:37.760875 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.760854 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-tm2dn"] Jul 15 13:29:37.761002 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.760981 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z74z6" Jul 15 13:29:37.761265 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.761232 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 15 13:29:37.762852 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.762804 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zz2vs"] Jul 15 13:29:37.763011 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.762967 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-tm2dn" Jul 15 13:29:37.763116 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.762997 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-g7d5r\"" Jul 15 13:29:37.764835 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.764810 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 15 13:29:37.764835 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.764825 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 13:29:37.764984 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.764872 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 15 13:29:37.765121 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.765092 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 15 13:29:37.765190 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.765176 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 15 13:29:37.765247 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.765222 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rnzhl\"" Jul 15 13:29:37.765463 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.765417 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 15 13:29:37.765529 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.765484 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 13:29:37.765529 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.765523 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 13:29:37.765989 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.765973 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 13:29:37.766375 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.766356 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 15 13:29:37.766557 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.766363 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 15 13:29:37.766650 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.766557 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 15 13:29:37.766965 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.766945 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 15 13:29:37.767805 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.767787 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xdmhg"] Jul 15 13:29:37.767909 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.767893 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zz2vs" Jul 15 13:29:37.767977 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.767945 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-zx4dv\"" Jul 15 13:29:37.770705 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.770656 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-746cbcdcd6-c9gwl"] Jul 15 13:29:37.770800 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.770782 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xdmhg" Jul 15 13:29:37.772503 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.772486 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-8ngk4"] Jul 15 13:29:37.772997 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.772612 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:29:37.780378 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.780346 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-sg5nj"] Jul 15 13:29:37.780758 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.780708 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" Jul 15 13:29:37.781410 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.781388 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 15 13:29:37.781971 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.781949 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 15 13:29:37.782353 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.782333 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 15 13:29:37.782515 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.782495 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-jgd8l\"" Jul 15 13:29:37.782682 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.782663 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 15 13:29:37.782856 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.782836 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 15 13:29:37.782990 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.782909 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 13:29:37.783061 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.783041 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 15 13:29:37.783125 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.783061 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-cfpzs\"" Jul 15 13:29:37.783275 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.783256 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 15 13:29:37.783382 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.783281 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 15 13:29:37.783503 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.783485 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9wnm2"] Jul 15 13:29:37.783631 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.783580 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-sg5nj" Jul 15 13:29:37.783735 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.783697 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r8c7f"] Jul 15 13:29:37.784422 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.784141 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 13:29:37.784422 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.784306 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pkw7w\"" Jul 15 13:29:37.787915 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.785818 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 15 13:29:37.787915 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.787514 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-d8klx"] Jul 15 13:29:37.788034 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.787938 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r8c7f" Jul 15 13:29:37.791317 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.790824 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-d8klx" Jul 15 13:29:37.792176 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.792158 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 13:29:37.792625 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.792589 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 13:29:37.793981 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.792740 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 15 13:29:37.793981 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.792731 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zz2vs"] Jul 15 13:29:37.793981 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.792660 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qvx6p\"" Jul 15 13:29:37.793981 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.793968 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 15 13:29:37.794312 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.794169 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 15 13:29:37.794312 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.794292 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 13:29:37.794411 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.794322 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 15 13:29:37.794462 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.794448 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 13:29:37.794462 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.794457 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 13:29:37.794695 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.794669 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 13:29:37.794860 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.794844 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-l25kl\"" Jul 15 13:29:37.794976 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.794956 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-87nh2\"" Jul 15 13:29:37.795124 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.795105 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 15 13:29:37.795124 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.794886 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 15 13:29:37.795424 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.795407 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z74z6"] Jul 15 13:29:37.795891 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.795838 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-tm2dn"] Jul 15 13:29:37.796005 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.795990 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 15 13:29:37.796903 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.796859 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 13:29:37.797008 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.796977 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-bt4d4\"" Jul 15 13:29:37.797107 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.797090 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-8ngk4"] Jul 15 13:29:37.798427 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.798408 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-746cbcdcd6-c9gwl"] Jul 15 13:29:37.799394 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.799377 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ztgmx"] Jul 15 13:29:37.800314 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.800295 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 15 13:29:37.802448 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.802430 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-d8klx"] Jul 15 13:29:37.807817 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.807790 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xdmhg"] Jul 15 13:29:37.811726 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.811701 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zm8t\" (UniqueName: \"kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-kube-api-access-2zm8t\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:37.811840 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.811747 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-image-registry-private-configuration\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:37.811840 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.811785 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-certificates\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:37.812000 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.811876 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-tls\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:37.812000 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.811916 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-installation-pull-secrets\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:37.812000 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.811968 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-bound-sa-token\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:37.812202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.812001 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-ca-trust-extracted\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:37.812202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.812036 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-trusted-ca\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:37.814350 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.814325 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-sg5nj"] Jul 15 13:29:37.826530 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.826505 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r8c7f"] Jul 15 13:29:37.912542 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.912451 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-tmp-dir\") pod \"dns-default-z74z6\" (UID: \"801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e\") " pod="openshift-dns/dns-default-z74z6" Jul 15 13:29:37.912759 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.912621 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7f487faf-49a3-4d67-b8a8-faa39c44c625-snapshots\") pod \"insights-operator-68d9dd94cf-8ngk4\" (UID: \"7f487faf-49a3-4d67-b8a8-faa39c44c625\") " pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" Jul 15 13:29:37.912759 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.912680 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/255bd244-111e-4dd9-9074-ca2adf2b6a3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ztgmx\" (UID: \"255bd244-111e-4dd9-9074-ca2adf2b6a3d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ztgmx" Jul 15 13:29:37.912759 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.912731 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-ca-trust-extracted\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:37.912994 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.912780 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d34ab343-03c6-4772-9fa4-048ee6de53b1-serving-cert\") pod \"service-ca-operator-7695fc6c8c-9wnm2\" (UID: \"d34ab343-03c6-4772-9fa4-048ee6de53b1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9wnm2" Jul 15 13:29:37.912994 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.912808 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f4547cb-8eca-4af6-b026-7d23aea2d5ca-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-xdmhg\" (UID: \"0f4547cb-8eca-4af6-b026-7d23aea2d5ca\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xdmhg" Jul 15 13:29:37.912994 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.912851 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-trusted-ca\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:37.912994 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.912878 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkcnm\" (UniqueName: \"kubernetes.io/projected/d34ab343-03c6-4772-9fa4-048ee6de53b1-kube-api-access-mkcnm\") pod \"service-ca-operator-7695fc6c8c-9wnm2\" (UID: \"d34ab343-03c6-4772-9fa4-048ee6de53b1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9wnm2" Jul 15 13:29:37.912994 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.912904 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xspxd\" (UniqueName: \"kubernetes.io/projected/255bd244-111e-4dd9-9074-ca2adf2b6a3d-kube-api-access-xspxd\") pod \"cluster-monitoring-operator-5f7f494dd4-ztgmx\" (UID: \"255bd244-111e-4dd9-9074-ca2adf2b6a3d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ztgmx" Jul 15 13:29:37.912994 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.912940 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-426c4\" (UniqueName: \"kubernetes.io/projected/91f5775e-2edc-4096-9ff3-73525544c0a6-kube-api-access-426c4\") pod \"network-check-source-869dcfcdcd-d8klx\" (UID: \"91f5775e-2edc-4096-9ff3-73525544c0a6\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-d8klx" Jul 15 13:29:37.912994 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.912984 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zm8t\" (UniqueName: \"kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-kube-api-access-2zm8t\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:37.913405 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913014 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ced5bb3-bad2-4fe7-8760-c870eb3c5295-cert\") pod \"ingress-canary-r8c7f\" (UID: \"7ced5bb3-bad2-4fe7-8760-c870eb3c5295\") " pod="openshift-ingress-canary/ingress-canary-r8c7f" Jul 15 13:29:37.913405 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913044 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f4547cb-8eca-4af6-b026-7d23aea2d5ca-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-xdmhg\" (UID: \"0f4547cb-8eca-4af6-b026-7d23aea2d5ca\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xdmhg" Jul 15 13:29:37.913405 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913074 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4njlv\" (UniqueName: \"kubernetes.io/projected/2272f6cf-e762-45d7-8a03-4b3445b51139-kube-api-access-4njlv\") pod \"volume-data-source-validator-78495597f6-zz2vs\" (UID: \"2272f6cf-e762-45d7-8a03-4b3445b51139\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zz2vs" Jul 15 13:29:37.913405 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913111 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-certificates\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:37.913405 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913135 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-installation-pull-secrets\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:37.913405 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913158 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a8a4c1b5-3f78-42c3-bcf4-0add73923644-trusted-ca\") pod \"console-operator-7866497494-tm2dn\" (UID: \"a8a4c1b5-3f78-42c3-bcf4-0add73923644\") " pod="openshift-console-operator/console-operator-7866497494-tm2dn" Jul 15 13:29:37.913405 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913188 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmrvn\" (UniqueName: \"kubernetes.io/projected/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-kube-api-access-qmrvn\") pod \"dns-default-z74z6\" (UID: \"801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e\") " pod="openshift-dns/dns-default-z74z6" Jul 15 13:29:37.913405 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913192 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-ca-trust-extracted\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:37.913405 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913218 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f487faf-49a3-4d67-b8a8-faa39c44c625-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-8ngk4\" (UID: \"7f487faf-49a3-4d67-b8a8-faa39c44c625\") " pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" Jul 15 13:29:37.913886 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913430 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a8a4c1b5-3f78-42c3-bcf4-0add73923644-config\") pod \"console-operator-7866497494-tm2dn\" (UID: \"a8a4c1b5-3f78-42c3-bcf4-0add73923644\") " pod="openshift-console-operator/console-operator-7866497494-tm2dn" Jul 15 13:29:37.913886 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913467 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d34ab343-03c6-4772-9fa4-048ee6de53b1-config\") pod \"service-ca-operator-7695fc6c8c-9wnm2\" (UID: \"d34ab343-03c6-4772-9fa4-048ee6de53b1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9wnm2" Jul 15 13:29:37.913886 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913492 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-service-ca-bundle\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:29:37.913886 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913547 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a8a4c1b5-3f78-42c3-bcf4-0add73923644-serving-cert\") pod \"console-operator-7866497494-tm2dn\" (UID: \"a8a4c1b5-3f78-42c3-bcf4-0add73923644\") " pod="openshift-console-operator/console-operator-7866497494-tm2dn" Jul 15 13:29:37.913886 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913647 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh2dn\" (UniqueName: \"kubernetes.io/projected/a8a4c1b5-3f78-42c3-bcf4-0add73923644-kube-api-access-nh2dn\") pod \"console-operator-7866497494-tm2dn\" (UID: \"a8a4c1b5-3f78-42c3-bcf4-0add73923644\") " pod="openshift-console-operator/console-operator-7866497494-tm2dn" Jul 15 13:29:37.913886 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913727 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-bound-sa-token\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:37.913886 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913772 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-metrics-certs\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:29:37.913886 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913799 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/255bd244-111e-4dd9-9074-ca2adf2b6a3d-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-ztgmx\" (UID: \"255bd244-111e-4dd9-9074-ca2adf2b6a3d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ztgmx" Jul 15 13:29:37.913886 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913821 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-certificates\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:37.913886 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913831 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnd95\" (UniqueName: \"kubernetes.io/projected/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-kube-api-access-fnd95\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:29:37.913886 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913858 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-config-volume\") pod \"dns-default-z74z6\" (UID: \"801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e\") " pod="openshift-dns/dns-default-z74z6" Jul 15 13:29:37.913886 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913882 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f487faf-49a3-4d67-b8a8-faa39c44c625-tmp\") pod \"insights-operator-68d9dd94cf-8ngk4\" (UID: \"7f487faf-49a3-4d67-b8a8-faa39c44c625\") " pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" Jul 15 13:29:37.914332 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913905 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f487faf-49a3-4d67-b8a8-faa39c44c625-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-8ngk4\" (UID: \"7f487faf-49a3-4d67-b8a8-faa39c44c625\") " pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" Jul 15 13:29:37.914332 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913929 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea0e04eb-0cbc-4672-8999-bd606cb426df-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-sg5nj\" (UID: \"ea0e04eb-0cbc-4672-8999-bd606cb426df\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-sg5nj" Jul 15 13:29:37.914332 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913958 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-image-registry-private-configuration\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:37.914332 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.913997 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-tls\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:37.914332 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.914022 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-default-certificate\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:29:37.914332 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.914050 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f487faf-49a3-4d67-b8a8-faa39c44c625-serving-cert\") pod \"insights-operator-68d9dd94cf-8ngk4\" (UID: \"7f487faf-49a3-4d67-b8a8-faa39c44c625\") " pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" Jul 15 13:29:37.914332 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.914078 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl9mt\" (UniqueName: \"kubernetes.io/projected/0f4547cb-8eca-4af6-b026-7d23aea2d5ca-kube-api-access-cl9mt\") pod \"kube-storage-version-migrator-operator-799cb7f958-xdmhg\" (UID: \"0f4547cb-8eca-4af6-b026-7d23aea2d5ca\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xdmhg" Jul 15 13:29:37.914332 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:37.914099 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 13:29:37.914332 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:37.914119 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64dcf47cf-w4dk6: secret "image-registry-tls" not found Jul 15 13:29:37.914332 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.914104 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw2wd\" (UniqueName: \"kubernetes.io/projected/7ced5bb3-bad2-4fe7-8760-c870eb3c5295-kube-api-access-fw2wd\") pod \"ingress-canary-r8c7f\" (UID: \"7ced5bb3-bad2-4fe7-8760-c870eb3c5295\") " pod="openshift-ingress-canary/ingress-canary-r8c7f" Jul 15 13:29:37.914332 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:37.914162 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-tls podName:5443e2b6-551d-4366-85bf-e9ae5ec2d5af nodeName:}" failed. No retries permitted until 2026-07-15 13:29:38.414145423 +0000 UTC m=+38.533707423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-tls") pod "image-registry-64dcf47cf-w4dk6" (UID: "5443e2b6-551d-4366-85bf-e9ae5ec2d5af") : secret "image-registry-tls" not found Jul 15 13:29:37.914332 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.914199 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-stats-auth\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:29:37.914332 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.914227 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r7cb\" (UniqueName: \"kubernetes.io/projected/7f487faf-49a3-4d67-b8a8-faa39c44c625-kube-api-access-6r7cb\") pod \"insights-operator-68d9dd94cf-8ngk4\" (UID: \"7f487faf-49a3-4d67-b8a8-faa39c44c625\") " pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" Jul 15 13:29:37.914332 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.914253 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-metrics-tls\") pod \"dns-default-z74z6\" (UID: \"801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e\") " pod="openshift-dns/dns-default-z74z6" Jul 15 13:29:37.914332 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.914276 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlxtt\" (UniqueName: \"kubernetes.io/projected/ea0e04eb-0cbc-4672-8999-bd606cb426df-kube-api-access-xlxtt\") pod \"cluster-samples-operator-65db858894-sg5nj\" (UID: \"ea0e04eb-0cbc-4672-8999-bd606cb426df\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-sg5nj" Jul 15 13:29:37.926353 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.926322 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-bound-sa-token\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:37.926530 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.926392 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zm8t\" (UniqueName: \"kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-kube-api-access-2zm8t\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:37.934134 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:37.934098 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg6dx_1da889f2-18e0-4f9d-b932-38d83ef3bd43/konnectivity-agent/0.log" limit=1024 Jul 15 13:29:38.015066 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015021 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f4547cb-8eca-4af6-b026-7d23aea2d5ca-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-xdmhg\" (UID: \"0f4547cb-8eca-4af6-b026-7d23aea2d5ca\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xdmhg" Jul 15 13:29:38.015066 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015066 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4njlv\" (UniqueName: \"kubernetes.io/projected/2272f6cf-e762-45d7-8a03-4b3445b51139-kube-api-access-4njlv\") pod \"volume-data-source-validator-78495597f6-zz2vs\" (UID: \"2272f6cf-e762-45d7-8a03-4b3445b51139\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zz2vs" Jul 15 13:29:38.015353 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015105 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a8a4c1b5-3f78-42c3-bcf4-0add73923644-trusted-ca\") pod \"console-operator-7866497494-tm2dn\" (UID: \"a8a4c1b5-3f78-42c3-bcf4-0add73923644\") " pod="openshift-console-operator/console-operator-7866497494-tm2dn" Jul 15 13:29:38.015353 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015130 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmrvn\" (UniqueName: \"kubernetes.io/projected/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-kube-api-access-qmrvn\") pod \"dns-default-z74z6\" (UID: \"801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e\") " pod="openshift-dns/dns-default-z74z6" Jul 15 13:29:38.015353 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015154 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f487faf-49a3-4d67-b8a8-faa39c44c625-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-8ngk4\" (UID: \"7f487faf-49a3-4d67-b8a8-faa39c44c625\") " pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" Jul 15 13:29:38.015353 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015176 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a8a4c1b5-3f78-42c3-bcf4-0add73923644-config\") pod \"console-operator-7866497494-tm2dn\" (UID: \"a8a4c1b5-3f78-42c3-bcf4-0add73923644\") " pod="openshift-console-operator/console-operator-7866497494-tm2dn" Jul 15 13:29:38.015353 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015202 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d34ab343-03c6-4772-9fa4-048ee6de53b1-config\") pod \"service-ca-operator-7695fc6c8c-9wnm2\" (UID: \"d34ab343-03c6-4772-9fa4-048ee6de53b1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9wnm2" Jul 15 13:29:38.015633 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015493 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-service-ca-bundle\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:29:38.015633 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015531 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a8a4c1b5-3f78-42c3-bcf4-0add73923644-serving-cert\") pod \"console-operator-7866497494-tm2dn\" (UID: \"a8a4c1b5-3f78-42c3-bcf4-0add73923644\") " pod="openshift-console-operator/console-operator-7866497494-tm2dn" Jul 15 13:29:38.015633 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015566 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh2dn\" (UniqueName: \"kubernetes.io/projected/a8a4c1b5-3f78-42c3-bcf4-0add73923644-kube-api-access-nh2dn\") pod \"console-operator-7866497494-tm2dn\" (UID: \"a8a4c1b5-3f78-42c3-bcf4-0add73923644\") " pod="openshift-console-operator/console-operator-7866497494-tm2dn" Jul 15 13:29:38.015633 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015586 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-metrics-certs\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:29:38.015633 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015627 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/255bd244-111e-4dd9-9074-ca2adf2b6a3d-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-ztgmx\" (UID: \"255bd244-111e-4dd9-9074-ca2adf2b6a3d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ztgmx" Jul 15 13:29:38.015893 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015653 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnd95\" (UniqueName: \"kubernetes.io/projected/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-kube-api-access-fnd95\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:29:38.015893 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015679 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-config-volume\") pod \"dns-default-z74z6\" (UID: \"801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e\") " pod="openshift-dns/dns-default-z74z6" Jul 15 13:29:38.015893 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015707 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f487faf-49a3-4d67-b8a8-faa39c44c625-tmp\") pod \"insights-operator-68d9dd94cf-8ngk4\" (UID: \"7f487faf-49a3-4d67-b8a8-faa39c44c625\") " pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" Jul 15 13:29:38.015893 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015735 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f487faf-49a3-4d67-b8a8-faa39c44c625-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-8ngk4\" (UID: \"7f487faf-49a3-4d67-b8a8-faa39c44c625\") " pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" Jul 15 13:29:38.015893 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015759 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea0e04eb-0cbc-4672-8999-bd606cb426df-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-sg5nj\" (UID: \"ea0e04eb-0cbc-4672-8999-bd606cb426df\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-sg5nj" Jul 15 13:29:38.015893 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015809 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-default-certificate\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:29:38.015893 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015833 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f487faf-49a3-4d67-b8a8-faa39c44c625-serving-cert\") pod \"insights-operator-68d9dd94cf-8ngk4\" (UID: \"7f487faf-49a3-4d67-b8a8-faa39c44c625\") " pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" Jul 15 13:29:38.015893 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015839 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f487faf-49a3-4d67-b8a8-faa39c44c625-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-8ngk4\" (UID: \"7f487faf-49a3-4d67-b8a8-faa39c44c625\") " pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" Jul 15 13:29:38.015893 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015857 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl9mt\" (UniqueName: \"kubernetes.io/projected/0f4547cb-8eca-4af6-b026-7d23aea2d5ca-kube-api-access-cl9mt\") pod \"kube-storage-version-migrator-operator-799cb7f958-xdmhg\" (UID: \"0f4547cb-8eca-4af6-b026-7d23aea2d5ca\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xdmhg" Jul 15 13:29:38.016366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015905 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw2wd\" (UniqueName: \"kubernetes.io/projected/7ced5bb3-bad2-4fe7-8760-c870eb3c5295-kube-api-access-fw2wd\") pod \"ingress-canary-r8c7f\" (UID: \"7ced5bb3-bad2-4fe7-8760-c870eb3c5295\") " pod="openshift-ingress-canary/ingress-canary-r8c7f" Jul 15 13:29:38.016366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015933 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-stats-auth\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:29:38.016366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015961 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r7cb\" (UniqueName: \"kubernetes.io/projected/7f487faf-49a3-4d67-b8a8-faa39c44c625-kube-api-access-6r7cb\") pod \"insights-operator-68d9dd94cf-8ngk4\" (UID: \"7f487faf-49a3-4d67-b8a8-faa39c44c625\") " pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" Jul 15 13:29:38.016366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015997 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-metrics-tls\") pod \"dns-default-z74z6\" (UID: \"801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e\") " pod="openshift-dns/dns-default-z74z6" Jul 15 13:29:38.016366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.016030 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlxtt\" (UniqueName: \"kubernetes.io/projected/ea0e04eb-0cbc-4672-8999-bd606cb426df-kube-api-access-xlxtt\") pod \"cluster-samples-operator-65db858894-sg5nj\" (UID: \"ea0e04eb-0cbc-4672-8999-bd606cb426df\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-sg5nj" Jul 15 13:29:38.016366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.016049 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a8a4c1b5-3f78-42c3-bcf4-0add73923644-trusted-ca\") pod \"console-operator-7866497494-tm2dn\" (UID: \"a8a4c1b5-3f78-42c3-bcf4-0add73923644\") " pod="openshift-console-operator/console-operator-7866497494-tm2dn" Jul 15 13:29:38.016366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.016053 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-tmp-dir\") pod \"dns-default-z74z6\" (UID: \"801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e\") " pod="openshift-dns/dns-default-z74z6" Jul 15 13:29:38.016366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.016187 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7f487faf-49a3-4d67-b8a8-faa39c44c625-snapshots\") pod \"insights-operator-68d9dd94cf-8ngk4\" (UID: \"7f487faf-49a3-4d67-b8a8-faa39c44c625\") " pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" Jul 15 13:29:38.016366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.016209 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/255bd244-111e-4dd9-9074-ca2adf2b6a3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ztgmx\" (UID: \"255bd244-111e-4dd9-9074-ca2adf2b6a3d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ztgmx" Jul 15 13:29:38.016366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.016229 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d34ab343-03c6-4772-9fa4-048ee6de53b1-serving-cert\") pod \"service-ca-operator-7695fc6c8c-9wnm2\" (UID: \"d34ab343-03c6-4772-9fa4-048ee6de53b1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9wnm2" Jul 15 13:29:38.016366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.016258 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f4547cb-8eca-4af6-b026-7d23aea2d5ca-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-xdmhg\" (UID: \"0f4547cb-8eca-4af6-b026-7d23aea2d5ca\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xdmhg" Jul 15 13:29:38.016366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.016287 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkcnm\" (UniqueName: \"kubernetes.io/projected/d34ab343-03c6-4772-9fa4-048ee6de53b1-kube-api-access-mkcnm\") pod \"service-ca-operator-7695fc6c8c-9wnm2\" (UID: \"d34ab343-03c6-4772-9fa4-048ee6de53b1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9wnm2" Jul 15 13:29:38.016366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.016306 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xspxd\" (UniqueName: \"kubernetes.io/projected/255bd244-111e-4dd9-9074-ca2adf2b6a3d-kube-api-access-xspxd\") pod \"cluster-monitoring-operator-5f7f494dd4-ztgmx\" (UID: \"255bd244-111e-4dd9-9074-ca2adf2b6a3d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ztgmx" Jul 15 13:29:38.016366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.016329 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-426c4\" (UniqueName: \"kubernetes.io/projected/91f5775e-2edc-4096-9ff3-73525544c0a6-kube-api-access-426c4\") pod \"network-check-source-869dcfcdcd-d8klx\" (UID: \"91f5775e-2edc-4096-9ff3-73525544c0a6\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-d8klx" Jul 15 13:29:38.016366 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.016350 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-service-ca-bundle podName:bc8b8f82-5a61-4607-b901-9bb811dfe8bd nodeName:}" failed. No retries permitted until 2026-07-15 13:29:38.516329822 +0000 UTC m=+38.635891823 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-service-ca-bundle") pod "router-default-746cbcdcd6-c9gwl" (UID: "bc8b8f82-5a61-4607-b901-9bb811dfe8bd") : configmap references non-existent config key: service-ca.crt Jul 15 13:29:38.017155 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.016417 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ced5bb3-bad2-4fe7-8760-c870eb3c5295-cert\") pod \"ingress-canary-r8c7f\" (UID: \"7ced5bb3-bad2-4fe7-8760-c870eb3c5295\") " pod="openshift-ingress-canary/ingress-canary-r8c7f" Jul 15 13:29:38.017155 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.016451 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d34ab343-03c6-4772-9fa4-048ee6de53b1-config\") pod \"service-ca-operator-7695fc6c8c-9wnm2\" (UID: \"d34ab343-03c6-4772-9fa4-048ee6de53b1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9wnm2" Jul 15 13:29:38.017155 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.016541 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-config-volume\") pod \"dns-default-z74z6\" (UID: \"801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e\") " pod="openshift-dns/dns-default-z74z6" Jul 15 13:29:38.017155 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.015968 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a8a4c1b5-3f78-42c3-bcf4-0add73923644-config\") pod \"console-operator-7866497494-tm2dn\" (UID: \"a8a4c1b5-3f78-42c3-bcf4-0add73923644\") " pod="openshift-console-operator/console-operator-7866497494-tm2dn" Jul 15 13:29:38.017155 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.016655 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:29:38.017155 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.016684 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 13:29:38.017155 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.016708 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-metrics-tls podName:801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e nodeName:}" failed. No retries permitted until 2026-07-15 13:29:38.516693642 +0000 UTC m=+38.636255649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-metrics-tls") pod "dns-default-z74z6" (UID: "801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e") : secret "dns-default-metrics-tls" not found Jul 15 13:29:38.017155 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.016732 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-metrics-certs podName:bc8b8f82-5a61-4607-b901-9bb811dfe8bd nodeName:}" failed. No retries permitted until 2026-07-15 13:29:38.516718203 +0000 UTC m=+38.636280204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-metrics-certs") pod "router-default-746cbcdcd6-c9gwl" (UID: "bc8b8f82-5a61-4607-b901-9bb811dfe8bd") : secret "router-metrics-certs-default" not found Jul 15 13:29:38.017155 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.017091 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f4547cb-8eca-4af6-b026-7d23aea2d5ca-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-xdmhg\" (UID: \"0f4547cb-8eca-4af6-b026-7d23aea2d5ca\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xdmhg" Jul 15 13:29:38.017586 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.017201 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-tmp-dir\") pod \"dns-default-z74z6\" (UID: \"801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e\") " pod="openshift-dns/dns-default-z74z6" Jul 15 13:29:38.017586 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.017290 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 13:29:38.017586 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.017332 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/255bd244-111e-4dd9-9074-ca2adf2b6a3d-cluster-monitoring-operator-tls podName:255bd244-111e-4dd9-9074-ca2adf2b6a3d nodeName:}" failed. No retries permitted until 2026-07-15 13:29:38.51731924 +0000 UTC m=+38.636881243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/255bd244-111e-4dd9-9074-ca2adf2b6a3d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-ztgmx" (UID: "255bd244-111e-4dd9-9074-ca2adf2b6a3d") : secret "cluster-monitoring-operator-tls" not found Jul 15 13:29:38.017586 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.017380 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7f487faf-49a3-4d67-b8a8-faa39c44c625-snapshots\") pod \"insights-operator-68d9dd94cf-8ngk4\" (UID: \"7f487faf-49a3-4d67-b8a8-faa39c44c625\") " pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" Jul 15 13:29:38.017586 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.017402 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 13:29:38.017586 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.017440 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea0e04eb-0cbc-4672-8999-bd606cb426df-samples-operator-tls podName:ea0e04eb-0cbc-4672-8999-bd606cb426df nodeName:}" failed. No retries permitted until 2026-07-15 13:29:38.517429065 +0000 UTC m=+38.636991064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ea0e04eb-0cbc-4672-8999-bd606cb426df-samples-operator-tls") pod "cluster-samples-operator-65db858894-sg5nj" (UID: "ea0e04eb-0cbc-4672-8999-bd606cb426df") : secret "samples-operator-tls" not found Jul 15 13:29:38.017908 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.017656 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/255bd244-111e-4dd9-9074-ca2adf2b6a3d-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-ztgmx\" (UID: \"255bd244-111e-4dd9-9074-ca2adf2b6a3d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ztgmx" Jul 15 13:29:38.017908 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.017710 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f487faf-49a3-4d67-b8a8-faa39c44c625-tmp\") pod \"insights-operator-68d9dd94cf-8ngk4\" (UID: \"7f487faf-49a3-4d67-b8a8-faa39c44c625\") " pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" Jul 15 13:29:38.019031 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.018977 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f4547cb-8eca-4af6-b026-7d23aea2d5ca-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-xdmhg\" (UID: \"0f4547cb-8eca-4af6-b026-7d23aea2d5ca\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xdmhg" Jul 15 13:29:38.019334 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.019311 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f487faf-49a3-4d67-b8a8-faa39c44c625-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-8ngk4\" (UID: \"7f487faf-49a3-4d67-b8a8-faa39c44c625\") " pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" Jul 15 13:29:38.020007 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.019974 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-stats-auth\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:29:38.020007 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.019980 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ced5bb3-bad2-4fe7-8760-c870eb3c5295-cert\") pod \"ingress-canary-r8c7f\" (UID: \"7ced5bb3-bad2-4fe7-8760-c870eb3c5295\") " pod="openshift-ingress-canary/ingress-canary-r8c7f" Jul 15 13:29:38.020325 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.020306 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a8a4c1b5-3f78-42c3-bcf4-0add73923644-serving-cert\") pod \"console-operator-7866497494-tm2dn\" (UID: \"a8a4c1b5-3f78-42c3-bcf4-0add73923644\") " pod="openshift-console-operator/console-operator-7866497494-tm2dn" Jul 15 13:29:38.020865 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.020840 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f487faf-49a3-4d67-b8a8-faa39c44c625-serving-cert\") pod \"insights-operator-68d9dd94cf-8ngk4\" (UID: \"7f487faf-49a3-4d67-b8a8-faa39c44c625\") " pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" Jul 15 13:29:38.020971 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.020955 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-default-certificate\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:29:38.021342 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.021321 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d34ab343-03c6-4772-9fa4-048ee6de53b1-serving-cert\") pod \"service-ca-operator-7695fc6c8c-9wnm2\" (UID: \"d34ab343-03c6-4772-9fa4-048ee6de53b1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9wnm2" Jul 15 13:29:38.031789 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.031731 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4njlv\" (UniqueName: \"kubernetes.io/projected/2272f6cf-e762-45d7-8a03-4b3445b51139-kube-api-access-4njlv\") pod \"volume-data-source-validator-78495597f6-zz2vs\" (UID: \"2272f6cf-e762-45d7-8a03-4b3445b51139\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zz2vs" Jul 15 13:29:38.032996 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.032971 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmrvn\" (UniqueName: \"kubernetes.io/projected/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-kube-api-access-qmrvn\") pod \"dns-default-z74z6\" (UID: \"801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e\") " pod="openshift-dns/dns-default-z74z6" Jul 15 13:29:38.044962 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.044913 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkcnm\" (UniqueName: \"kubernetes.io/projected/d34ab343-03c6-4772-9fa4-048ee6de53b1-kube-api-access-mkcnm\") pod \"service-ca-operator-7695fc6c8c-9wnm2\" (UID: \"d34ab343-03c6-4772-9fa4-048ee6de53b1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9wnm2" Jul 15 13:29:38.047807 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.047744 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r7cb\" (UniqueName: \"kubernetes.io/projected/7f487faf-49a3-4d67-b8a8-faa39c44c625-kube-api-access-6r7cb\") pod \"insights-operator-68d9dd94cf-8ngk4\" (UID: \"7f487faf-49a3-4d67-b8a8-faa39c44c625\") " pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" Jul 15 13:29:38.047999 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.047837 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-426c4\" (UniqueName: \"kubernetes.io/projected/91f5775e-2edc-4096-9ff3-73525544c0a6-kube-api-access-426c4\") pod \"network-check-source-869dcfcdcd-d8klx\" (UID: \"91f5775e-2edc-4096-9ff3-73525544c0a6\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-d8klx" Jul 15 13:29:38.048730 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.048704 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl9mt\" (UniqueName: \"kubernetes.io/projected/0f4547cb-8eca-4af6-b026-7d23aea2d5ca-kube-api-access-cl9mt\") pod \"kube-storage-version-migrator-operator-799cb7f958-xdmhg\" (UID: \"0f4547cb-8eca-4af6-b026-7d23aea2d5ca\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xdmhg" Jul 15 13:29:38.048854 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.048710 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw2wd\" (UniqueName: \"kubernetes.io/projected/7ced5bb3-bad2-4fe7-8760-c870eb3c5295-kube-api-access-fw2wd\") pod \"ingress-canary-r8c7f\" (UID: \"7ced5bb3-bad2-4fe7-8760-c870eb3c5295\") " pod="openshift-ingress-canary/ingress-canary-r8c7f" Jul 15 13:29:38.049227 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.049197 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xspxd\" (UniqueName: \"kubernetes.io/projected/255bd244-111e-4dd9-9074-ca2adf2b6a3d-kube-api-access-xspxd\") pod \"cluster-monitoring-operator-5f7f494dd4-ztgmx\" (UID: \"255bd244-111e-4dd9-9074-ca2adf2b6a3d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ztgmx" Jul 15 13:29:38.049468 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.049444 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh2dn\" (UniqueName: \"kubernetes.io/projected/a8a4c1b5-3f78-42c3-bcf4-0add73923644-kube-api-access-nh2dn\") pod \"console-operator-7866497494-tm2dn\" (UID: \"a8a4c1b5-3f78-42c3-bcf4-0add73923644\") " pod="openshift-console-operator/console-operator-7866497494-tm2dn" Jul 15 13:29:38.049940 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.049921 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlxtt\" (UniqueName: \"kubernetes.io/projected/ea0e04eb-0cbc-4672-8999-bd606cb426df-kube-api-access-xlxtt\") pod \"cluster-samples-operator-65db858894-sg5nj\" (UID: \"ea0e04eb-0cbc-4672-8999-bd606cb426df\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-sg5nj" Jul 15 13:29:38.050121 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.050104 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnd95\" (UniqueName: \"kubernetes.io/projected/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-kube-api-access-fnd95\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:29:38.064738 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.064710 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg6dx_1da889f2-18e0-4f9d-b932-38d83ef3bd43/konnectivity-agent/0.log" limit=1024 Jul 15 13:29:38.069455 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.069423 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9wnm2" Jul 15 13:29:38.098155 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.098124 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-tm2dn" Jul 15 13:29:38.107717 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.107691 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zz2vs" Jul 15 13:29:38.114549 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.114518 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xdmhg" Jul 15 13:29:38.131491 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.131441 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" Jul 15 13:29:38.167535 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.165673 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r8c7f" Jul 15 13:29:38.171722 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.171292 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-d8klx" Jul 15 13:29:38.301746 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.299989 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9wnm2"] Jul 15 13:29:38.337694 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.337657 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zz2vs"] Jul 15 13:29:38.352776 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.351727 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-tm2dn"] Jul 15 13:29:38.356565 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.356515 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xdmhg"] Jul 15 13:29:38.362907 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:38.361343 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8a4c1b5_3f78_42c3_bcf4_0add73923644.slice/crio-4991230e7ef28c9f9dc081ae385a7efe2f423603202b077f177e053eec151cf6 WatchSource:0}: Error finding container 4991230e7ef28c9f9dc081ae385a7efe2f423603202b077f177e053eec151cf6: Status 404 returned error can't find the container with id 4991230e7ef28c9f9dc081ae385a7efe2f423603202b077f177e053eec151cf6 Jul 15 13:29:38.372970 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.372937 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-8ngk4"] Jul 15 13:29:38.420729 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.420705 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-tls\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:38.420889 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.420862 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 13:29:38.420889 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.420884 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64dcf47cf-w4dk6: secret "image-registry-tls" not found Jul 15 13:29:38.420955 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.420949 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-tls podName:5443e2b6-551d-4366-85bf-e9ae5ec2d5af nodeName:}" failed. No retries permitted until 2026-07-15 13:29:39.420933266 +0000 UTC m=+39.540495262 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-tls") pod "image-registry-64dcf47cf-w4dk6" (UID: "5443e2b6-551d-4366-85bf-e9ae5ec2d5af") : secret "image-registry-tls" not found Jul 15 13:29:38.424305 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.424286 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-d8klx"] Jul 15 13:29:38.433235 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.433215 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r8c7f"] Jul 15 13:29:38.463901 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:38.463857 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f487faf_49a3_4d67_b8a8_faa39c44c625.slice/crio-8e778bf3d460820334e0ed50ab70dc414d7639d4cffbbc0d8e13fcc35770f6e9 WatchSource:0}: Error finding container 8e778bf3d460820334e0ed50ab70dc414d7639d4cffbbc0d8e13fcc35770f6e9: Status 404 returned error can't find the container with id 8e778bf3d460820334e0ed50ab70dc414d7639d4cffbbc0d8e13fcc35770f6e9 Jul 15 13:29:38.464143 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:38.464125 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f4547cb_8eca_4af6_b026_7d23aea2d5ca.slice/crio-ba5ff64ce1d0d86602427cd85a56101972a5d0419fc8fe5e1e12bdff8dbb537e WatchSource:0}: Error finding container ba5ff64ce1d0d86602427cd85a56101972a5d0419fc8fe5e1e12bdff8dbb537e: Status 404 returned error can't find the container with id ba5ff64ce1d0d86602427cd85a56101972a5d0419fc8fe5e1e12bdff8dbb537e Jul 15 13:29:38.470455 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:38.470429 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ced5bb3_bad2_4fe7_8760_c870eb3c5295.slice/crio-dbfe6cad6e7d6e29495ee0852c155e34946432a357cdc65b49c65db251a0b689 WatchSource:0}: Error finding container dbfe6cad6e7d6e29495ee0852c155e34946432a357cdc65b49c65db251a0b689: Status 404 returned error can't find the container with id dbfe6cad6e7d6e29495ee0852c155e34946432a357cdc65b49c65db251a0b689 Jul 15 13:29:38.470665 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:38.470650 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91f5775e_2edc_4096_9ff3_73525544c0a6.slice/crio-d10d293785f76b1553d181b6003ca57449227d3ea082e805641760198e61fedc WatchSource:0}: Error finding container d10d293785f76b1553d181b6003ca57449227d3ea082e805641760198e61fedc: Status 404 returned error can't find the container with id d10d293785f76b1553d181b6003ca57449227d3ea082e805641760198e61fedc Jul 15 13:29:38.472775 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.472621 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:29:38.472775 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.472629 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:29:38.472775 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.472677 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:29:38.477378 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.477356 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 13:29:38.477849 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.477831 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rv6f8\"" Jul 15 13:29:38.478054 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.478035 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w89gv\"" Jul 15 13:29:38.478231 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.477894 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 13:29:38.521679 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.521641 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-metrics-tls\") pod \"dns-default-z74z6\" (UID: \"801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e\") " pod="openshift-dns/dns-default-z74z6" Jul 15 13:29:38.521679 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.521683 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/255bd244-111e-4dd9-9074-ca2adf2b6a3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ztgmx\" (UID: \"255bd244-111e-4dd9-9074-ca2adf2b6a3d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ztgmx" Jul 15 13:29:38.521926 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.521740 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-service-ca-bundle\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:29:38.521926 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.521768 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-metrics-certs\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:29:38.521926 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.521790 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea0e04eb-0cbc-4672-8999-bd606cb426df-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-sg5nj\" (UID: \"ea0e04eb-0cbc-4672-8999-bd606cb426df\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-sg5nj" Jul 15 13:29:38.521926 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.521814 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:29:38.521926 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.521881 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 13:29:38.521926 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.521903 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-metrics-tls podName:801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e nodeName:}" failed. No retries permitted until 2026-07-15 13:29:39.521881885 +0000 UTC m=+39.641443882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-metrics-tls") pod "dns-default-z74z6" (UID: "801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e") : secret "dns-default-metrics-tls" not found Jul 15 13:29:38.522191 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.521937 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 13:29:38.522191 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.521958 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/255bd244-111e-4dd9-9074-ca2adf2b6a3d-cluster-monitoring-operator-tls podName:255bd244-111e-4dd9-9074-ca2adf2b6a3d nodeName:}" failed. No retries permitted until 2026-07-15 13:29:39.521940631 +0000 UTC m=+39.641502647 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/255bd244-111e-4dd9-9074-ca2adf2b6a3d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-ztgmx" (UID: "255bd244-111e-4dd9-9074-ca2adf2b6a3d") : secret "cluster-monitoring-operator-tls" not found Jul 15 13:29:38.522191 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.521963 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 13:29:38.522191 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.522026 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-metrics-certs podName:bc8b8f82-5a61-4607-b901-9bb811dfe8bd nodeName:}" failed. No retries permitted until 2026-07-15 13:29:39.521999562 +0000 UTC m=+39.641561568 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-metrics-certs") pod "router-default-746cbcdcd6-c9gwl" (UID: "bc8b8f82-5a61-4607-b901-9bb811dfe8bd") : secret "router-metrics-certs-default" not found Jul 15 13:29:38.522191 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.522057 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-service-ca-bundle podName:bc8b8f82-5a61-4607-b901-9bb811dfe8bd nodeName:}" failed. No retries permitted until 2026-07-15 13:29:39.522038214 +0000 UTC m=+39.641600211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-service-ca-bundle") pod "router-default-746cbcdcd6-c9gwl" (UID: "bc8b8f82-5a61-4607-b901-9bb811dfe8bd") : configmap references non-existent config key: service-ca.crt Jul 15 13:29:38.522191 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.522085 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea0e04eb-0cbc-4672-8999-bd606cb426df-samples-operator-tls podName:ea0e04eb-0cbc-4672-8999-bd606cb426df nodeName:}" failed. No retries permitted until 2026-07-15 13:29:39.522071739 +0000 UTC m=+39.641633748 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ea0e04eb-0cbc-4672-8999-bd606cb426df-samples-operator-tls") pod "cluster-samples-operator-65db858894-sg5nj" (UID: "ea0e04eb-0cbc-4672-8999-bd606cb426df") : secret "samples-operator-tls" not found Jul 15 13:29:38.566931 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.566877 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 15 13:29:38.574657 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.574626 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-trusted-ca\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:38.647807 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.647769 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-d8klx" event={"ID":"91f5775e-2edc-4096-9ff3-73525544c0a6","Type":"ContainerStarted","Data":"d10d293785f76b1553d181b6003ca57449227d3ea082e805641760198e61fedc"} Jul 15 13:29:38.648822 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.648800 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r8c7f" event={"ID":"7ced5bb3-bad2-4fe7-8760-c870eb3c5295","Type":"ContainerStarted","Data":"dbfe6cad6e7d6e29495ee0852c155e34946432a357cdc65b49c65db251a0b689"} Jul 15 13:29:38.649989 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.649968 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-tm2dn" event={"ID":"a8a4c1b5-3f78-42c3-bcf4-0add73923644","Type":"ContainerStarted","Data":"4991230e7ef28c9f9dc081ae385a7efe2f423603202b077f177e053eec151cf6"} Jul 15 13:29:38.651067 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.651047 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" event={"ID":"7f487faf-49a3-4d67-b8a8-faa39c44c625","Type":"ContainerStarted","Data":"8e778bf3d460820334e0ed50ab70dc414d7639d4cffbbc0d8e13fcc35770f6e9"} Jul 15 13:29:38.653704 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.653681 2558 generic.go:356] "Generic (PLEG): container finished" podID="f4b463d4-4fda-4a24-8ee4-c6a14089e80b" containerID="348c5ce6efacf116dafda46a8009b945b4f745fd90b13ba4c4bde6dc9462630e" exitCode=0 Jul 15 13:29:38.653774 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.653761 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lcdbd" event={"ID":"f4b463d4-4fda-4a24-8ee4-c6a14089e80b","Type":"ContainerDied","Data":"348c5ce6efacf116dafda46a8009b945b4f745fd90b13ba4c4bde6dc9462630e"} Jul 15 13:29:38.654881 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.654851 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zz2vs" event={"ID":"2272f6cf-e762-45d7-8a03-4b3445b51139","Type":"ContainerStarted","Data":"00cf7f0993cbb4ee6e370040908d8a16cecd5014c46d437d2b70930e8e270b06"} Jul 15 13:29:38.656061 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.656018 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xdmhg" event={"ID":"0f4547cb-8eca-4af6-b026-7d23aea2d5ca","Type":"ContainerStarted","Data":"ba5ff64ce1d0d86602427cd85a56101972a5d0419fc8fe5e1e12bdff8dbb537e"} Jul 15 13:29:38.657254 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.657236 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9wnm2" event={"ID":"d34ab343-03c6-4772-9fa4-048ee6de53b1","Type":"ContainerStarted","Data":"8c7f9c1cd205b0c34cc4726c430beb9520a7ab7c2b87062e834a9cfba34ddf73"} Jul 15 13:29:38.725993 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:38.725970 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-t7cjq\"" Jul 15 13:29:38.913677 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.913633 2558 secret.go:189] Couldn't get secret openshift-image-registry/installation-pull-secrets: failed to sync secret cache: timed out waiting for the condition Jul 15 13:29:38.913880 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.913717 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-installation-pull-secrets podName:5443e2b6-551d-4366-85bf-e9ae5ec2d5af nodeName:}" failed. No retries permitted until 2026-07-15 13:29:39.413699691 +0000 UTC m=+39.533261691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "installation-pull-secrets" (UniqueName: "kubernetes.io/secret/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-installation-pull-secrets") pod "image-registry-64dcf47cf-w4dk6" (UID: "5443e2b6-551d-4366-85bf-e9ae5ec2d5af") : failed to sync secret cache: timed out waiting for the condition Jul 15 13:29:38.914756 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.914736 2558 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-private-configuration: failed to sync secret cache: timed out waiting for the condition Jul 15 13:29:38.914816 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:38.914807 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-image-registry-private-configuration podName:5443e2b6-551d-4366-85bf-e9ae5ec2d5af nodeName:}" failed. No retries permitted until 2026-07-15 13:29:39.414781932 +0000 UTC m=+39.534343947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "image-registry-private-configuration" (UniqueName: "kubernetes.io/secret/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-image-registry-private-configuration") pod "image-registry-64dcf47cf-w4dk6" (UID: "5443e2b6-551d-4366-85bf-e9ae5ec2d5af") : failed to sync secret cache: timed out waiting for the condition Jul 15 13:29:39.030794 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:39.030498 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 15 13:29:39.257393 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:39.257139 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 15 13:29:39.431755 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:39.431716 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-installation-pull-secrets\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:39.431950 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:39.431843 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-image-registry-private-configuration\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:39.431950 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:39.431881 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-tls\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:39.432092 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:39.432074 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 13:29:39.432141 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:39.432097 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64dcf47cf-w4dk6: secret "image-registry-tls" not found Jul 15 13:29:39.432190 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:39.432163 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-tls podName:5443e2b6-551d-4366-85bf-e9ae5ec2d5af nodeName:}" failed. No retries permitted until 2026-07-15 13:29:41.432143347 +0000 UTC m=+41.551705360 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-tls") pod "image-registry-64dcf47cf-w4dk6" (UID: "5443e2b6-551d-4366-85bf-e9ae5ec2d5af") : secret "image-registry-tls" not found Jul 15 13:29:39.438520 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:39.438441 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-image-registry-private-configuration\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:39.441287 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:39.441043 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-installation-pull-secrets\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:39.532424 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:39.532371 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/255bd244-111e-4dd9-9074-ca2adf2b6a3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ztgmx\" (UID: \"255bd244-111e-4dd9-9074-ca2adf2b6a3d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ztgmx" Jul 15 13:29:39.532626 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:39.532488 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-service-ca-bundle\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:29:39.532626 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:39.532533 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-metrics-certs\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:29:39.532626 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:39.532570 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea0e04eb-0cbc-4672-8999-bd606cb426df-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-sg5nj\" (UID: \"ea0e04eb-0cbc-4672-8999-bd606cb426df\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-sg5nj" Jul 15 13:29:39.532816 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:39.532648 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-metrics-tls\") pod \"dns-default-z74z6\" (UID: \"801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e\") " pod="openshift-dns/dns-default-z74z6" Jul 15 13:29:39.532816 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:39.532776 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:29:39.532921 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:39.532835 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-metrics-tls podName:801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e nodeName:}" failed. No retries permitted until 2026-07-15 13:29:41.532817282 +0000 UTC m=+41.652379281 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-metrics-tls") pod "dns-default-z74z6" (UID: "801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e") : secret "dns-default-metrics-tls" not found Jul 15 13:29:39.532921 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:39.532898 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 13:29:39.533034 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:39.532932 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/255bd244-111e-4dd9-9074-ca2adf2b6a3d-cluster-monitoring-operator-tls podName:255bd244-111e-4dd9-9074-ca2adf2b6a3d nodeName:}" failed. No retries permitted until 2026-07-15 13:29:41.532922286 +0000 UTC m=+41.652484285 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/255bd244-111e-4dd9-9074-ca2adf2b6a3d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-ztgmx" (UID: "255bd244-111e-4dd9-9074-ca2adf2b6a3d") : secret "cluster-monitoring-operator-tls" not found Jul 15 13:29:39.533034 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:39.533023 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-service-ca-bundle podName:bc8b8f82-5a61-4607-b901-9bb811dfe8bd nodeName:}" failed. No retries permitted until 2026-07-15 13:29:41.53301322 +0000 UTC m=+41.652575219 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-service-ca-bundle") pod "router-default-746cbcdcd6-c9gwl" (UID: "bc8b8f82-5a61-4607-b901-9bb811dfe8bd") : configmap references non-existent config key: service-ca.crt Jul 15 13:29:39.533142 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:39.533080 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 13:29:39.533142 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:39.533109 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-metrics-certs podName:bc8b8f82-5a61-4607-b901-9bb811dfe8bd nodeName:}" failed. No retries permitted until 2026-07-15 13:29:41.533099081 +0000 UTC m=+41.652661096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-metrics-certs") pod "router-default-746cbcdcd6-c9gwl" (UID: "bc8b8f82-5a61-4607-b901-9bb811dfe8bd") : secret "router-metrics-certs-default" not found Jul 15 13:29:39.533246 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:39.533180 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 13:29:39.533246 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:39.533213 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea0e04eb-0cbc-4672-8999-bd606cb426df-samples-operator-tls podName:ea0e04eb-0cbc-4672-8999-bd606cb426df nodeName:}" failed. No retries permitted until 2026-07-15 13:29:41.533202333 +0000 UTC m=+41.652764330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ea0e04eb-0cbc-4672-8999-bd606cb426df-samples-operator-tls") pod "cluster-samples-operator-65db858894-sg5nj" (UID: "ea0e04eb-0cbc-4672-8999-bd606cb426df") : secret "samples-operator-tls" not found Jul 15 13:29:39.667100 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:39.666211 2558 generic.go:356] "Generic (PLEG): container finished" podID="f4b463d4-4fda-4a24-8ee4-c6a14089e80b" containerID="59354477c06bb5d44be06801cd5f7eac733cff856fb5203b5c5eb2f77da4e4cc" exitCode=0 Jul 15 13:29:39.667100 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:39.666283 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lcdbd" event={"ID":"f4b463d4-4fda-4a24-8ee4-c6a14089e80b","Type":"ContainerDied","Data":"59354477c06bb5d44be06801cd5f7eac733cff856fb5203b5c5eb2f77da4e4cc"} Jul 15 13:29:40.678694 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:40.678185 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lcdbd" event={"ID":"f4b463d4-4fda-4a24-8ee4-c6a14089e80b","Type":"ContainerStarted","Data":"aedbe2a70dfa96bcd46d58c999bb5036d4c4a71966376c7335c3018d6a71f0cc"} Jul 15 13:29:40.712213 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:40.711804 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lcdbd" podStartSLOduration=7.794209381 podStartE2EDuration="39.711782916s" totalImagesPullingTime="31.917573535s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:29:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:29:40.710001718 +0000 UTC m=+40.829563740" watchObservedRunningTime="2026-07-15 13:29:40.711782916 +0000 UTC m=+40.831344936" Jul 15 13:29:41.456045 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:41.455844 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-tls\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:41.456045 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:41.456016 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 13:29:41.456045 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:41.456034 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64dcf47cf-w4dk6: secret "image-registry-tls" not found Jul 15 13:29:41.456340 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:41.456106 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-tls podName:5443e2b6-551d-4366-85bf-e9ae5ec2d5af nodeName:}" failed. No retries permitted until 2026-07-15 13:29:45.456083417 +0000 UTC m=+45.575645434 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-tls") pod "image-registry-64dcf47cf-w4dk6" (UID: "5443e2b6-551d-4366-85bf-e9ae5ec2d5af") : secret "image-registry-tls" not found Jul 15 13:29:41.556984 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:41.556945 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-metrics-certs\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:29:41.557197 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:41.557001 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea0e04eb-0cbc-4672-8999-bd606cb426df-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-sg5nj\" (UID: \"ea0e04eb-0cbc-4672-8999-bd606cb426df\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-sg5nj" Jul 15 13:29:41.557197 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:41.557065 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-metrics-tls\") pod \"dns-default-z74z6\" (UID: \"801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e\") " pod="openshift-dns/dns-default-z74z6" Jul 15 13:29:41.557197 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:41.557097 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/255bd244-111e-4dd9-9074-ca2adf2b6a3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ztgmx\" (UID: \"255bd244-111e-4dd9-9074-ca2adf2b6a3d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ztgmx" Jul 15 13:29:41.557197 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:41.557107 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 13:29:41.557197 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:41.557115 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 13:29:41.557197 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:41.557174 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea0e04eb-0cbc-4672-8999-bd606cb426df-samples-operator-tls podName:ea0e04eb-0cbc-4672-8999-bd606cb426df nodeName:}" failed. No retries permitted until 2026-07-15 13:29:45.557154965 +0000 UTC m=+45.676716974 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ea0e04eb-0cbc-4672-8999-bd606cb426df-samples-operator-tls") pod "cluster-samples-operator-65db858894-sg5nj" (UID: "ea0e04eb-0cbc-4672-8999-bd606cb426df") : secret "samples-operator-tls" not found Jul 15 13:29:41.557197 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:41.557201 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 13:29:41.557510 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:41.557217 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:29:41.557510 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:41.557239 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-metrics-certs podName:bc8b8f82-5a61-4607-b901-9bb811dfe8bd nodeName:}" failed. No retries permitted until 2026-07-15 13:29:45.557229344 +0000 UTC m=+45.676791344 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-metrics-certs") pod "router-default-746cbcdcd6-c9gwl" (UID: "bc8b8f82-5a61-4607-b901-9bb811dfe8bd") : secret "router-metrics-certs-default" not found Jul 15 13:29:41.557510 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:41.557256 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/255bd244-111e-4dd9-9074-ca2adf2b6a3d-cluster-monitoring-operator-tls podName:255bd244-111e-4dd9-9074-ca2adf2b6a3d nodeName:}" failed. No retries permitted until 2026-07-15 13:29:45.557248253 +0000 UTC m=+45.676810252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/255bd244-111e-4dd9-9074-ca2adf2b6a3d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-ztgmx" (UID: "255bd244-111e-4dd9-9074-ca2adf2b6a3d") : secret "cluster-monitoring-operator-tls" not found Jul 15 13:29:41.557510 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:41.557272 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-metrics-tls podName:801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e nodeName:}" failed. No retries permitted until 2026-07-15 13:29:45.557263863 +0000 UTC m=+45.676825860 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-metrics-tls") pod "dns-default-z74z6" (UID: "801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e") : secret "dns-default-metrics-tls" not found Jul 15 13:29:41.557510 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:41.557318 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-service-ca-bundle\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:29:41.557510 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:41.557435 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-service-ca-bundle podName:bc8b8f82-5a61-4607-b901-9bb811dfe8bd nodeName:}" failed. No retries permitted until 2026-07-15 13:29:45.557424897 +0000 UTC m=+45.676986894 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-service-ca-bundle") pod "router-default-746cbcdcd6-c9gwl" (UID: "bc8b8f82-5a61-4607-b901-9bb811dfe8bd") : configmap references non-existent config key: service-ca.crt Jul 15 13:29:45.493454 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:45.493404 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-tls\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:45.494050 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:45.493534 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 13:29:45.494050 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:45.493555 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64dcf47cf-w4dk6: secret "image-registry-tls" not found Jul 15 13:29:45.494050 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:45.493639 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-tls podName:5443e2b6-551d-4366-85bf-e9ae5ec2d5af nodeName:}" failed. No retries permitted until 2026-07-15 13:29:53.49362054 +0000 UTC m=+53.613182537 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-tls") pod "image-registry-64dcf47cf-w4dk6" (UID: "5443e2b6-551d-4366-85bf-e9ae5ec2d5af") : secret "image-registry-tls" not found Jul 15 13:29:45.594493 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:45.594453 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-service-ca-bundle\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:29:45.594691 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:45.594514 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-metrics-certs\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:29:45.594691 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:45.594552 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea0e04eb-0cbc-4672-8999-bd606cb426df-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-sg5nj\" (UID: \"ea0e04eb-0cbc-4672-8999-bd606cb426df\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-sg5nj" Jul 15 13:29:45.594691 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:45.594621 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-metrics-tls\") pod \"dns-default-z74z6\" (UID: \"801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e\") " pod="openshift-dns/dns-default-z74z6" Jul 15 13:29:45.594691 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:45.594654 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-service-ca-bundle podName:bc8b8f82-5a61-4607-b901-9bb811dfe8bd nodeName:}" failed. No retries permitted until 2026-07-15 13:29:53.594632424 +0000 UTC m=+53.714194433 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-service-ca-bundle") pod "router-default-746cbcdcd6-c9gwl" (UID: "bc8b8f82-5a61-4607-b901-9bb811dfe8bd") : configmap references non-existent config key: service-ca.crt Jul 15 13:29:45.594923 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:45.594697 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:29:45.594923 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:45.594697 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/255bd244-111e-4dd9-9074-ca2adf2b6a3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ztgmx\" (UID: \"255bd244-111e-4dd9-9074-ca2adf2b6a3d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ztgmx" Jul 15 13:29:45.594923 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:45.594708 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 13:29:45.594923 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:45.594653 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 13:29:45.594923 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:45.594755 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-metrics-certs podName:bc8b8f82-5a61-4607-b901-9bb811dfe8bd nodeName:}" failed. No retries permitted until 2026-07-15 13:29:53.594743667 +0000 UTC m=+53.714305677 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-metrics-certs") pod "router-default-746cbcdcd6-c9gwl" (UID: "bc8b8f82-5a61-4607-b901-9bb811dfe8bd") : secret "router-metrics-certs-default" not found Jul 15 13:29:45.594923 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:45.594786 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-metrics-tls podName:801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e nodeName:}" failed. No retries permitted until 2026-07-15 13:29:53.594767629 +0000 UTC m=+53.714329630 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-metrics-tls") pod "dns-default-z74z6" (UID: "801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e") : secret "dns-default-metrics-tls" not found Jul 15 13:29:45.594923 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:45.594797 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 13:29:45.594923 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:45.594811 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea0e04eb-0cbc-4672-8999-bd606cb426df-samples-operator-tls podName:ea0e04eb-0cbc-4672-8999-bd606cb426df nodeName:}" failed. No retries permitted until 2026-07-15 13:29:53.594801248 +0000 UTC m=+53.714363249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ea0e04eb-0cbc-4672-8999-bd606cb426df-samples-operator-tls") pod "cluster-samples-operator-65db858894-sg5nj" (UID: "ea0e04eb-0cbc-4672-8999-bd606cb426df") : secret "samples-operator-tls" not found Jul 15 13:29:45.594923 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:45.594841 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/255bd244-111e-4dd9-9074-ca2adf2b6a3d-cluster-monitoring-operator-tls podName:255bd244-111e-4dd9-9074-ca2adf2b6a3d nodeName:}" failed. No retries permitted until 2026-07-15 13:29:53.59483212 +0000 UTC m=+53.714394117 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/255bd244-111e-4dd9-9074-ca2adf2b6a3d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-ztgmx" (UID: "255bd244-111e-4dd9-9074-ca2adf2b6a3d") : secret "cluster-monitoring-operator-tls" not found Jul 15 13:29:46.628495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.627174 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-ctds2"] Jul 15 13:29:46.647418 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.647390 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-ctds2"] Jul 15 13:29:46.647523 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.647509 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-ctds2" Jul 15 13:29:46.652289 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.652254 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 15 13:29:46.652958 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.652526 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 15 13:29:46.654242 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.654217 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-z75bq\"" Jul 15 13:29:46.699094 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.698394 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" event={"ID":"7f487faf-49a3-4d67-b8a8-faa39c44c625","Type":"ContainerStarted","Data":"78de934ae88b1bedd9848cddc7b00026419a849f4a48d36f30fb0a0f1aed66a2"} Jul 15 13:29:46.701203 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.701163 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zz2vs" event={"ID":"2272f6cf-e762-45d7-8a03-4b3445b51139","Type":"ContainerStarted","Data":"48c795e940744e63d5127735ada8063bcc587d38c109aef8edc8111e7da0d4a4"} Jul 15 13:29:46.704894 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.704495 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/126f7ccc-57f1-4742-85d8-bb39f2d19c51-nginx-conf\") pod \"networking-console-plugin-6cf856758c-ctds2\" (UID: \"126f7ccc-57f1-4742-85d8-bb39f2d19c51\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-ctds2" Jul 15 13:29:46.704894 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.704613 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xdmhg" event={"ID":"0f4547cb-8eca-4af6-b026-7d23aea2d5ca","Type":"ContainerStarted","Data":"cec87466923e830eb4f5589152c83b9b26885481f968bd27052a0c2f7146cd04"} Jul 15 13:29:46.704894 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.704710 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/126f7ccc-57f1-4742-85d8-bb39f2d19c51-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-ctds2\" (UID: \"126f7ccc-57f1-4742-85d8-bb39f2d19c51\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-ctds2" Jul 15 13:29:46.707161 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.707126 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9wnm2" event={"ID":"d34ab343-03c6-4772-9fa4-048ee6de53b1","Type":"ContainerStarted","Data":"e2eefe58240e3ee42f1774e938d2ac8257ed0c0da56cd2b000c9bb228f1b6ebf"} Jul 15 13:29:46.708723 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.708695 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-d8klx" event={"ID":"91f5775e-2edc-4096-9ff3-73525544c0a6","Type":"ContainerStarted","Data":"81b1a8334a1e84d33805526a49decf3674194f6828aee23955d7455a312d5e48"} Jul 15 13:29:46.710649 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.710626 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r8c7f" event={"ID":"7ced5bb3-bad2-4fe7-8760-c870eb3c5295","Type":"ContainerStarted","Data":"9ce2c231449bf43366896c110db2303b9b440588d58212cf86ce61518e1ba23c"} Jul 15 13:29:46.713329 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.713309 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-tm2dn" event={"ID":"a8a4c1b5-3f78-42c3-bcf4-0add73923644","Type":"ContainerStarted","Data":"a4d4cb677c48200cce37a1a03128924edf2bb7631d7532c58738f489fea6a346"} Jul 15 13:29:46.713739 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.713703 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-tm2dn" Jul 15 13:29:46.715244 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.715219 2558 patch_prober.go:28] interesting pod/console-operator-7866497494-tm2dn container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.10:8443/readyz\": dial tcp 10.132.0.10:8443: connect: connection refused" start-of-body= Jul 15 13:29:46.715465 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.715410 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7866497494-tm2dn" podUID="a8a4c1b5-3f78-42c3-bcf4-0add73923644" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.10:8443/readyz\": dial tcp 10.132.0.10:8443: connect: connection refused" Jul 15 13:29:46.744450 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.744380 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" podStartSLOduration=7.747166477 podStartE2EDuration="15.744357867s" totalImagesPullingTime="7.99719139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:29:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:29:46.724046887 +0000 UTC m=+46.843608907" watchObservedRunningTime="2026-07-15 13:29:46.744357867 +0000 UTC m=+46.863919887" Jul 15 13:29:46.746023 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.745682 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9wnm2" podStartSLOduration=8.593267381 podStartE2EDuration="16.745668761s" totalImagesPullingTime="8.15240138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:29:46.744035347 +0000 UTC m=+46.863597368" watchObservedRunningTime="2026-07-15 13:29:46.745668761 +0000 UTC m=+46.865230782" Jul 15 13:29:46.783236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.783102 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-tm2dn" podStartSLOduration=7.683309891 podStartE2EDuration="15.783084426s" totalImagesPullingTime="8.099774535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:29:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:29:46.782712693 +0000 UTC m=+46.902274713" watchObservedRunningTime="2026-07-15 13:29:46.783084426 +0000 UTC m=+46.902646446" Jul 15 13:29:46.803694 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.803631 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-zz2vs" podStartSLOduration=8.694019526 podStartE2EDuration="16.803586995s" totalImagesPullingTime="8.109567469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:29:46.802261754 +0000 UTC m=+46.921823776" watchObservedRunningTime="2026-07-15 13:29:46.803586995 +0000 UTC m=+46.923148998" Jul 15 13:29:46.808653 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.805902 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/126f7ccc-57f1-4742-85d8-bb39f2d19c51-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-ctds2\" (UID: \"126f7ccc-57f1-4742-85d8-bb39f2d19c51\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-ctds2" Jul 15 13:29:46.808653 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.806028 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/126f7ccc-57f1-4742-85d8-bb39f2d19c51-nginx-conf\") pod \"networking-console-plugin-6cf856758c-ctds2\" (UID: \"126f7ccc-57f1-4742-85d8-bb39f2d19c51\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-ctds2" Jul 15 13:29:46.808653 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:46.807864 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 13:29:46.808653 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:46.807923 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/126f7ccc-57f1-4742-85d8-bb39f2d19c51-networking-console-plugin-cert podName:126f7ccc-57f1-4742-85d8-bb39f2d19c51 nodeName:}" failed. No retries permitted until 2026-07-15 13:29:47.307906108 +0000 UTC m=+47.427468110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/126f7ccc-57f1-4742-85d8-bb39f2d19c51-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-ctds2" (UID: "126f7ccc-57f1-4742-85d8-bb39f2d19c51") : secret "networking-console-plugin-cert" not found Jul 15 13:29:46.809198 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.809168 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/126f7ccc-57f1-4742-85d8-bb39f2d19c51-nginx-conf\") pod \"networking-console-plugin-6cf856758c-ctds2\" (UID: \"126f7ccc-57f1-4742-85d8-bb39f2d19c51\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-ctds2" Jul 15 13:29:46.830641 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.830062 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xdmhg" podStartSLOduration=7.82613911 podStartE2EDuration="15.830041103s" totalImagesPullingTime="8.003901993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:29:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:29:46.82909512 +0000 UTC m=+46.948657153" watchObservedRunningTime="2026-07-15 13:29:46.830041103 +0000 UTC m=+46.949603123" Jul 15 13:29:46.861828 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:46.861749 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-d8klx" podStartSLOduration=7.870716026 podStartE2EDuration="15.861724728s" totalImagesPullingTime="7.991008702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:29:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:29:46.857787761 +0000 UTC m=+46.977349782" watchObservedRunningTime="2026-07-15 13:29:46.861724728 +0000 UTC m=+46.981286751" Jul 15 13:29:47.310393 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:47.310354 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/126f7ccc-57f1-4742-85d8-bb39f2d19c51-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-ctds2\" (UID: \"126f7ccc-57f1-4742-85d8-bb39f2d19c51\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-ctds2" Jul 15 13:29:47.310580 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:47.310480 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 13:29:47.310580 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:47.310536 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/126f7ccc-57f1-4742-85d8-bb39f2d19c51-networking-console-plugin-cert podName:126f7ccc-57f1-4742-85d8-bb39f2d19c51 nodeName:}" failed. No retries permitted until 2026-07-15 13:29:48.310521539 +0000 UTC m=+48.430083535 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/126f7ccc-57f1-4742-85d8-bb39f2d19c51-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-ctds2" (UID: "126f7ccc-57f1-4742-85d8-bb39f2d19c51") : secret "networking-console-plugin-cert" not found Jul 15 13:29:47.718493 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:47.718468 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/0.log" Jul 15 13:29:47.718988 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:47.718508 2558 generic.go:356] "Generic (PLEG): container finished" podID="a8a4c1b5-3f78-42c3-bcf4-0add73923644" containerID="a4d4cb677c48200cce37a1a03128924edf2bb7631d7532c58738f489fea6a346" exitCode=255 Jul 15 13:29:47.718988 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:47.718638 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-tm2dn" event={"ID":"a8a4c1b5-3f78-42c3-bcf4-0add73923644","Type":"ContainerDied","Data":"a4d4cb677c48200cce37a1a03128924edf2bb7631d7532c58738f489fea6a346"} Jul 15 13:29:47.718988 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:47.718887 2558 scope.go:117] "RemoveContainer" containerID="a4d4cb677c48200cce37a1a03128924edf2bb7631d7532c58738f489fea6a346" Jul 15 13:29:47.906444 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:47.906385 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r8c7f" podStartSLOduration=2.915366122 podStartE2EDuration="10.906360547s" totalImagesPullingTime="7.990994425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:29:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:29:46.909967961 +0000 UTC m=+47.029529980" watchObservedRunningTime="2026-07-15 13:29:47.906360547 +0000 UTC m=+48.025922568" Jul 15 13:29:47.907183 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:47.907165 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tvbmk"] Jul 15 13:29:47.925865 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:47.925838 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:29:47.946935 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:47.946898 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 13:29:47.947178 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:47.947150 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 13:29:47.958615 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:47.958575 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vgfvj\"" Jul 15 13:29:47.979206 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:47.979122 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tvbmk"] Jul 15 13:29:48.018350 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.018308 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvbmk\" (UID: \"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0\") " pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:29:48.018531 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.018475 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjvlj\" (UniqueName: \"kubernetes.io/projected/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-kube-api-access-xjvlj\") pod \"insights-runtime-extractor-tvbmk\" (UID: \"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0\") " pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:29:48.018531 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.018512 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-data-volume\") pod \"insights-runtime-extractor-tvbmk\" (UID: \"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0\") " pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:29:48.018658 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.018567 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-crio-socket\") pod \"insights-runtime-extractor-tvbmk\" (UID: \"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0\") " pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:29:48.018709 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.018683 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvbmk\" (UID: \"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0\") " pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:29:48.098991 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.098954 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-tm2dn" Jul 15 13:29:48.119589 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.119547 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjvlj\" (UniqueName: \"kubernetes.io/projected/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-kube-api-access-xjvlj\") pod \"insights-runtime-extractor-tvbmk\" (UID: \"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0\") " pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:29:48.119783 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.119629 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-data-volume\") pod \"insights-runtime-extractor-tvbmk\" (UID: \"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0\") " pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:29:48.119783 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.119684 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-crio-socket\") pod \"insights-runtime-extractor-tvbmk\" (UID: \"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0\") " pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:29:48.119783 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.119737 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvbmk\" (UID: \"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0\") " pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:29:48.119960 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.119788 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvbmk\" (UID: \"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0\") " pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:29:48.119960 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:48.119863 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 13:29:48.119960 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:48.119932 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-kube-rbac-proxy-cm podName:d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0 nodeName:}" failed. No retries permitted until 2026-07-15 13:29:48.61991714 +0000 UTC m=+48.739479142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tvbmk" (UID: "d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0") : configmap "kube-rbac-proxy" not found Jul 15 13:29:48.119960 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.119858 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-crio-socket\") pod \"insights-runtime-extractor-tvbmk\" (UID: \"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0\") " pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:29:48.120124 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:48.119956 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 13:29:48.120124 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:48.120028 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-insights-runtime-extractor-tls podName:d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0 nodeName:}" failed. No retries permitted until 2026-07-15 13:29:48.620014044 +0000 UTC m=+48.739576056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvbmk" (UID: "d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0") : secret "insights-runtime-extractor-tls" not found Jul 15 13:29:48.120245 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.120224 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-data-volume\") pod \"insights-runtime-extractor-tvbmk\" (UID: \"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0\") " pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:29:48.151131 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.151088 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjvlj\" (UniqueName: \"kubernetes.io/projected/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-kube-api-access-xjvlj\") pod \"insights-runtime-extractor-tvbmk\" (UID: \"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0\") " pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:29:48.322373 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.322278 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/126f7ccc-57f1-4742-85d8-bb39f2d19c51-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-ctds2\" (UID: \"126f7ccc-57f1-4742-85d8-bb39f2d19c51\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-ctds2" Jul 15 13:29:48.322545 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:48.322414 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 13:29:48.322545 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:48.322520 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/126f7ccc-57f1-4742-85d8-bb39f2d19c51-networking-console-plugin-cert podName:126f7ccc-57f1-4742-85d8-bb39f2d19c51 nodeName:}" failed. No retries permitted until 2026-07-15 13:29:50.32250187 +0000 UTC m=+50.442063891 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/126f7ccc-57f1-4742-85d8-bb39f2d19c51-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-ctds2" (UID: "126f7ccc-57f1-4742-85d8-bb39f2d19c51") : secret "networking-console-plugin-cert" not found Jul 15 13:29:48.419617 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.419576 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rgn8x"] Jul 15 13:29:48.450364 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.450333 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rgn8x"] Jul 15 13:29:48.450519 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.450458 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rgn8x" Jul 15 13:29:48.453726 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.453704 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-x7846\"" Jul 15 13:29:48.453952 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.453939 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 15 13:29:48.454459 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.454448 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 15 13:29:48.525039 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.524993 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgfn5\" (UniqueName: \"kubernetes.io/projected/0ac1bef6-2398-4d82-879b-c438e5b04c3a-kube-api-access-hgfn5\") pod \"migrator-7f59b54f6c-rgn8x\" (UID: \"0ac1bef6-2398-4d82-879b-c438e5b04c3a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rgn8x" Jul 15 13:29:48.626146 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.626069 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgfn5\" (UniqueName: \"kubernetes.io/projected/0ac1bef6-2398-4d82-879b-c438e5b04c3a-kube-api-access-hgfn5\") pod \"migrator-7f59b54f6c-rgn8x\" (UID: \"0ac1bef6-2398-4d82-879b-c438e5b04c3a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rgn8x" Jul 15 13:29:48.626146 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.626118 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvbmk\" (UID: \"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0\") " pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:29:48.626338 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.626169 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvbmk\" (UID: \"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0\") " pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:29:48.626338 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:48.626273 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 13:29:48.626338 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:48.626304 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 13:29:48.626445 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:48.626340 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-kube-rbac-proxy-cm podName:d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0 nodeName:}" failed. No retries permitted until 2026-07-15 13:29:49.626323258 +0000 UTC m=+49.745885254 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tvbmk" (UID: "d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0") : configmap "kube-rbac-proxy" not found Jul 15 13:29:48.626445 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:48.626359 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-insights-runtime-extractor-tls podName:d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0 nodeName:}" failed. No retries permitted until 2026-07-15 13:29:49.626352987 +0000 UTC m=+49.745914983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvbmk" (UID: "d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0") : secret "insights-runtime-extractor-tls" not found Jul 15 13:29:48.641544 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.641506 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgfn5\" (UniqueName: \"kubernetes.io/projected/0ac1bef6-2398-4d82-879b-c438e5b04c3a-kube-api-access-hgfn5\") pod \"migrator-7f59b54f6c-rgn8x\" (UID: \"0ac1bef6-2398-4d82-879b-c438e5b04c3a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rgn8x" Jul 15 13:29:48.724544 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.724516 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/1.log" Jul 15 13:29:48.725009 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.724990 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/0.log" Jul 15 13:29:48.725075 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.725037 2558 generic.go:356] "Generic (PLEG): container finished" podID="a8a4c1b5-3f78-42c3-bcf4-0add73923644" containerID="17b36c749a212ecb5a9d595c4e44e816729d9bea26740e312e44aa9d05774a43" exitCode=255 Jul 15 13:29:48.725131 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.725085 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-tm2dn" event={"ID":"a8a4c1b5-3f78-42c3-bcf4-0add73923644","Type":"ContainerDied","Data":"17b36c749a212ecb5a9d595c4e44e816729d9bea26740e312e44aa9d05774a43"} Jul 15 13:29:48.725183 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.725145 2558 scope.go:117] "RemoveContainer" containerID="a4d4cb677c48200cce37a1a03128924edf2bb7631d7532c58738f489fea6a346" Jul 15 13:29:48.725325 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.725307 2558 scope.go:117] "RemoveContainer" containerID="17b36c749a212ecb5a9d595c4e44e816729d9bea26740e312e44aa9d05774a43" Jul 15 13:29:48.725544 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:48.725523 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-tm2dn_openshift-console-operator(a8a4c1b5-3f78-42c3-bcf4-0add73923644)\"" pod="openshift-console-operator/console-operator-7866497494-tm2dn" podUID="a8a4c1b5-3f78-42c3-bcf4-0add73923644" Jul 15 13:29:48.760493 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.760459 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rgn8x" Jul 15 13:29:48.920929 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.920906 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rgn8x"] Jul 15 13:29:48.922447 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:48.922426 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ac1bef6_2398_4d82_879b_c438e5b04c3a.slice/crio-b871d896709ce9fed683a6fbeaa633a2d7090ee73ab538d692a9f42a3fa89451 WatchSource:0}: Error finding container b871d896709ce9fed683a6fbeaa633a2d7090ee73ab538d692a9f42a3fa89451: Status 404 returned error can't find the container with id b871d896709ce9fed683a6fbeaa633a2d7090ee73ab538d692a9f42a3fa89451 Jul 15 13:29:48.974037 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:48.974011 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8nchk_96eceb11-871f-4522-a3c1-c2795c533360/dns-node-resolver/0.log" Jul 15 13:29:49.636617 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:49.636555 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvbmk\" (UID: \"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0\") " pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:29:49.636800 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:49.636650 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvbmk\" (UID: \"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0\") " pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:29:49.636800 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:49.636685 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 13:29:49.636800 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:49.636766 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-kube-rbac-proxy-cm podName:d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0 nodeName:}" failed. No retries permitted until 2026-07-15 13:29:51.636745239 +0000 UTC m=+51.756307248 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tvbmk" (UID: "d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0") : configmap "kube-rbac-proxy" not found Jul 15 13:29:49.636942 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:49.636858 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 13:29:49.636942 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:49.636930 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-insights-runtime-extractor-tls podName:d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0 nodeName:}" failed. No retries permitted until 2026-07-15 13:29:51.636910107 +0000 UTC m=+51.756472107 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvbmk" (UID: "d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0") : secret "insights-runtime-extractor-tls" not found Jul 15 13:29:49.730467 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:49.730435 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/1.log" Jul 15 13:29:49.730891 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:49.730865 2558 scope.go:117] "RemoveContainer" containerID="17b36c749a212ecb5a9d595c4e44e816729d9bea26740e312e44aa9d05774a43" Jul 15 13:29:49.731077 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:49.731048 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-tm2dn_openshift-console-operator(a8a4c1b5-3f78-42c3-bcf4-0add73923644)\"" pod="openshift-console-operator/console-operator-7866497494-tm2dn" podUID="a8a4c1b5-3f78-42c3-bcf4-0add73923644" Jul 15 13:29:49.732363 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:49.732331 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rgn8x" event={"ID":"0ac1bef6-2398-4d82-879b-c438e5b04c3a","Type":"ContainerStarted","Data":"b871d896709ce9fed683a6fbeaa633a2d7090ee73ab538d692a9f42a3fa89451"} Jul 15 13:29:49.971476 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:49.971448 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6zd8z_42a1082a-1cc4-4ca5-9291-9b5c86fcebfa/node-ca/0.log" Jul 15 13:29:50.342387 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:50.342298 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/126f7ccc-57f1-4742-85d8-bb39f2d19c51-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-ctds2\" (UID: \"126f7ccc-57f1-4742-85d8-bb39f2d19c51\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-ctds2" Jul 15 13:29:50.342532 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:50.342451 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 13:29:50.342532 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:50.342516 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/126f7ccc-57f1-4742-85d8-bb39f2d19c51-networking-console-plugin-cert podName:126f7ccc-57f1-4742-85d8-bb39f2d19c51 nodeName:}" failed. No retries permitted until 2026-07-15 13:29:54.342500981 +0000 UTC m=+54.462062977 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/126f7ccc-57f1-4742-85d8-bb39f2d19c51-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-ctds2" (UID: "126f7ccc-57f1-4742-85d8-bb39f2d19c51") : secret "networking-console-plugin-cert" not found Jul 15 13:29:50.736957 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:50.736926 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rgn8x" event={"ID":"0ac1bef6-2398-4d82-879b-c438e5b04c3a","Type":"ContainerStarted","Data":"6ca511873b6bbb1ff5ba8a045a45eeaf952d7ec51ade291ec221246b99301e1d"} Jul 15 13:29:50.740430 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:50.740402 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-mgjlr"] Jul 15 13:29:50.761776 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:50.761581 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-mgjlr"] Jul 15 13:29:50.761776 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:50.761706 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-mgjlr" Jul 15 13:29:50.767241 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:50.767217 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 15 13:29:50.768482 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:50.768432 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 15 13:29:50.768758 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:50.768448 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 15 13:29:50.768850 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:50.768522 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-x2rl2\"" Jul 15 13:29:50.768850 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:50.768531 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 15 13:29:50.772078 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:50.772050 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r8c7f_7ced5bb3-bad2-4fe7-8760-c870eb3c5295/serve-healthcheck-canary/0.log" Jul 15 13:29:50.847819 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:50.847781 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b6cc567b-9b70-430e-aca6-bb361809039e-signing-key\") pod \"service-ca-79f68b9f4f-mgjlr\" (UID: \"b6cc567b-9b70-430e-aca6-bb361809039e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mgjlr" Jul 15 13:29:50.847989 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:50.847837 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b6cc567b-9b70-430e-aca6-bb361809039e-signing-cabundle\") pod \"service-ca-79f68b9f4f-mgjlr\" (UID: \"b6cc567b-9b70-430e-aca6-bb361809039e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mgjlr" Jul 15 13:29:50.847989 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:50.847926 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz55m\" (UniqueName: \"kubernetes.io/projected/b6cc567b-9b70-430e-aca6-bb361809039e-kube-api-access-fz55m\") pod \"service-ca-79f68b9f4f-mgjlr\" (UID: \"b6cc567b-9b70-430e-aca6-bb361809039e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mgjlr" Jul 15 13:29:50.949268 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:50.949224 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz55m\" (UniqueName: \"kubernetes.io/projected/b6cc567b-9b70-430e-aca6-bb361809039e-kube-api-access-fz55m\") pod \"service-ca-79f68b9f4f-mgjlr\" (UID: \"b6cc567b-9b70-430e-aca6-bb361809039e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mgjlr" Jul 15 13:29:50.949442 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:50.949359 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b6cc567b-9b70-430e-aca6-bb361809039e-signing-key\") pod \"service-ca-79f68b9f4f-mgjlr\" (UID: \"b6cc567b-9b70-430e-aca6-bb361809039e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mgjlr" Jul 15 13:29:50.949442 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:50.949418 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b6cc567b-9b70-430e-aca6-bb361809039e-signing-cabundle\") pod \"service-ca-79f68b9f4f-mgjlr\" (UID: \"b6cc567b-9b70-430e-aca6-bb361809039e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mgjlr" Jul 15 13:29:50.950170 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:50.950151 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b6cc567b-9b70-430e-aca6-bb361809039e-signing-cabundle\") pod \"service-ca-79f68b9f4f-mgjlr\" (UID: \"b6cc567b-9b70-430e-aca6-bb361809039e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mgjlr" Jul 15 13:29:50.951874 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:50.951852 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b6cc567b-9b70-430e-aca6-bb361809039e-signing-key\") pod \"service-ca-79f68b9f4f-mgjlr\" (UID: \"b6cc567b-9b70-430e-aca6-bb361809039e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mgjlr" Jul 15 13:29:50.965423 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:50.961759 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz55m\" (UniqueName: \"kubernetes.io/projected/b6cc567b-9b70-430e-aca6-bb361809039e-kube-api-access-fz55m\") pod \"service-ca-79f68b9f4f-mgjlr\" (UID: \"b6cc567b-9b70-430e-aca6-bb361809039e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mgjlr" Jul 15 13:29:51.072560 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:51.072513 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-mgjlr" Jul 15 13:29:51.216280 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:51.216201 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-mgjlr"] Jul 15 13:29:51.219351 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:29:51.219322 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6cc567b_9b70_430e_aca6_bb361809039e.slice/crio-392c2328e6b79d9f07f876cd827bf51c190ca52705f9ade845eed520c53f88e0 WatchSource:0}: Error finding container 392c2328e6b79d9f07f876cd827bf51c190ca52705f9ade845eed520c53f88e0: Status 404 returned error can't find the container with id 392c2328e6b79d9f07f876cd827bf51c190ca52705f9ade845eed520c53f88e0 Jul 15 13:29:51.656189 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:51.656095 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvbmk\" (UID: \"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0\") " pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:29:51.656189 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:51.656158 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvbmk\" (UID: \"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0\") " pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:29:51.656372 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:51.656228 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 13:29:51.656372 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:51.656301 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-kube-rbac-proxy-cm podName:d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0 nodeName:}" failed. No retries permitted until 2026-07-15 13:29:55.656282961 +0000 UTC m=+55.775844962 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tvbmk" (UID: "d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0") : configmap "kube-rbac-proxy" not found Jul 15 13:29:51.656372 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:51.656337 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 13:29:51.656476 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:51.656412 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-insights-runtime-extractor-tls podName:d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0 nodeName:}" failed. No retries permitted until 2026-07-15 13:29:55.656396415 +0000 UTC m=+55.775958421 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvbmk" (UID: "d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0") : secret "insights-runtime-extractor-tls" not found Jul 15 13:29:51.742292 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:51.742255 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-mgjlr" event={"ID":"b6cc567b-9b70-430e-aca6-bb361809039e","Type":"ContainerStarted","Data":"ac2e2ab8cceeb6ab63f86352a5d67d2205d8653922e109fb9c82f5d6fc6c506f"} Jul 15 13:29:51.742823 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:51.742313 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-mgjlr" event={"ID":"b6cc567b-9b70-430e-aca6-bb361809039e","Type":"ContainerStarted","Data":"392c2328e6b79d9f07f876cd827bf51c190ca52705f9ade845eed520c53f88e0"} Jul 15 13:29:51.744083 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:51.744051 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rgn8x" event={"ID":"0ac1bef6-2398-4d82-879b-c438e5b04c3a","Type":"ContainerStarted","Data":"1829f00681dacaeb7993f4f7eca8e1f8b71aace160b64deca6187c699d321812"} Jul 15 13:29:51.760801 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:51.760754 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-mgjlr" podStartSLOduration=1.760737209 podStartE2EDuration="1.760737209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:29:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:29:51.759935784 +0000 UTC m=+51.879497803" watchObservedRunningTime="2026-07-15 13:29:51.760737209 +0000 UTC m=+51.880299229" Jul 15 13:29:51.778026 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:51.777973 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rgn8x" podStartSLOduration=2.131218211 podStartE2EDuration="3.777957361s" totalImagesPullingTime="1.64673915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:29:51.777219266 +0000 UTC m=+51.896781284" watchObservedRunningTime="2026-07-15 13:29:51.777957361 +0000 UTC m=+51.897519380" Jul 15 13:29:53.575884 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:53.575839 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-tls\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:29:53.576362 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:53.576017 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 13:29:53.576362 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:53.576042 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64dcf47cf-w4dk6: secret "image-registry-tls" not found Jul 15 13:29:53.576362 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:53.576105 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-tls podName:5443e2b6-551d-4366-85bf-e9ae5ec2d5af nodeName:}" failed. No retries permitted until 2026-07-15 13:30:09.576085985 +0000 UTC m=+69.695648001 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-tls") pod "image-registry-64dcf47cf-w4dk6" (UID: "5443e2b6-551d-4366-85bf-e9ae5ec2d5af") : secret "image-registry-tls" not found Jul 15 13:29:53.677658 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:53.677622 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-metrics-tls\") pod \"dns-default-z74z6\" (UID: \"801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e\") " pod="openshift-dns/dns-default-z74z6" Jul 15 13:29:53.677942 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:53.677678 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/255bd244-111e-4dd9-9074-ca2adf2b6a3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ztgmx\" (UID: \"255bd244-111e-4dd9-9074-ca2adf2b6a3d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ztgmx" Jul 15 13:29:53.677942 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:53.677777 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-service-ca-bundle\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:29:53.677942 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:53.677825 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:29:53.677942 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:53.677917 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-metrics-tls podName:801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e nodeName:}" failed. No retries permitted until 2026-07-15 13:30:09.677896891 +0000 UTC m=+69.797458891 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-metrics-tls") pod "dns-default-z74z6" (UID: "801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e") : secret "dns-default-metrics-tls" not found Jul 15 13:29:53.677942 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:53.677932 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 13:29:53.678188 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:53.677982 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-metrics-certs podName:bc8b8f82-5a61-4607-b901-9bb811dfe8bd nodeName:}" failed. No retries permitted until 2026-07-15 13:30:09.677967409 +0000 UTC m=+69.797529412 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-metrics-certs") pod "router-default-746cbcdcd6-c9gwl" (UID: "bc8b8f82-5a61-4607-b901-9bb811dfe8bd") : secret "router-metrics-certs-default" not found Jul 15 13:29:53.678188 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:53.678036 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 13:29:53.678188 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:53.678067 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/255bd244-111e-4dd9-9074-ca2adf2b6a3d-cluster-monitoring-operator-tls podName:255bd244-111e-4dd9-9074-ca2adf2b6a3d nodeName:}" failed. No retries permitted until 2026-07-15 13:30:09.678057425 +0000 UTC m=+69.797619425 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/255bd244-111e-4dd9-9074-ca2adf2b6a3d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-ztgmx" (UID: "255bd244-111e-4dd9-9074-ca2adf2b6a3d") : secret "cluster-monitoring-operator-tls" not found Jul 15 13:29:53.678188 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:53.678126 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-service-ca-bundle podName:bc8b8f82-5a61-4607-b901-9bb811dfe8bd nodeName:}" failed. No retries permitted until 2026-07-15 13:30:09.678116654 +0000 UTC m=+69.797678655 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-service-ca-bundle") pod "router-default-746cbcdcd6-c9gwl" (UID: "bc8b8f82-5a61-4607-b901-9bb811dfe8bd") : configmap references non-existent config key: service-ca.crt Jul 15 13:29:53.678188 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:53.677828 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-metrics-certs\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:29:53.678188 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:53.678180 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea0e04eb-0cbc-4672-8999-bd606cb426df-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-sg5nj\" (UID: \"ea0e04eb-0cbc-4672-8999-bd606cb426df\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-sg5nj" Jul 15 13:29:53.678482 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:53.678270 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 13:29:53.678482 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:53.678298 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea0e04eb-0cbc-4672-8999-bd606cb426df-samples-operator-tls podName:ea0e04eb-0cbc-4672-8999-bd606cb426df nodeName:}" failed. No retries permitted until 2026-07-15 13:30:09.678288656 +0000 UTC m=+69.797850654 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ea0e04eb-0cbc-4672-8999-bd606cb426df-samples-operator-tls") pod "cluster-samples-operator-65db858894-sg5nj" (UID: "ea0e04eb-0cbc-4672-8999-bd606cb426df") : secret "samples-operator-tls" not found Jul 15 13:29:54.385684 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:54.385641 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/126f7ccc-57f1-4742-85d8-bb39f2d19c51-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-ctds2\" (UID: \"126f7ccc-57f1-4742-85d8-bb39f2d19c51\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-ctds2" Jul 15 13:29:54.385846 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:54.385808 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 13:29:54.385910 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:54.385891 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/126f7ccc-57f1-4742-85d8-bb39f2d19c51-networking-console-plugin-cert podName:126f7ccc-57f1-4742-85d8-bb39f2d19c51 nodeName:}" failed. No retries permitted until 2026-07-15 13:30:02.385875099 +0000 UTC m=+62.505437099 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/126f7ccc-57f1-4742-85d8-bb39f2d19c51-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-ctds2" (UID: "126f7ccc-57f1-4742-85d8-bb39f2d19c51") : secret "networking-console-plugin-cert" not found Jul 15 13:29:55.697505 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:55.697463 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvbmk\" (UID: \"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0\") " pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:29:55.698013 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:55.697524 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvbmk\" (UID: \"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0\") " pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:29:55.698013 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:55.697709 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 13:29:55.698013 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:55.697781 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-insights-runtime-extractor-tls podName:d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0 nodeName:}" failed. No retries permitted until 2026-07-15 13:30:03.697761637 +0000 UTC m=+63.817323654 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvbmk" (UID: "d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0") : secret "insights-runtime-extractor-tls" not found Jul 15 13:29:55.698176 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:55.698096 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvbmk\" (UID: \"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0\") " pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:29:56.713948 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:56.713909 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-tm2dn" Jul 15 13:29:56.714419 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:56.714284 2558 scope.go:117] "RemoveContainer" containerID="17b36c749a212ecb5a9d595c4e44e816729d9bea26740e312e44aa9d05774a43" Jul 15 13:29:56.714484 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:29:56.714426 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-tm2dn_openshift-console-operator(a8a4c1b5-3f78-42c3-bcf4-0add73923644)\"" pod="openshift-console-operator/console-operator-7866497494-tm2dn" podUID="a8a4c1b5-3f78-42c3-bcf4-0add73923644" Jul 15 13:29:58.098527 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:58.098457 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-tm2dn" Jul 15 13:29:58.099136 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:58.098877 2558 scope.go:117] "RemoveContainer" containerID="17b36c749a212ecb5a9d595c4e44e816729d9bea26740e312e44aa9d05774a43" Jul 15 13:29:58.770220 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:58.770193 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/1.log" Jul 15 13:29:58.770414 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:58.770262 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-tm2dn" event={"ID":"a8a4c1b5-3f78-42c3-bcf4-0add73923644","Type":"ContainerStarted","Data":"1831b943c2a91f2747f4418566d9e781234b5c194348acba28f04f7d9108cf33"} Jul 15 13:29:58.770552 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:58.770533 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-tm2dn" Jul 15 13:29:58.776644 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:29:58.776613 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-tm2dn" Jul 15 13:30:02.466934 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:02.466890 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/126f7ccc-57f1-4742-85d8-bb39f2d19c51-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-ctds2\" (UID: \"126f7ccc-57f1-4742-85d8-bb39f2d19c51\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-ctds2" Jul 15 13:30:02.469438 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:02.469401 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/126f7ccc-57f1-4742-85d8-bb39f2d19c51-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-ctds2\" (UID: \"126f7ccc-57f1-4742-85d8-bb39f2d19c51\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-ctds2" Jul 15 13:30:02.567885 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:02.567855 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-z75bq\"" Jul 15 13:30:02.574588 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:02.574568 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-ctds2" Jul 15 13:30:02.661788 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:02.661752 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fkf79" Jul 15 13:30:02.761407 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:02.761328 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-ctds2"] Jul 15 13:30:02.764884 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:30:02.764852 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod126f7ccc_57f1_4742_85d8_bb39f2d19c51.slice/crio-64050c2af152d63b4e8c26bcbc9e27b57385749fe9489d58234c48ced821181a WatchSource:0}: Error finding container 64050c2af152d63b4e8c26bcbc9e27b57385749fe9489d58234c48ced821181a: Status 404 returned error can't find the container with id 64050c2af152d63b4e8c26bcbc9e27b57385749fe9489d58234c48ced821181a Jul 15 13:30:02.784857 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:02.784815 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-ctds2" event={"ID":"126f7ccc-57f1-4742-85d8-bb39f2d19c51","Type":"ContainerStarted","Data":"64050c2af152d63b4e8c26bcbc9e27b57385749fe9489d58234c48ced821181a"} Jul 15 13:30:03.778665 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:03.778620 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvbmk\" (UID: \"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0\") " pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:30:03.781244 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:03.781203 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvbmk\" (UID: \"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0\") " pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:30:03.867520 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:03.867483 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vgfvj\"" Jul 15 13:30:03.874415 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:03.874392 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tvbmk" Jul 15 13:30:04.037317 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:04.037231 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tvbmk"] Jul 15 13:30:04.283469 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:30:04.283436 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6daff2b_298b_4d7a_ba2d_a1a2ffb22ce0.slice/crio-ab0c160854561240de04a6def42c5b0373b2ee3164bb56080e251f185a526fce WatchSource:0}: Error finding container ab0c160854561240de04a6def42c5b0373b2ee3164bb56080e251f185a526fce: Status 404 returned error can't find the container with id ab0c160854561240de04a6def42c5b0373b2ee3164bb56080e251f185a526fce Jul 15 13:30:04.793236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:04.793200 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-ctds2" event={"ID":"126f7ccc-57f1-4742-85d8-bb39f2d19c51","Type":"ContainerStarted","Data":"a4604c991c978662ba27756b48500114df0468bb7ab44aed1c68cb23d0431fe5"} Jul 15 13:30:04.794470 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:04.794437 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tvbmk" event={"ID":"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0","Type":"ContainerStarted","Data":"ab0c160854561240de04a6def42c5b0373b2ee3164bb56080e251f185a526fce"} Jul 15 13:30:04.824377 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:04.824319 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-ctds2" podStartSLOduration=17.279626714 podStartE2EDuration="18.824302656s" totalImagesPullingTime="1.544675942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:29:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:30:04.823880507 +0000 UTC m=+64.943442525" watchObservedRunningTime="2026-07-15 13:30:04.824302656 +0000 UTC m=+64.943864674" Jul 15 13:30:06.201614 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:06.201571 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d024b3a4-a62c-4c57-adee-38378835c1c8-original-pull-secret\") pod \"global-pull-secret-syncer-d7hsr\" (UID: \"d024b3a4-a62c-4c57-adee-38378835c1c8\") " pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:30:06.202129 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:06.201629 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d89f2fe-5910-4b03-afba-b491605dc56a-metrics-certs\") pod \"network-metrics-daemon-sbjdk\" (UID: \"1d89f2fe-5910-4b03-afba-b491605dc56a\") " pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:30:06.207146 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:06.207123 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 13:30:06.209042 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:06.209011 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 13:30:06.214687 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:06.214658 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d89f2fe-5910-4b03-afba-b491605dc56a-metrics-certs\") pod \"network-metrics-daemon-sbjdk\" (UID: \"1d89f2fe-5910-4b03-afba-b491605dc56a\") " pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:30:06.214809 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:06.214656 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d024b3a4-a62c-4c57-adee-38378835c1c8-original-pull-secret\") pod \"global-pull-secret-syncer-d7hsr\" (UID: \"d024b3a4-a62c-4c57-adee-38378835c1c8\") " pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:30:06.302837 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:06.302804 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhbnn\" (UniqueName: \"kubernetes.io/projected/d3cd2f3c-8841-43bc-887c-c24ef412ea2f-kube-api-access-hhbnn\") pod \"network-check-target-m8n2n\" (UID: \"d3cd2f3c-8841-43bc-887c-c24ef412ea2f\") " pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:30:06.306020 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:06.305990 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhbnn\" (UniqueName: \"kubernetes.io/projected/d3cd2f3c-8841-43bc-887c-c24ef412ea2f-kube-api-access-hhbnn\") pod \"network-check-target-m8n2n\" (UID: \"d3cd2f3c-8841-43bc-887c-c24ef412ea2f\") " pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:30:06.386756 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:06.386723 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7hsr" Jul 15 13:30:06.398285 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:06.398263 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rv6f8\"" Jul 15 13:30:06.401983 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:06.401961 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w89gv\"" Jul 15 13:30:06.404539 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:06.404507 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:30:06.407407 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:06.407382 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbjdk" Jul 15 13:30:06.572890 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:06.572780 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d7hsr"] Jul 15 13:30:06.575403 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:30:06.575371 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd024b3a4_a62c_4c57_adee_38378835c1c8.slice/crio-214a676ee8fcde0285585b0896c35be32a53cb4e3a6d2b67f2e68cb7ba4f83cf WatchSource:0}: Error finding container 214a676ee8fcde0285585b0896c35be32a53cb4e3a6d2b67f2e68cb7ba4f83cf: Status 404 returned error can't find the container with id 214a676ee8fcde0285585b0896c35be32a53cb4e3a6d2b67f2e68cb7ba4f83cf Jul 15 13:30:06.592748 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:06.592650 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m8n2n"] Jul 15 13:30:06.595578 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:30:06.595554 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3cd2f3c_8841_43bc_887c_c24ef412ea2f.slice/crio-f8c7cbb5bed9824981c2b6f4f20bf55152f9ecd656e34d2e1286d69ec81db1bc WatchSource:0}: Error finding container f8c7cbb5bed9824981c2b6f4f20bf55152f9ecd656e34d2e1286d69ec81db1bc: Status 404 returned error can't find the container with id f8c7cbb5bed9824981c2b6f4f20bf55152f9ecd656e34d2e1286d69ec81db1bc Jul 15 13:30:06.626105 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:06.626075 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sbjdk"] Jul 15 13:30:06.628957 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:30:06.628916 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d89f2fe_5910_4b03_afba_b491605dc56a.slice/crio-7fa1b83e6a926da4ce066a6d243264d96e58bed968f3f95bf67d4272c0ddc6fe WatchSource:0}: Error finding container 7fa1b83e6a926da4ce066a6d243264d96e58bed968f3f95bf67d4272c0ddc6fe: Status 404 returned error can't find the container with id 7fa1b83e6a926da4ce066a6d243264d96e58bed968f3f95bf67d4272c0ddc6fe Jul 15 13:30:06.804543 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:06.804445 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sbjdk" event={"ID":"1d89f2fe-5910-4b03-afba-b491605dc56a","Type":"ContainerStarted","Data":"7fa1b83e6a926da4ce066a6d243264d96e58bed968f3f95bf67d4272c0ddc6fe"} Jul 15 13:30:06.806276 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:06.806242 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m8n2n" event={"ID":"d3cd2f3c-8841-43bc-887c-c24ef412ea2f","Type":"ContainerStarted","Data":"3e5fba98dcd2148a8aafa1ce00d11c5d103ba954e73811d65c6c056e5b55709d"} Jul 15 13:30:06.806407 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:06.806293 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m8n2n" event={"ID":"d3cd2f3c-8841-43bc-887c-c24ef412ea2f","Type":"ContainerStarted","Data":"f8c7cbb5bed9824981c2b6f4f20bf55152f9ecd656e34d2e1286d69ec81db1bc"} Jul 15 13:30:06.806472 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:06.806403 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:30:06.807436 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:06.807415 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d7hsr" event={"ID":"d024b3a4-a62c-4c57-adee-38378835c1c8","Type":"ContainerStarted","Data":"214a676ee8fcde0285585b0896c35be32a53cb4e3a6d2b67f2e68cb7ba4f83cf"} Jul 15 13:30:06.831421 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:06.831359 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-m8n2n" podStartSLOduration=65.831334175 podStartE2EDuration="1m5.831334175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:29:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:30:06.83065595 +0000 UTC m=+66.950217971" watchObservedRunningTime="2026-07-15 13:30:06.831334175 +0000 UTC m=+66.950896192" Jul 15 13:30:09.635831 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:09.635782 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-tls\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:30:09.639099 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:09.639060 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-tls\") pod \"image-registry-64dcf47cf-w4dk6\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:30:09.737181 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:09.737131 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-metrics-certs\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:30:09.737380 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:09.737198 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea0e04eb-0cbc-4672-8999-bd606cb426df-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-sg5nj\" (UID: \"ea0e04eb-0cbc-4672-8999-bd606cb426df\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-sg5nj" Jul 15 13:30:09.737380 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:09.737254 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-metrics-tls\") pod \"dns-default-z74z6\" (UID: \"801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e\") " pod="openshift-dns/dns-default-z74z6" Jul 15 13:30:09.737380 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:09.737294 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/255bd244-111e-4dd9-9074-ca2adf2b6a3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ztgmx\" (UID: \"255bd244-111e-4dd9-9074-ca2adf2b6a3d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ztgmx" Jul 15 13:30:09.737380 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:09.737360 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-service-ca-bundle\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:30:09.738243 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:09.738187 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-service-ca-bundle\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:30:09.740247 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:09.740199 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e-metrics-tls\") pod \"dns-default-z74z6\" (UID: \"801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e\") " pod="openshift-dns/dns-default-z74z6" Jul 15 13:30:09.740468 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:09.740412 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea0e04eb-0cbc-4672-8999-bd606cb426df-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-sg5nj\" (UID: \"ea0e04eb-0cbc-4672-8999-bd606cb426df\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-sg5nj" Jul 15 13:30:09.740641 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:09.740622 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc8b8f82-5a61-4607-b901-9bb811dfe8bd-metrics-certs\") pod \"router-default-746cbcdcd6-c9gwl\" (UID: \"bc8b8f82-5a61-4607-b901-9bb811dfe8bd\") " pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:30:09.740942 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:09.740917 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/255bd244-111e-4dd9-9074-ca2adf2b6a3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ztgmx\" (UID: \"255bd244-111e-4dd9-9074-ca2adf2b6a3d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ztgmx" Jul 15 13:30:09.827760 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:09.827729 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-t7cjq\"" Jul 15 13:30:09.834908 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:09.834853 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:30:09.886088 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:09.886009 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-g7d5r\"" Jul 15 13:30:09.891935 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:09.891905 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ztgmx" Jul 15 13:30:09.895246 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:09.895222 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rnzhl\"" Jul 15 13:30:09.902533 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:09.902502 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z74z6" Jul 15 13:30:09.926194 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:09.925962 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pkw7w\"" Jul 15 13:30:09.933753 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:09.933143 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:30:09.946927 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:09.946899 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-l25kl\"" Jul 15 13:30:09.956201 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:09.955654 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-sg5nj" Jul 15 13:30:10.041157 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:10.041124 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64dcf47cf-w4dk6"] Jul 15 13:30:10.052916 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:30:10.052870 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5443e2b6_551d_4366_85bf_e9ae5ec2d5af.slice/crio-d0563e8ac95b52c9d86bbba79171a49a49e6ec0aa05020c0c2dc5f05abade80a WatchSource:0}: Error finding container d0563e8ac95b52c9d86bbba79171a49a49e6ec0aa05020c0c2dc5f05abade80a: Status 404 returned error can't find the container with id d0563e8ac95b52c9d86bbba79171a49a49e6ec0aa05020c0c2dc5f05abade80a Jul 15 13:30:10.117202 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:10.117114 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ztgmx"] Jul 15 13:30:10.132889 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:10.132806 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z74z6"] Jul 15 13:30:10.171088 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:10.171035 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-746cbcdcd6-c9gwl"] Jul 15 13:30:10.189448 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:10.189417 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-sg5nj"] Jul 15 13:30:10.262238 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:30:10.262190 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod255bd244_111e_4dd9_9074_ca2adf2b6a3d.slice/crio-3edb81cb4399600456ee75cb30a2f4c9ee971d3a2af471991e66bcb85a82a2f8 WatchSource:0}: Error finding container 3edb81cb4399600456ee75cb30a2f4c9ee971d3a2af471991e66bcb85a82a2f8: Status 404 returned error can't find the container with id 3edb81cb4399600456ee75cb30a2f4c9ee971d3a2af471991e66bcb85a82a2f8 Jul 15 13:30:10.262936 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:30:10.262909 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod801ef2bc_1ced_4b4f_81b2_9f06c4a9ce4e.slice/crio-edef114e145f0fa40b2a98ca3b07cebfda5e36febd4a0081a89a29a311d2687c WatchSource:0}: Error finding container edef114e145f0fa40b2a98ca3b07cebfda5e36febd4a0081a89a29a311d2687c: Status 404 returned error can't find the container with id edef114e145f0fa40b2a98ca3b07cebfda5e36febd4a0081a89a29a311d2687c Jul 15 13:30:10.264118 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:30:10.264085 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc8b8f82_5a61_4607_b901_9bb811dfe8bd.slice/crio-859d3d5acc5bbf7865e537283de1712ecf254e54cbc2e5d55e1c90b2fb286981 WatchSource:0}: Error finding container 859d3d5acc5bbf7865e537283de1712ecf254e54cbc2e5d55e1c90b2fb286981: Status 404 returned error can't find the container with id 859d3d5acc5bbf7865e537283de1712ecf254e54cbc2e5d55e1c90b2fb286981 Jul 15 13:30:10.826833 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:10.826794 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tvbmk" event={"ID":"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0","Type":"ContainerStarted","Data":"cad845d57eda9719335c06f5dddf2156c46feee935f5a96e6098cd5477d2df8a"} Jul 15 13:30:10.828806 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:10.828782 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" event={"ID":"bc8b8f82-5a61-4607-b901-9bb811dfe8bd","Type":"ContainerStarted","Data":"b8c1d5a693c34c3d8f3365dfac65d0d1969e16fe2d9b83556e1919f59c438328"} Jul 15 13:30:10.828939 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:10.828818 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" event={"ID":"bc8b8f82-5a61-4607-b901-9bb811dfe8bd","Type":"ContainerStarted","Data":"859d3d5acc5bbf7865e537283de1712ecf254e54cbc2e5d55e1c90b2fb286981"} Jul 15 13:30:10.829924 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:10.829901 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ztgmx" event={"ID":"255bd244-111e-4dd9-9074-ca2adf2b6a3d","Type":"ContainerStarted","Data":"3edb81cb4399600456ee75cb30a2f4c9ee971d3a2af471991e66bcb85a82a2f8"} Jul 15 13:30:10.830995 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:10.830975 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-sg5nj" event={"ID":"ea0e04eb-0cbc-4672-8999-bd606cb426df","Type":"ContainerStarted","Data":"a806724cd1267224390d28dd3843eacaf4e219427f7f01e5d04f83b58502f481"} Jul 15 13:30:10.832021 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:10.831998 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z74z6" event={"ID":"801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e","Type":"ContainerStarted","Data":"edef114e145f0fa40b2a98ca3b07cebfda5e36febd4a0081a89a29a311d2687c"} Jul 15 13:30:10.833271 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:10.833249 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" event={"ID":"5443e2b6-551d-4366-85bf-e9ae5ec2d5af","Type":"ContainerStarted","Data":"a394c6a769f1574c1b44d703d7de7d70e9e4172e9448d3ff53340f7cb28f1f00"} Jul 15 13:30:10.833337 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:10.833288 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" event={"ID":"5443e2b6-551d-4366-85bf-e9ae5ec2d5af","Type":"ContainerStarted","Data":"d0563e8ac95b52c9d86bbba79171a49a49e6ec0aa05020c0c2dc5f05abade80a"} Jul 15 13:30:10.833402 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:10.833391 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:30:10.857146 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:10.857101 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" podStartSLOduration=40.857082888 podStartE2EDuration="40.857082888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:29:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:30:10.853849212 +0000 UTC m=+70.973411223" watchObservedRunningTime="2026-07-15 13:30:10.857082888 +0000 UTC m=+70.976644898" Jul 15 13:30:10.881441 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:10.881376 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" podStartSLOduration=69.881350969 podStartE2EDuration="1m9.881350969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:29:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:30:10.878951134 +0000 UTC m=+70.998513153" watchObservedRunningTime="2026-07-15 13:30:10.881350969 +0000 UTC m=+71.000912989" Jul 15 13:30:10.934376 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:10.933743 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:30:10.937003 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:10.936967 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:30:11.841902 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:11.841782 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sbjdk" event={"ID":"1d89f2fe-5910-4b03-afba-b491605dc56a","Type":"ContainerStarted","Data":"fabbed4a6693181ab51388763ab49eaa915a2ec5a8fcb97218b02c23d6ad80c8"} Jul 15 13:30:11.841902 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:11.841858 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sbjdk" event={"ID":"1d89f2fe-5910-4b03-afba-b491605dc56a","Type":"ContainerStarted","Data":"06f660be8430c124b8fb68bdcba306b0794f8aca37cc4d2d2f5b79b8a76b569e"} Jul 15 13:30:11.842434 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:11.842223 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:30:11.844037 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:11.843989 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-746cbcdcd6-c9gwl" Jul 15 13:30:11.864881 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:11.864495 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sbjdk" podStartSLOduration=66.637651311 podStartE2EDuration="1m10.86447415s" totalImagesPullingTime="4.226822839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:30:11.863944603 +0000 UTC m=+71.983506624" watchObservedRunningTime="2026-07-15 13:30:11.86447415 +0000 UTC m=+71.984036170" Jul 15 13:30:12.758891 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:12.758855 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d56cc78d4-xnc67"] Jul 15 13:30:12.772094 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:12.772053 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d56cc78d4-xnc67" Jul 15 13:30:12.774844 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:12.774816 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 15 13:30:12.776545 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:12.776116 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 13:30:12.776545 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:12.776259 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-89mch\"" Jul 15 13:30:12.777505 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:12.777364 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 13:30:12.777505 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:12.777393 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 15 13:30:12.777505 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:12.777406 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 15 13:30:12.777505 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:12.777462 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 15 13:30:12.777505 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:12.777470 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 15 13:30:12.788524 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:12.788443 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d56cc78d4-xnc67"] Jul 15 13:30:12.967394 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:12.967359 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f112f8d6-992e-465d-89c6-77654ec71755-service-ca\") pod \"console-d56cc78d4-xnc67\" (UID: \"f112f8d6-992e-465d-89c6-77654ec71755\") " pod="openshift-console/console-d56cc78d4-xnc67" Jul 15 13:30:12.967921 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:12.967401 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dtqz\" (UniqueName: \"kubernetes.io/projected/f112f8d6-992e-465d-89c6-77654ec71755-kube-api-access-7dtqz\") pod \"console-d56cc78d4-xnc67\" (UID: \"f112f8d6-992e-465d-89c6-77654ec71755\") " pod="openshift-console/console-d56cc78d4-xnc67" Jul 15 13:30:12.967921 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:12.967470 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f112f8d6-992e-465d-89c6-77654ec71755-console-oauth-config\") pod \"console-d56cc78d4-xnc67\" (UID: \"f112f8d6-992e-465d-89c6-77654ec71755\") " pod="openshift-console/console-d56cc78d4-xnc67" Jul 15 13:30:12.967921 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:12.967650 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f112f8d6-992e-465d-89c6-77654ec71755-oauth-serving-cert\") pod \"console-d56cc78d4-xnc67\" (UID: \"f112f8d6-992e-465d-89c6-77654ec71755\") " pod="openshift-console/console-d56cc78d4-xnc67" Jul 15 13:30:12.967921 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:12.967821 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f112f8d6-992e-465d-89c6-77654ec71755-console-config\") pod \"console-d56cc78d4-xnc67\" (UID: \"f112f8d6-992e-465d-89c6-77654ec71755\") " pod="openshift-console/console-d56cc78d4-xnc67" Jul 15 13:30:12.968113 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:12.967983 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f112f8d6-992e-465d-89c6-77654ec71755-console-serving-cert\") pod \"console-d56cc78d4-xnc67\" (UID: \"f112f8d6-992e-465d-89c6-77654ec71755\") " pod="openshift-console/console-d56cc78d4-xnc67" Jul 15 13:30:13.069332 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:13.069278 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f112f8d6-992e-465d-89c6-77654ec71755-console-config\") pod \"console-d56cc78d4-xnc67\" (UID: \"f112f8d6-992e-465d-89c6-77654ec71755\") " pod="openshift-console/console-d56cc78d4-xnc67" Jul 15 13:30:13.069332 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:13.069331 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f112f8d6-992e-465d-89c6-77654ec71755-console-serving-cert\") pod \"console-d56cc78d4-xnc67\" (UID: \"f112f8d6-992e-465d-89c6-77654ec71755\") " pod="openshift-console/console-d56cc78d4-xnc67" Jul 15 13:30:13.069575 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:13.069367 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f112f8d6-992e-465d-89c6-77654ec71755-service-ca\") pod \"console-d56cc78d4-xnc67\" (UID: \"f112f8d6-992e-465d-89c6-77654ec71755\") " pod="openshift-console/console-d56cc78d4-xnc67" Jul 15 13:30:13.069575 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:13.069389 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dtqz\" (UniqueName: \"kubernetes.io/projected/f112f8d6-992e-465d-89c6-77654ec71755-kube-api-access-7dtqz\") pod \"console-d56cc78d4-xnc67\" (UID: \"f112f8d6-992e-465d-89c6-77654ec71755\") " pod="openshift-console/console-d56cc78d4-xnc67" Jul 15 13:30:13.069575 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:13.069416 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f112f8d6-992e-465d-89c6-77654ec71755-console-oauth-config\") pod \"console-d56cc78d4-xnc67\" (UID: \"f112f8d6-992e-465d-89c6-77654ec71755\") " pod="openshift-console/console-d56cc78d4-xnc67" Jul 15 13:30:13.069575 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:13.069455 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f112f8d6-992e-465d-89c6-77654ec71755-oauth-serving-cert\") pod \"console-d56cc78d4-xnc67\" (UID: \"f112f8d6-992e-465d-89c6-77654ec71755\") " pod="openshift-console/console-d56cc78d4-xnc67" Jul 15 13:30:13.070214 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:13.070179 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f112f8d6-992e-465d-89c6-77654ec71755-oauth-serving-cert\") pod \"console-d56cc78d4-xnc67\" (UID: \"f112f8d6-992e-465d-89c6-77654ec71755\") " pod="openshift-console/console-d56cc78d4-xnc67" Jul 15 13:30:13.070214 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:13.070192 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f112f8d6-992e-465d-89c6-77654ec71755-service-ca\") pod \"console-d56cc78d4-xnc67\" (UID: \"f112f8d6-992e-465d-89c6-77654ec71755\") " pod="openshift-console/console-d56cc78d4-xnc67" Jul 15 13:30:13.070393 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:13.070244 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f112f8d6-992e-465d-89c6-77654ec71755-console-config\") pod \"console-d56cc78d4-xnc67\" (UID: \"f112f8d6-992e-465d-89c6-77654ec71755\") " pod="openshift-console/console-d56cc78d4-xnc67" Jul 15 13:30:13.072440 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:13.072415 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f112f8d6-992e-465d-89c6-77654ec71755-console-oauth-config\") pod \"console-d56cc78d4-xnc67\" (UID: \"f112f8d6-992e-465d-89c6-77654ec71755\") " pod="openshift-console/console-d56cc78d4-xnc67" Jul 15 13:30:13.072942 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:13.072898 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f112f8d6-992e-465d-89c6-77654ec71755-console-serving-cert\") pod \"console-d56cc78d4-xnc67\" (UID: \"f112f8d6-992e-465d-89c6-77654ec71755\") " pod="openshift-console/console-d56cc78d4-xnc67" Jul 15 13:30:13.082869 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:13.082833 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dtqz\" (UniqueName: \"kubernetes.io/projected/f112f8d6-992e-465d-89c6-77654ec71755-kube-api-access-7dtqz\") pod \"console-d56cc78d4-xnc67\" (UID: \"f112f8d6-992e-465d-89c6-77654ec71755\") " pod="openshift-console/console-d56cc78d4-xnc67" Jul 15 13:30:13.087375 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:13.087346 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d56cc78d4-xnc67" Jul 15 13:30:16.099964 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:16.099928 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d56cc78d4-xnc67"] Jul 15 13:30:16.866132 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:16.866080 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-sg5nj" event={"ID":"ea0e04eb-0cbc-4672-8999-bd606cb426df","Type":"ContainerStarted","Data":"70b39cda6c846c31dea8daa867f3411b781c9b7fc3b4890327efaafcd132e6c0"} Jul 15 13:30:16.869073 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:16.869032 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z74z6" event={"ID":"801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e","Type":"ContainerStarted","Data":"f7cdf8df470c4c2898e0fcdb8c41432c930515b43adb12b03d061eba6e5bc0e7"} Jul 15 13:30:16.871009 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:16.870983 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d7hsr" event={"ID":"d024b3a4-a62c-4c57-adee-38378835c1c8","Type":"ContainerStarted","Data":"d239e6b3df2e592a8a0d0aae70064c7451cba66d8fa32d28255ef81aa3f358b7"} Jul 15 13:30:16.872963 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:16.872905 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ztgmx" event={"ID":"255bd244-111e-4dd9-9074-ca2adf2b6a3d","Type":"ContainerStarted","Data":"921a0183ebf8be774df7cab93325d12c5a34e7a37b71cdf5f3ced5add3d62d28"} Jul 15 13:30:16.913773 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:16.913720 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-d7hsr" podStartSLOduration=66.554147514 podStartE2EDuration="1m15.913698641s" totalImagesPullingTime="9.359551127s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:30:16.913038265 +0000 UTC m=+77.032600286" watchObservedRunningTime="2026-07-15 13:30:16.913698641 +0000 UTC m=+77.033260662" Jul 15 13:30:16.956451 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:16.956386 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ztgmx" podStartSLOduration=41.316858886 podStartE2EDuration="46.956362797s" totalImagesPullingTime="5.639503911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:30:16.955892278 +0000 UTC m=+77.075454298" watchObservedRunningTime="2026-07-15 13:30:16.956362797 +0000 UTC m=+77.075924817" Jul 15 13:30:17.806376 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:30:17.806338 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf112f8d6_992e_465d_89c6_77654ec71755.slice/crio-6a1850b139a7b2cb52c2ed32d7a009916e3c4a67dc70bc95568311d54f6fc03c WatchSource:0}: Error finding container 6a1850b139a7b2cb52c2ed32d7a009916e3c4a67dc70bc95568311d54f6fc03c: Status 404 returned error can't find the container with id 6a1850b139a7b2cb52c2ed32d7a009916e3c4a67dc70bc95568311d54f6fc03c Jul 15 13:30:17.879130 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:17.879077 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d56cc78d4-xnc67" event={"ID":"f112f8d6-992e-465d-89c6-77654ec71755","Type":"ContainerStarted","Data":"6a1850b139a7b2cb52c2ed32d7a009916e3c4a67dc70bc95568311d54f6fc03c"} Jul 15 13:30:18.889579 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:18.889479 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tvbmk" event={"ID":"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0","Type":"ContainerStarted","Data":"24f9cc095e9f0afea7442afbd339fdbd149e9e2ac0e790acefa8e2d60497bd37"} Jul 15 13:30:18.891646 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:18.891615 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-sg5nj" event={"ID":"ea0e04eb-0cbc-4672-8999-bd606cb426df","Type":"ContainerStarted","Data":"da35822066814b38c9d64a64ebbdece53d4e4271ef705ed213af460cfd05b84a"} Jul 15 13:30:18.893823 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:18.893785 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z74z6" event={"ID":"801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e","Type":"ContainerStarted","Data":"625fc266bf92bf437a1aa031cc03dbba147708c126924f517dad4cf969b9fc6a"} Jul 15 13:30:18.893950 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:18.893930 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z74z6" Jul 15 13:30:18.932057 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:18.932002 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-sg5nj" podStartSLOduration=42.321450365 podStartE2EDuration="47.931984454s" totalImagesPullingTime="5.610534089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:29:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:30:18.928829843 +0000 UTC m=+79.048391865" watchObservedRunningTime="2026-07-15 13:30:18.931984454 +0000 UTC m=+79.051546473" Jul 15 13:30:23.919742 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:23.919693 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d56cc78d4-xnc67" event={"ID":"f112f8d6-992e-465d-89c6-77654ec71755","Type":"ContainerStarted","Data":"9b8baf05cf7bd00fbd96f1983194d2201cf9b54466b5ae4bf500750840d6d1c7"} Jul 15 13:30:23.921729 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:23.921702 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tvbmk" event={"ID":"d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0","Type":"ContainerStarted","Data":"3ac35fa49ec0dd910d8485ae86fbb4b18d774efaaf1f093911c8f922940bda7d"} Jul 15 13:30:23.959458 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:23.959405 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z74z6" podStartSLOduration=41.321727994 podStartE2EDuration="46.959389534s" totalImagesPullingTime="5.63766154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:29:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:30:18.981014212 +0000 UTC m=+79.100576232" watchObservedRunningTime="2026-07-15 13:30:23.959389534 +0000 UTC m=+84.078951554" Jul 15 13:30:23.959707 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:23.959687 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d56cc78d4-xnc67" podStartSLOduration=6.701487384 podStartE2EDuration="11.959680224s" totalImagesPullingTime="5.25819284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:30:23.959291563 +0000 UTC m=+84.078853595" watchObservedRunningTime="2026-07-15 13:30:23.959680224 +0000 UTC m=+84.079242242" Jul 15 13:30:28.902447 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:28.902412 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z74z6" Jul 15 13:30:28.926102 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:28.926040 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tvbmk" podStartSLOduration=23.348893442 podStartE2EDuration="41.926021772s" totalImagesPullingTime="18.57712833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:29:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:30:24.000926408 +0000 UTC m=+84.120488427" watchObservedRunningTime="2026-07-15 13:30:28.926021772 +0000 UTC m=+89.045583793" Jul 15 13:30:29.839333 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:29.839303 2558 patch_prober.go:28] interesting pod/image-registry-64dcf47cf-w4dk6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 13:30:29.839522 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:29.839351 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" podUID="5443e2b6-551d-4366-85bf-e9ae5ec2d5af" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 13:30:31.847164 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:31.847135 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:30:33.088296 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.088248 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d56cc78d4-xnc67" Jul 15 13:30:33.088765 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.088332 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d56cc78d4-xnc67" Jul 15 13:30:33.089954 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.089925 2558 patch_prober.go:28] interesting pod/console-d56cc78d4-xnc67 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= Jul 15 13:30:33.090063 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.089976 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-d56cc78d4-xnc67" podUID="f112f8d6-992e-465d-89c6-77654ec71755" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" Jul 15 13:30:33.770203 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.770165 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sgdq2"] Jul 15 13:30:33.774331 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.774297 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.778222 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.778055 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 13:30:33.778787 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.778442 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 13:30:33.778787 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.778647 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 13:30:33.778787 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.778691 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 13:30:33.779500 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.779472 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jpzss\"" Jul 15 13:30:33.844410 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.844372 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.844410 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.844423 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftxll\" (UniqueName: \"kubernetes.io/projected/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-kube-api-access-ftxll\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.844662 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.844457 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-root\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.844662 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.844541 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-metrics-client-ca\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.844662 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.844591 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-node-exporter-textfile\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.844662 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.844636 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.844790 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.844677 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-node-exporter-wtmp\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.844790 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.844738 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-sys\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.844855 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.844808 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-node-exporter-tls\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.945705 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.945663 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-node-exporter-tls\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.945885 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.945733 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.945885 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.945764 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftxll\" (UniqueName: \"kubernetes.io/projected/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-kube-api-access-ftxll\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.945885 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.945791 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-root\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.945885 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.945825 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-metrics-client-ca\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.945885 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:30:33.945830 2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 15 13:30:33.945885 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.945857 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-node-exporter-textfile\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.945885 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.945883 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.946243 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:30:33.945923 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-node-exporter-tls podName:3c3e00f3-94c5-40d4-a621-bd3f1463e5f7 nodeName:}" failed. No retries permitted until 2026-07-15 13:30:34.445894681 +0000 UTC m=+94.565456692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-node-exporter-tls") pod "node-exporter-sgdq2" (UID: "3c3e00f3-94c5-40d4-a621-bd3f1463e5f7") : secret "node-exporter-tls" not found Jul 15 13:30:33.946243 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.945977 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-node-exporter-wtmp\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.946243 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.946008 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-sys\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.946243 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.946087 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-sys\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.946443 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.946354 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-node-exporter-wtmp\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.946563 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.946539 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.946684 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.946664 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-node-exporter-textfile\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.946745 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.946695 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-metrics-client-ca\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.946794 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.946784 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-root\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.948930 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.948907 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:33.957176 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:33.957149 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftxll\" (UniqueName: \"kubernetes.io/projected/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-kube-api-access-ftxll\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:34.449999 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:34.449961 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-node-exporter-tls\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:34.450384 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:30:34.450136 2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 15 13:30:34.450384 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:30:34.450220 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-node-exporter-tls podName:3c3e00f3-94c5-40d4-a621-bd3f1463e5f7 nodeName:}" failed. No retries permitted until 2026-07-15 13:30:35.45019742 +0000 UTC m=+95.569759420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-node-exporter-tls") pod "node-exporter-sgdq2" (UID: "3c3e00f3-94c5-40d4-a621-bd3f1463e5f7") : secret "node-exporter-tls" not found Jul 15 13:30:35.459552 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:35.459509 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-node-exporter-tls\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:35.462223 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:35.462186 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c3e00f3-94c5-40d4-a621-bd3f1463e5f7-node-exporter-tls\") pod \"node-exporter-sgdq2\" (UID: \"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7\") " pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:35.488523 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:35.488484 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64dcf47cf-w4dk6"] Jul 15 13:30:35.586386 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:35.586350 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sgdq2" Jul 15 13:30:35.600028 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:30:35.599995 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c3e00f3_94c5_40d4_a621_bd3f1463e5f7.slice/crio-c241a8abfe49ff4531de2e7b25f0ca7faffe43cabb77cabad26387b1d4ab6f88 WatchSource:0}: Error finding container c241a8abfe49ff4531de2e7b25f0ca7faffe43cabb77cabad26387b1d4ab6f88: Status 404 returned error can't find the container with id c241a8abfe49ff4531de2e7b25f0ca7faffe43cabb77cabad26387b1d4ab6f88 Jul 15 13:30:35.970878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:35.970842 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sgdq2" event={"ID":"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7","Type":"ContainerStarted","Data":"c241a8abfe49ff4531de2e7b25f0ca7faffe43cabb77cabad26387b1d4ab6f88"} Jul 15 13:30:36.134294 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:36.134253 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d56cc78d4-xnc67"] Jul 15 13:30:36.976438 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:36.976403 2558 generic.go:356] "Generic (PLEG): container finished" podID="3c3e00f3-94c5-40d4-a621-bd3f1463e5f7" containerID="1a3944cc2402c97ce49989b636244dd218b7c0af983ab5f28108838936bed387" exitCode=0 Jul 15 13:30:36.976816 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:36.976455 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sgdq2" event={"ID":"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7","Type":"ContainerDied","Data":"1a3944cc2402c97ce49989b636244dd218b7c0af983ab5f28108838936bed387"} Jul 15 13:30:37.814864 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:37.814835 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-m8n2n" Jul 15 13:30:37.982828 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:37.982792 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sgdq2" event={"ID":"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7","Type":"ContainerStarted","Data":"e43677906b7cba0afa0b10163b020f9b89c402ffd1a1bb28811a72de6c59a5b8"} Jul 15 13:30:37.983196 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:37.982845 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sgdq2" event={"ID":"3c3e00f3-94c5-40d4-a621-bd3f1463e5f7","Type":"ContainerStarted","Data":"3fa97a989d3d5e7eeecb7d56785f1274bd57a54b11de885901ef8558d6eeb347"} Jul 15 13:30:38.006727 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.006663 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sgdq2" podStartSLOduration=4.063074281 podStartE2EDuration="5.006642261s" totalImagesPullingTime="872.196924ms" totalInitContainerRuntime="71.371056ms" isStatefulPod=true podCreationTimestamp="2026-07-15 13:30:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:30:38.006323613 +0000 UTC m=+98.125885634" watchObservedRunningTime="2026-07-15 13:30:38.006642261 +0000 UTC m=+98.126204281" Jul 15 13:30:38.428739 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.428699 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55cc67c97d-2wfvr"] Jul 15 13:30:38.435284 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.435243 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:30:38.445162 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.445138 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 15 13:30:38.453421 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.453390 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55cc67c97d-2wfvr"] Jul 15 13:30:38.585826 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.585788 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfe0d947-31ed-409c-9298-1b0f6b8931fb-console-serving-cert\") pod \"console-55cc67c97d-2wfvr\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:30:38.585989 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.585839 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfe0d947-31ed-409c-9298-1b0f6b8931fb-console-config\") pod \"console-55cc67c97d-2wfvr\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:30:38.585989 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.585945 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfe0d947-31ed-409c-9298-1b0f6b8931fb-console-oauth-config\") pod \"console-55cc67c97d-2wfvr\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:30:38.585989 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.585980 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfe0d947-31ed-409c-9298-1b0f6b8931fb-service-ca\") pod \"console-55cc67c97d-2wfvr\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:30:38.586127 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.586019 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gct2w\" (UniqueName: \"kubernetes.io/projected/bfe0d947-31ed-409c-9298-1b0f6b8931fb-kube-api-access-gct2w\") pod \"console-55cc67c97d-2wfvr\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:30:38.586127 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.586072 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfe0d947-31ed-409c-9298-1b0f6b8931fb-trusted-ca-bundle\") pod \"console-55cc67c97d-2wfvr\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:30:38.586127 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.586099 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfe0d947-31ed-409c-9298-1b0f6b8931fb-oauth-serving-cert\") pod \"console-55cc67c97d-2wfvr\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:30:38.687199 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.687108 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfe0d947-31ed-409c-9298-1b0f6b8931fb-console-oauth-config\") pod \"console-55cc67c97d-2wfvr\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:30:38.687199 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.687152 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfe0d947-31ed-409c-9298-1b0f6b8931fb-service-ca\") pod \"console-55cc67c97d-2wfvr\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:30:38.687426 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.687291 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gct2w\" (UniqueName: \"kubernetes.io/projected/bfe0d947-31ed-409c-9298-1b0f6b8931fb-kube-api-access-gct2w\") pod \"console-55cc67c97d-2wfvr\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:30:38.687426 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.687384 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfe0d947-31ed-409c-9298-1b0f6b8931fb-trusted-ca-bundle\") pod \"console-55cc67c97d-2wfvr\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:30:38.687426 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.687413 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfe0d947-31ed-409c-9298-1b0f6b8931fb-oauth-serving-cert\") pod \"console-55cc67c97d-2wfvr\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:30:38.687586 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.687444 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfe0d947-31ed-409c-9298-1b0f6b8931fb-console-serving-cert\") pod \"console-55cc67c97d-2wfvr\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:30:38.687586 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.687469 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfe0d947-31ed-409c-9298-1b0f6b8931fb-console-config\") pod \"console-55cc67c97d-2wfvr\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:30:38.687951 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.687919 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfe0d947-31ed-409c-9298-1b0f6b8931fb-service-ca\") pod \"console-55cc67c97d-2wfvr\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:30:38.688118 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.688091 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfe0d947-31ed-409c-9298-1b0f6b8931fb-oauth-serving-cert\") pod \"console-55cc67c97d-2wfvr\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:30:38.688307 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.688284 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfe0d947-31ed-409c-9298-1b0f6b8931fb-console-config\") pod \"console-55cc67c97d-2wfvr\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:30:38.688350 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.688288 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfe0d947-31ed-409c-9298-1b0f6b8931fb-trusted-ca-bundle\") pod \"console-55cc67c97d-2wfvr\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:30:38.689826 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.689808 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfe0d947-31ed-409c-9298-1b0f6b8931fb-console-oauth-config\") pod \"console-55cc67c97d-2wfvr\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:30:38.689959 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.689940 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfe0d947-31ed-409c-9298-1b0f6b8931fb-console-serving-cert\") pod \"console-55cc67c97d-2wfvr\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:30:38.697033 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.697006 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gct2w\" (UniqueName: \"kubernetes.io/projected/bfe0d947-31ed-409c-9298-1b0f6b8931fb-kube-api-access-gct2w\") pod \"console-55cc67c97d-2wfvr\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:30:38.744919 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.744872 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:30:38.894682 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.894649 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55cc67c97d-2wfvr"] Jul 15 13:30:38.898343 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:30:38.898309 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfe0d947_31ed_409c_9298_1b0f6b8931fb.slice/crio-02d727a5c88ff1cb7729832647b613c502c35c32fbe5a857030d2625fee721bc WatchSource:0}: Error finding container 02d727a5c88ff1cb7729832647b613c502c35c32fbe5a857030d2625fee721bc: Status 404 returned error can't find the container with id 02d727a5c88ff1cb7729832647b613c502c35c32fbe5a857030d2625fee721bc Jul 15 13:30:38.990522 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.990479 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55cc67c97d-2wfvr" event={"ID":"bfe0d947-31ed-409c-9298-1b0f6b8931fb","Type":"ContainerStarted","Data":"646123d1f853279173ab6dcf25d7a3635f890aaeb279e77a5901b12a82f3f687"} Jul 15 13:30:38.991032 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:38.990538 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55cc67c97d-2wfvr" event={"ID":"bfe0d947-31ed-409c-9298-1b0f6b8931fb","Type":"ContainerStarted","Data":"02d727a5c88ff1cb7729832647b613c502c35c32fbe5a857030d2625fee721bc"} Jul 15 13:30:39.013535 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:39.013473 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55cc67c97d-2wfvr" podStartSLOduration=1.013454392 podStartE2EDuration="1.013454392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:30:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:30:39.012758988 +0000 UTC m=+99.132321009" watchObservedRunningTime="2026-07-15 13:30:39.013454392 +0000 UTC m=+99.133016412" Jul 15 13:30:43.255883 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.255839 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55cc67c97d-2wfvr"] Jul 15 13:30:43.324897 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.324856 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-795449f957-qvqfn"] Jul 15 13:30:43.504026 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.503987 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-795449f957-qvqfn"] Jul 15 13:30:43.504026 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.504026 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:43.631058 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.631019 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff0be648-735b-4184-ad74-4767d73b5854-console-config\") pod \"console-795449f957-qvqfn\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:43.631058 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.631063 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hb8q\" (UniqueName: \"kubernetes.io/projected/ff0be648-735b-4184-ad74-4767d73b5854-kube-api-access-9hb8q\") pod \"console-795449f957-qvqfn\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:43.631269 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.631083 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff0be648-735b-4184-ad74-4767d73b5854-oauth-serving-cert\") pod \"console-795449f957-qvqfn\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:43.631269 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.631179 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff0be648-735b-4184-ad74-4767d73b5854-console-oauth-config\") pod \"console-795449f957-qvqfn\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:43.631269 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.631211 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff0be648-735b-4184-ad74-4767d73b5854-service-ca\") pod \"console-795449f957-qvqfn\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:43.631269 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.631239 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff0be648-735b-4184-ad74-4767d73b5854-console-serving-cert\") pod \"console-795449f957-qvqfn\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:43.631269 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.631257 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff0be648-735b-4184-ad74-4767d73b5854-trusted-ca-bundle\") pod \"console-795449f957-qvqfn\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:43.731972 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.731937 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff0be648-735b-4184-ad74-4767d73b5854-service-ca\") pod \"console-795449f957-qvqfn\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:43.732144 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.731985 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff0be648-735b-4184-ad74-4767d73b5854-console-serving-cert\") pod \"console-795449f957-qvqfn\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:43.732144 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.732002 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff0be648-735b-4184-ad74-4767d73b5854-trusted-ca-bundle\") pod \"console-795449f957-qvqfn\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:43.732144 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.732067 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff0be648-735b-4184-ad74-4767d73b5854-console-config\") pod \"console-795449f957-qvqfn\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:43.732144 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.732112 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hb8q\" (UniqueName: \"kubernetes.io/projected/ff0be648-735b-4184-ad74-4767d73b5854-kube-api-access-9hb8q\") pod \"console-795449f957-qvqfn\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:43.732144 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.732141 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff0be648-735b-4184-ad74-4767d73b5854-oauth-serving-cert\") pod \"console-795449f957-qvqfn\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:43.732383 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.732204 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff0be648-735b-4184-ad74-4767d73b5854-console-oauth-config\") pod \"console-795449f957-qvqfn\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:43.732966 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.732937 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff0be648-735b-4184-ad74-4767d73b5854-service-ca\") pod \"console-795449f957-qvqfn\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:43.733230 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.733207 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff0be648-735b-4184-ad74-4767d73b5854-oauth-serving-cert\") pod \"console-795449f957-qvqfn\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:43.733315 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.733229 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff0be648-735b-4184-ad74-4767d73b5854-console-config\") pod \"console-795449f957-qvqfn\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:43.733315 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.733244 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff0be648-735b-4184-ad74-4767d73b5854-trusted-ca-bundle\") pod \"console-795449f957-qvqfn\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:43.735176 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.735153 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff0be648-735b-4184-ad74-4767d73b5854-console-oauth-config\") pod \"console-795449f957-qvqfn\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:43.735276 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.735152 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff0be648-735b-4184-ad74-4767d73b5854-console-serving-cert\") pod \"console-795449f957-qvqfn\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:43.743318 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.743285 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hb8q\" (UniqueName: \"kubernetes.io/projected/ff0be648-735b-4184-ad74-4767d73b5854-kube-api-access-9hb8q\") pod \"console-795449f957-qvqfn\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:43.813577 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.813474 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:43.996925 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:43.996888 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-795449f957-qvqfn"] Jul 15 13:30:44.000072 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:30:44.000036 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff0be648_735b_4184_ad74_4767d73b5854.slice/crio-5f68713351e4a976892070017255c0ec3d2a368f7237830958da85a3f33c0e79 WatchSource:0}: Error finding container 5f68713351e4a976892070017255c0ec3d2a368f7237830958da85a3f33c0e79: Status 404 returned error can't find the container with id 5f68713351e4a976892070017255c0ec3d2a368f7237830958da85a3f33c0e79 Jul 15 13:30:44.012390 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:44.012355 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-795449f957-qvqfn" event={"ID":"ff0be648-735b-4184-ad74-4767d73b5854","Type":"ContainerStarted","Data":"5f68713351e4a976892070017255c0ec3d2a368f7237830958da85a3f33c0e79"} Jul 15 13:30:45.018364 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:45.018333 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-795449f957-qvqfn" event={"ID":"ff0be648-735b-4184-ad74-4767d73b5854","Type":"ContainerStarted","Data":"000bd323fd85e55b2de40ac694d779f4919fee859455716f4e4ab2ebaaebaaef"} Jul 15 13:30:48.745255 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:48.745216 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:30:53.814014 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:53.813969 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:53.814478 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:53.814044 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:53.819054 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:53.819034 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:30:53.848315 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:53.848253 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-795449f957-qvqfn" podStartSLOduration=10.848234915 podStartE2EDuration="10.848234915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:30:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:30:45.065171203 +0000 UTC m=+105.184733236" watchObservedRunningTime="2026-07-15 13:30:53.848234915 +0000 UTC m=+113.967796934" Jul 15 13:30:54.056021 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:30:54.055991 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:31:00.510249 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.510184 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" podUID="5443e2b6-551d-4366-85bf-e9ae5ec2d5af" containerName="registry" containerID="cri-o://a394c6a769f1574c1b44d703d7de7d70e9e4172e9448d3ff53340f7cb28f1f00" gracePeriod=30 Jul 15 13:31:00.759093 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.759067 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:31:00.878912 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.878817 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-ca-trust-extracted\") pod \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " Jul 15 13:31:00.878912 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.878864 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-certificates\") pod \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " Jul 15 13:31:00.878912 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.878894 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-tls\") pod \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " Jul 15 13:31:00.879165 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.878919 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-image-registry-private-configuration\") pod \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " Jul 15 13:31:00.879165 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.878942 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-trusted-ca\") pod \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " Jul 15 13:31:00.879165 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.879100 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-bound-sa-token\") pod \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " Jul 15 13:31:00.879165 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.879151 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-installation-pull-secrets\") pod \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " Jul 15 13:31:00.879378 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.879229 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zm8t\" (UniqueName: \"kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-kube-api-access-2zm8t\") pod \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\" (UID: \"5443e2b6-551d-4366-85bf-e9ae5ec2d5af\") " Jul 15 13:31:00.879378 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.879330 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5443e2b6-551d-4366-85bf-e9ae5ec2d5af" (UID: "5443e2b6-551d-4366-85bf-e9ae5ec2d5af"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:31:00.879547 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.879506 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-certificates\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:31:00.879827 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.879793 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5443e2b6-551d-4366-85bf-e9ae5ec2d5af" (UID: "5443e2b6-551d-4366-85bf-e9ae5ec2d5af"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:31:00.881878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.881831 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5443e2b6-551d-4366-85bf-e9ae5ec2d5af" (UID: "5443e2b6-551d-4366-85bf-e9ae5ec2d5af"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:31:00.882003 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.881891 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-kube-api-access-2zm8t" (OuterVolumeSpecName: "kube-api-access-2zm8t") pod "5443e2b6-551d-4366-85bf-e9ae5ec2d5af" (UID: "5443e2b6-551d-4366-85bf-e9ae5ec2d5af"). InnerVolumeSpecName "kube-api-access-2zm8t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:31:00.882003 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.881969 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5443e2b6-551d-4366-85bf-e9ae5ec2d5af" (UID: "5443e2b6-551d-4366-85bf-e9ae5ec2d5af"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:31:00.882129 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.882050 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5443e2b6-551d-4366-85bf-e9ae5ec2d5af" (UID: "5443e2b6-551d-4366-85bf-e9ae5ec2d5af"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:31:00.882129 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.882081 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5443e2b6-551d-4366-85bf-e9ae5ec2d5af" (UID: "5443e2b6-551d-4366-85bf-e9ae5ec2d5af"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:31:00.888281 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.888252 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5443e2b6-551d-4366-85bf-e9ae5ec2d5af" (UID: "5443e2b6-551d-4366-85bf-e9ae5ec2d5af"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:31:00.980726 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.980689 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zm8t\" (UniqueName: \"kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-kube-api-access-2zm8t\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:31:00.980726 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.980721 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-ca-trust-extracted\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:31:00.980726 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.980733 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-registry-tls\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:31:00.980947 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.980743 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-image-registry-private-configuration\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:31:00.980947 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.980753 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-trusted-ca\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:31:00.980947 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.980762 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-bound-sa-token\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:31:00.980947 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:00.980770 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5443e2b6-551d-4366-85bf-e9ae5ec2d5af-installation-pull-secrets\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:31:01.088030 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.087991 2558 generic.go:356] "Generic (PLEG): container finished" podID="5443e2b6-551d-4366-85bf-e9ae5ec2d5af" containerID="a394c6a769f1574c1b44d703d7de7d70e9e4172e9448d3ff53340f7cb28f1f00" exitCode=0 Jul 15 13:31:01.088186 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.088044 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" Jul 15 13:31:01.088186 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.088053 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" event={"ID":"5443e2b6-551d-4366-85bf-e9ae5ec2d5af","Type":"ContainerDied","Data":"a394c6a769f1574c1b44d703d7de7d70e9e4172e9448d3ff53340f7cb28f1f00"} Jul 15 13:31:01.088186 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.088097 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64dcf47cf-w4dk6" event={"ID":"5443e2b6-551d-4366-85bf-e9ae5ec2d5af","Type":"ContainerDied","Data":"d0563e8ac95b52c9d86bbba79171a49a49e6ec0aa05020c0c2dc5f05abade80a"} Jul 15 13:31:01.088186 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.088117 2558 scope.go:117] "RemoveContainer" containerID="a394c6a769f1574c1b44d703d7de7d70e9e4172e9448d3ff53340f7cb28f1f00" Jul 15 13:31:01.096821 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.096803 2558 scope.go:117] "RemoveContainer" containerID="a394c6a769f1574c1b44d703d7de7d70e9e4172e9448d3ff53340f7cb28f1f00" Jul 15 13:31:01.097155 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:31:01.097130 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a394c6a769f1574c1b44d703d7de7d70e9e4172e9448d3ff53340f7cb28f1f00\": container with ID starting with a394c6a769f1574c1b44d703d7de7d70e9e4172e9448d3ff53340f7cb28f1f00 not found: ID does not exist" containerID="a394c6a769f1574c1b44d703d7de7d70e9e4172e9448d3ff53340f7cb28f1f00" Jul 15 13:31:01.097198 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.097163 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a394c6a769f1574c1b44d703d7de7d70e9e4172e9448d3ff53340f7cb28f1f00"} err="failed to get container status \"a394c6a769f1574c1b44d703d7de7d70e9e4172e9448d3ff53340f7cb28f1f00\": rpc error: code = NotFound desc = could not find container \"a394c6a769f1574c1b44d703d7de7d70e9e4172e9448d3ff53340f7cb28f1f00\": container with ID starting with a394c6a769f1574c1b44d703d7de7d70e9e4172e9448d3ff53340f7cb28f1f00 not found: ID does not exist" Jul 15 13:31:01.111001 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.110971 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64dcf47cf-w4dk6"] Jul 15 13:31:01.115075 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.115051 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64dcf47cf-w4dk6"] Jul 15 13:31:01.162564 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.162478 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d56cc78d4-xnc67" podUID="f112f8d6-992e-465d-89c6-77654ec71755" containerName="console" containerID="cri-o://9b8baf05cf7bd00fbd96f1983194d2201cf9b54466b5ae4bf500750840d6d1c7" gracePeriod=15 Jul 15 13:31:01.399654 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.399627 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d56cc78d4-xnc67" Jul 15 13:31:01.585942 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.585907 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f112f8d6-992e-465d-89c6-77654ec71755-console-oauth-config\") pod \"f112f8d6-992e-465d-89c6-77654ec71755\" (UID: \"f112f8d6-992e-465d-89c6-77654ec71755\") " Jul 15 13:31:01.585942 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.585946 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dtqz\" (UniqueName: \"kubernetes.io/projected/f112f8d6-992e-465d-89c6-77654ec71755-kube-api-access-7dtqz\") pod \"f112f8d6-992e-465d-89c6-77654ec71755\" (UID: \"f112f8d6-992e-465d-89c6-77654ec71755\") " Jul 15 13:31:01.586452 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.585976 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f112f8d6-992e-465d-89c6-77654ec71755-service-ca\") pod \"f112f8d6-992e-465d-89c6-77654ec71755\" (UID: \"f112f8d6-992e-465d-89c6-77654ec71755\") " Jul 15 13:31:01.586452 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.586130 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f112f8d6-992e-465d-89c6-77654ec71755-oauth-serving-cert\") pod \"f112f8d6-992e-465d-89c6-77654ec71755\" (UID: \"f112f8d6-992e-465d-89c6-77654ec71755\") " Jul 15 13:31:01.586452 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.586182 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f112f8d6-992e-465d-89c6-77654ec71755-console-config\") pod \"f112f8d6-992e-465d-89c6-77654ec71755\" (UID: \"f112f8d6-992e-465d-89c6-77654ec71755\") " Jul 15 13:31:01.586452 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.586242 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f112f8d6-992e-465d-89c6-77654ec71755-console-serving-cert\") pod \"f112f8d6-992e-465d-89c6-77654ec71755\" (UID: \"f112f8d6-992e-465d-89c6-77654ec71755\") " Jul 15 13:31:01.586724 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.586511 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f112f8d6-992e-465d-89c6-77654ec71755-service-ca" (OuterVolumeSpecName: "service-ca") pod "f112f8d6-992e-465d-89c6-77654ec71755" (UID: "f112f8d6-992e-465d-89c6-77654ec71755"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:31:01.586724 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.586647 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f112f8d6-992e-465d-89c6-77654ec71755-console-config" (OuterVolumeSpecName: "console-config") pod "f112f8d6-992e-465d-89c6-77654ec71755" (UID: "f112f8d6-992e-465d-89c6-77654ec71755"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:31:01.586837 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.586811 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f112f8d6-992e-465d-89c6-77654ec71755-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f112f8d6-992e-465d-89c6-77654ec71755" (UID: "f112f8d6-992e-465d-89c6-77654ec71755"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:31:01.588592 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.588566 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f112f8d6-992e-465d-89c6-77654ec71755-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f112f8d6-992e-465d-89c6-77654ec71755" (UID: "f112f8d6-992e-465d-89c6-77654ec71755"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:31:01.588718 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.588619 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f112f8d6-992e-465d-89c6-77654ec71755-kube-api-access-7dtqz" (OuterVolumeSpecName: "kube-api-access-7dtqz") pod "f112f8d6-992e-465d-89c6-77654ec71755" (UID: "f112f8d6-992e-465d-89c6-77654ec71755"). InnerVolumeSpecName "kube-api-access-7dtqz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:31:01.588761 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.588727 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f112f8d6-992e-465d-89c6-77654ec71755-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f112f8d6-992e-465d-89c6-77654ec71755" (UID: "f112f8d6-992e-465d-89c6-77654ec71755"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:31:01.687154 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.687123 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f112f8d6-992e-465d-89c6-77654ec71755-oauth-serving-cert\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:31:01.687154 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.687152 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f112f8d6-992e-465d-89c6-77654ec71755-console-config\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:31:01.687154 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.687162 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f112f8d6-992e-465d-89c6-77654ec71755-console-serving-cert\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:31:01.687368 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.687172 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f112f8d6-992e-465d-89c6-77654ec71755-console-oauth-config\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:31:01.687368 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.687182 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dtqz\" (UniqueName: \"kubernetes.io/projected/f112f8d6-992e-465d-89c6-77654ec71755-kube-api-access-7dtqz\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:31:01.687368 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:01.687192 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f112f8d6-992e-465d-89c6-77654ec71755-service-ca\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:31:02.093258 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:02.093225 2558 generic.go:356] "Generic (PLEG): container finished" podID="f112f8d6-992e-465d-89c6-77654ec71755" containerID="9b8baf05cf7bd00fbd96f1983194d2201cf9b54466b5ae4bf500750840d6d1c7" exitCode=0 Jul 15 13:31:02.093446 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:02.093273 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d56cc78d4-xnc67" Jul 15 13:31:02.093446 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:02.093320 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d56cc78d4-xnc67" event={"ID":"f112f8d6-992e-465d-89c6-77654ec71755","Type":"ContainerDied","Data":"9b8baf05cf7bd00fbd96f1983194d2201cf9b54466b5ae4bf500750840d6d1c7"} Jul 15 13:31:02.093446 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:02.093372 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d56cc78d4-xnc67" event={"ID":"f112f8d6-992e-465d-89c6-77654ec71755","Type":"ContainerDied","Data":"6a1850b139a7b2cb52c2ed32d7a009916e3c4a67dc70bc95568311d54f6fc03c"} Jul 15 13:31:02.093446 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:02.093399 2558 scope.go:117] "RemoveContainer" containerID="9b8baf05cf7bd00fbd96f1983194d2201cf9b54466b5ae4bf500750840d6d1c7" Jul 15 13:31:02.101874 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:02.101856 2558 scope.go:117] "RemoveContainer" containerID="9b8baf05cf7bd00fbd96f1983194d2201cf9b54466b5ae4bf500750840d6d1c7" Jul 15 13:31:02.102164 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:31:02.102143 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b8baf05cf7bd00fbd96f1983194d2201cf9b54466b5ae4bf500750840d6d1c7\": container with ID starting with 9b8baf05cf7bd00fbd96f1983194d2201cf9b54466b5ae4bf500750840d6d1c7 not found: ID does not exist" containerID="9b8baf05cf7bd00fbd96f1983194d2201cf9b54466b5ae4bf500750840d6d1c7" Jul 15 13:31:02.102208 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:02.102172 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b8baf05cf7bd00fbd96f1983194d2201cf9b54466b5ae4bf500750840d6d1c7"} err="failed to get container status \"9b8baf05cf7bd00fbd96f1983194d2201cf9b54466b5ae4bf500750840d6d1c7\": rpc error: code = NotFound desc = could not find container \"9b8baf05cf7bd00fbd96f1983194d2201cf9b54466b5ae4bf500750840d6d1c7\": container with ID starting with 9b8baf05cf7bd00fbd96f1983194d2201cf9b54466b5ae4bf500750840d6d1c7 not found: ID does not exist" Jul 15 13:31:02.122490 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:02.122448 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d56cc78d4-xnc67"] Jul 15 13:31:02.126711 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:02.126677 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d56cc78d4-xnc67"] Jul 15 13:31:02.477921 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:02.477880 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5443e2b6-551d-4366-85bf-e9ae5ec2d5af" path="/var/lib/kubelet/pods/5443e2b6-551d-4366-85bf-e9ae5ec2d5af/volumes" Jul 15 13:31:02.478289 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:02.478275 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f112f8d6-992e-465d-89c6-77654ec71755" path="/var/lib/kubelet/pods/f112f8d6-992e-465d-89c6-77654ec71755/volumes" Jul 15 13:31:03.101013 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:03.100982 2558 generic.go:356] "Generic (PLEG): container finished" podID="d34ab343-03c6-4772-9fa4-048ee6de53b1" containerID="e2eefe58240e3ee42f1774e938d2ac8257ed0c0da56cd2b000c9bb228f1b6ebf" exitCode=0 Jul 15 13:31:03.101013 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:03.101024 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9wnm2" event={"ID":"d34ab343-03c6-4772-9fa4-048ee6de53b1","Type":"ContainerDied","Data":"e2eefe58240e3ee42f1774e938d2ac8257ed0c0da56cd2b000c9bb228f1b6ebf"} Jul 15 13:31:03.101449 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:03.101317 2558 scope.go:117] "RemoveContainer" containerID="e2eefe58240e3ee42f1774e938d2ac8257ed0c0da56cd2b000c9bb228f1b6ebf" Jul 15 13:31:04.107042 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:04.107010 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9wnm2" event={"ID":"d34ab343-03c6-4772-9fa4-048ee6de53b1","Type":"ContainerStarted","Data":"bc638cfbaf5ad72226e57d863866bb9ad82f078e341f30422f177ee37df2ac33"} Jul 15 13:31:08.275995 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:08.275946 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-55cc67c97d-2wfvr" podUID="bfe0d947-31ed-409c-9298-1b0f6b8931fb" containerName="console" containerID="cri-o://646123d1f853279173ab6dcf25d7a3635f890aaeb279e77a5901b12a82f3f687" gracePeriod=15 Jul 15 13:31:08.530197 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:08.530134 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:31:08.640395 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:08.640354 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfe0d947-31ed-409c-9298-1b0f6b8931fb-console-oauth-config\") pod \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " Jul 15 13:31:08.640395 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:08.640393 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfe0d947-31ed-409c-9298-1b0f6b8931fb-oauth-serving-cert\") pod \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " Jul 15 13:31:08.640691 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:08.640413 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfe0d947-31ed-409c-9298-1b0f6b8931fb-service-ca\") pod \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " Jul 15 13:31:08.640691 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:08.640441 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gct2w\" (UniqueName: \"kubernetes.io/projected/bfe0d947-31ed-409c-9298-1b0f6b8931fb-kube-api-access-gct2w\") pod \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " Jul 15 13:31:08.640691 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:08.640487 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfe0d947-31ed-409c-9298-1b0f6b8931fb-trusted-ca-bundle\") pod \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " Jul 15 13:31:08.640691 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:08.640561 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfe0d947-31ed-409c-9298-1b0f6b8931fb-console-config\") pod \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " Jul 15 13:31:08.640691 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:08.640631 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfe0d947-31ed-409c-9298-1b0f6b8931fb-console-serving-cert\") pod \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\" (UID: \"bfe0d947-31ed-409c-9298-1b0f6b8931fb\") " Jul 15 13:31:08.640991 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:08.640952 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfe0d947-31ed-409c-9298-1b0f6b8931fb-service-ca" (OuterVolumeSpecName: "service-ca") pod "bfe0d947-31ed-409c-9298-1b0f6b8931fb" (UID: "bfe0d947-31ed-409c-9298-1b0f6b8931fb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:31:08.640991 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:08.640979 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfe0d947-31ed-409c-9298-1b0f6b8931fb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bfe0d947-31ed-409c-9298-1b0f6b8931fb" (UID: "bfe0d947-31ed-409c-9298-1b0f6b8931fb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:31:08.641141 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:08.641109 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfe0d947-31ed-409c-9298-1b0f6b8931fb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bfe0d947-31ed-409c-9298-1b0f6b8931fb" (UID: "bfe0d947-31ed-409c-9298-1b0f6b8931fb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:31:08.641302 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:08.641251 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfe0d947-31ed-409c-9298-1b0f6b8931fb-console-config" (OuterVolumeSpecName: "console-config") pod "bfe0d947-31ed-409c-9298-1b0f6b8931fb" (UID: "bfe0d947-31ed-409c-9298-1b0f6b8931fb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:31:08.642775 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:08.642748 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfe0d947-31ed-409c-9298-1b0f6b8931fb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bfe0d947-31ed-409c-9298-1b0f6b8931fb" (UID: "bfe0d947-31ed-409c-9298-1b0f6b8931fb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:31:08.642904 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:08.642880 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfe0d947-31ed-409c-9298-1b0f6b8931fb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bfe0d947-31ed-409c-9298-1b0f6b8931fb" (UID: "bfe0d947-31ed-409c-9298-1b0f6b8931fb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:31:08.642972 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:08.642895 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfe0d947-31ed-409c-9298-1b0f6b8931fb-kube-api-access-gct2w" (OuterVolumeSpecName: "kube-api-access-gct2w") pod "bfe0d947-31ed-409c-9298-1b0f6b8931fb" (UID: "bfe0d947-31ed-409c-9298-1b0f6b8931fb"). InnerVolumeSpecName "kube-api-access-gct2w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:31:08.742235 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:08.742188 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfe0d947-31ed-409c-9298-1b0f6b8931fb-console-oauth-config\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:31:08.742235 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:08.742223 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfe0d947-31ed-409c-9298-1b0f6b8931fb-oauth-serving-cert\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:31:08.742235 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:08.742234 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfe0d947-31ed-409c-9298-1b0f6b8931fb-service-ca\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:31:08.742235 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:08.742242 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gct2w\" (UniqueName: \"kubernetes.io/projected/bfe0d947-31ed-409c-9298-1b0f6b8931fb-kube-api-access-gct2w\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:31:08.742235 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:08.742253 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfe0d947-31ed-409c-9298-1b0f6b8931fb-trusted-ca-bundle\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:31:08.742529 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:08.742262 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfe0d947-31ed-409c-9298-1b0f6b8931fb-console-config\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:31:08.742529 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:08.742271 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfe0d947-31ed-409c-9298-1b0f6b8931fb-console-serving-cert\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:31:09.126725 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:09.126689 2558 generic.go:356] "Generic (PLEG): container finished" podID="bfe0d947-31ed-409c-9298-1b0f6b8931fb" containerID="646123d1f853279173ab6dcf25d7a3635f890aaeb279e77a5901b12a82f3f687" exitCode=0 Jul 15 13:31:09.126931 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:09.126745 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55cc67c97d-2wfvr" Jul 15 13:31:09.126931 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:09.126770 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55cc67c97d-2wfvr" event={"ID":"bfe0d947-31ed-409c-9298-1b0f6b8931fb","Type":"ContainerDied","Data":"646123d1f853279173ab6dcf25d7a3635f890aaeb279e77a5901b12a82f3f687"} Jul 15 13:31:09.126931 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:09.126824 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55cc67c97d-2wfvr" event={"ID":"bfe0d947-31ed-409c-9298-1b0f6b8931fb","Type":"ContainerDied","Data":"02d727a5c88ff1cb7729832647b613c502c35c32fbe5a857030d2625fee721bc"} Jul 15 13:31:09.126931 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:09.126847 2558 scope.go:117] "RemoveContainer" containerID="646123d1f853279173ab6dcf25d7a3635f890aaeb279e77a5901b12a82f3f687" Jul 15 13:31:09.135509 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:09.135489 2558 scope.go:117] "RemoveContainer" containerID="646123d1f853279173ab6dcf25d7a3635f890aaeb279e77a5901b12a82f3f687" Jul 15 13:31:09.135872 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:31:09.135853 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"646123d1f853279173ab6dcf25d7a3635f890aaeb279e77a5901b12a82f3f687\": container with ID starting with 646123d1f853279173ab6dcf25d7a3635f890aaeb279e77a5901b12a82f3f687 not found: ID does not exist" containerID="646123d1f853279173ab6dcf25d7a3635f890aaeb279e77a5901b12a82f3f687" Jul 15 13:31:09.135939 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:09.135882 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"646123d1f853279173ab6dcf25d7a3635f890aaeb279e77a5901b12a82f3f687"} err="failed to get container status \"646123d1f853279173ab6dcf25d7a3635f890aaeb279e77a5901b12a82f3f687\": rpc error: code = NotFound desc = could not find container \"646123d1f853279173ab6dcf25d7a3635f890aaeb279e77a5901b12a82f3f687\": container with ID starting with 646123d1f853279173ab6dcf25d7a3635f890aaeb279e77a5901b12a82f3f687 not found: ID does not exist" Jul 15 13:31:09.153142 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:09.153100 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55cc67c97d-2wfvr"] Jul 15 13:31:09.157494 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:09.157469 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55cc67c97d-2wfvr"] Jul 15 13:31:10.478423 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:10.478383 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfe0d947-31ed-409c-9298-1b0f6b8931fb" path="/var/lib/kubelet/pods/bfe0d947-31ed-409c-9298-1b0f6b8931fb/volumes" Jul 15 13:31:13.144882 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:13.144839 2558 generic.go:356] "Generic (PLEG): container finished" podID="0f4547cb-8eca-4af6-b026-7d23aea2d5ca" containerID="cec87466923e830eb4f5589152c83b9b26885481f968bd27052a0c2f7146cd04" exitCode=0 Jul 15 13:31:13.145297 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:13.144910 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xdmhg" event={"ID":"0f4547cb-8eca-4af6-b026-7d23aea2d5ca","Type":"ContainerDied","Data":"cec87466923e830eb4f5589152c83b9b26885481f968bd27052a0c2f7146cd04"} Jul 15 13:31:13.145297 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:13.145237 2558 scope.go:117] "RemoveContainer" containerID="cec87466923e830eb4f5589152c83b9b26885481f968bd27052a0c2f7146cd04" Jul 15 13:31:14.150348 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:14.150304 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xdmhg" event={"ID":"0f4547cb-8eca-4af6-b026-7d23aea2d5ca","Type":"ContainerStarted","Data":"401d15c159665d42e3524cda76404b6a6e969ebd40a175fe5e5d95c57c504320"} Jul 15 13:31:17.163266 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:17.163235 2558 generic.go:356] "Generic (PLEG): container finished" podID="7f487faf-49a3-4d67-b8a8-faa39c44c625" containerID="78de934ae88b1bedd9848cddc7b00026419a849f4a48d36f30fb0a0f1aed66a2" exitCode=0 Jul 15 13:31:17.163768 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:17.163312 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" event={"ID":"7f487faf-49a3-4d67-b8a8-faa39c44c625","Type":"ContainerDied","Data":"78de934ae88b1bedd9848cddc7b00026419a849f4a48d36f30fb0a0f1aed66a2"} Jul 15 13:31:17.163768 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:17.163759 2558 scope.go:117] "RemoveContainer" containerID="78de934ae88b1bedd9848cddc7b00026419a849f4a48d36f30fb0a0f1aed66a2" Jul 15 13:31:18.168868 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:18.168836 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-8ngk4" event={"ID":"7f487faf-49a3-4d67-b8a8-faa39c44c625","Type":"ContainerStarted","Data":"bfbf28c5c3e2905d957696de72a2509abb09a13734db27beb887676ab2416776"} Jul 15 13:31:52.026596 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.026555 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86f89c8b9c-l6d8m"] Jul 15 13:31:52.027087 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.026893 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5443e2b6-551d-4366-85bf-e9ae5ec2d5af" containerName="registry" Jul 15 13:31:52.027087 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.026911 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5443e2b6-551d-4366-85bf-e9ae5ec2d5af" containerName="registry" Jul 15 13:31:52.027087 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.026921 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f112f8d6-992e-465d-89c6-77654ec71755" containerName="console" Jul 15 13:31:52.027087 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.026930 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f112f8d6-992e-465d-89c6-77654ec71755" containerName="console" Jul 15 13:31:52.027087 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.026954 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfe0d947-31ed-409c-9298-1b0f6b8931fb" containerName="console" Jul 15 13:31:52.027087 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.026963 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfe0d947-31ed-409c-9298-1b0f6b8931fb" containerName="console" Jul 15 13:31:52.027087 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.027048 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f112f8d6-992e-465d-89c6-77654ec71755" containerName="console" Jul 15 13:31:52.027087 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.027059 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfe0d947-31ed-409c-9298-1b0f6b8931fb" containerName="console" Jul 15 13:31:52.027087 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.027069 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5443e2b6-551d-4366-85bf-e9ae5ec2d5af" containerName="registry" Jul 15 13:31:52.030137 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.030118 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:31:52.049354 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.049317 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86f89c8b9c-l6d8m"] Jul 15 13:31:52.078014 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.077973 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72a08f12-c265-452f-87f1-950313d38b85-console-config\") pod \"console-86f89c8b9c-l6d8m\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:31:52.078204 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.078021 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72a08f12-c265-452f-87f1-950313d38b85-oauth-serving-cert\") pod \"console-86f89c8b9c-l6d8m\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:31:52.078204 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.078097 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72a08f12-c265-452f-87f1-950313d38b85-service-ca\") pod \"console-86f89c8b9c-l6d8m\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:31:52.078204 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.078165 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72a08f12-c265-452f-87f1-950313d38b85-console-oauth-config\") pod \"console-86f89c8b9c-l6d8m\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:31:52.078370 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.078225 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72a08f12-c265-452f-87f1-950313d38b85-console-serving-cert\") pod \"console-86f89c8b9c-l6d8m\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:31:52.078370 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.078251 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn4rc\" (UniqueName: \"kubernetes.io/projected/72a08f12-c265-452f-87f1-950313d38b85-kube-api-access-pn4rc\") pod \"console-86f89c8b9c-l6d8m\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:31:52.078370 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.078278 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72a08f12-c265-452f-87f1-950313d38b85-trusted-ca-bundle\") pod \"console-86f89c8b9c-l6d8m\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:31:52.179456 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.179380 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72a08f12-c265-452f-87f1-950313d38b85-console-config\") pod \"console-86f89c8b9c-l6d8m\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:31:52.179666 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.179508 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72a08f12-c265-452f-87f1-950313d38b85-oauth-serving-cert\") pod \"console-86f89c8b9c-l6d8m\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:31:52.179666 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.179536 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72a08f12-c265-452f-87f1-950313d38b85-service-ca\") pod \"console-86f89c8b9c-l6d8m\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:31:52.179666 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.179592 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72a08f12-c265-452f-87f1-950313d38b85-console-oauth-config\") pod \"console-86f89c8b9c-l6d8m\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:31:52.179832 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.179675 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72a08f12-c265-452f-87f1-950313d38b85-console-serving-cert\") pod \"console-86f89c8b9c-l6d8m\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:31:52.179832 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.179699 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn4rc\" (UniqueName: \"kubernetes.io/projected/72a08f12-c265-452f-87f1-950313d38b85-kube-api-access-pn4rc\") pod \"console-86f89c8b9c-l6d8m\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:31:52.179832 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.179724 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72a08f12-c265-452f-87f1-950313d38b85-trusted-ca-bundle\") pod \"console-86f89c8b9c-l6d8m\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:31:52.180416 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.180391 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72a08f12-c265-452f-87f1-950313d38b85-oauth-serving-cert\") pod \"console-86f89c8b9c-l6d8m\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:31:52.180517 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.180398 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72a08f12-c265-452f-87f1-950313d38b85-console-config\") pod \"console-86f89c8b9c-l6d8m\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:31:52.180517 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.180425 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72a08f12-c265-452f-87f1-950313d38b85-service-ca\") pod \"console-86f89c8b9c-l6d8m\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:31:52.180595 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.180565 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72a08f12-c265-452f-87f1-950313d38b85-trusted-ca-bundle\") pod \"console-86f89c8b9c-l6d8m\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:31:52.182232 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.182203 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72a08f12-c265-452f-87f1-950313d38b85-console-oauth-config\") pod \"console-86f89c8b9c-l6d8m\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:31:52.182299 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.182242 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72a08f12-c265-452f-87f1-950313d38b85-console-serving-cert\") pod \"console-86f89c8b9c-l6d8m\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:31:52.191857 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.191835 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn4rc\" (UniqueName: \"kubernetes.io/projected/72a08f12-c265-452f-87f1-950313d38b85-kube-api-access-pn4rc\") pod \"console-86f89c8b9c-l6d8m\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:31:52.339584 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.339484 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:31:52.481707 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:52.481671 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86f89c8b9c-l6d8m"] Jul 15 13:31:52.485476 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:31:52.485449 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72a08f12_c265_452f_87f1_950313d38b85.slice/crio-aeef1312338c4c8979440f20b9e9f4343a80e84fe1f1cb7972f248b9e6b03200 WatchSource:0}: Error finding container aeef1312338c4c8979440f20b9e9f4343a80e84fe1f1cb7972f248b9e6b03200: Status 404 returned error can't find the container with id aeef1312338c4c8979440f20b9e9f4343a80e84fe1f1cb7972f248b9e6b03200 Jul 15 13:31:53.310418 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:53.310377 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f89c8b9c-l6d8m" event={"ID":"72a08f12-c265-452f-87f1-950313d38b85","Type":"ContainerStarted","Data":"4560e8b68ae057c4d6770980b6faebdcd8fb346008c2dc2e012e45544ced4b30"} Jul 15 13:31:53.310825 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:53.310425 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f89c8b9c-l6d8m" event={"ID":"72a08f12-c265-452f-87f1-950313d38b85","Type":"ContainerStarted","Data":"aeef1312338c4c8979440f20b9e9f4343a80e84fe1f1cb7972f248b9e6b03200"} Jul 15 13:31:53.336594 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:31:53.336539 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86f89c8b9c-l6d8m" podStartSLOduration=2.3365063360000002 podStartE2EDuration="2.336506336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:31:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:31:53.335137982 +0000 UTC m=+173.454700011" watchObservedRunningTime="2026-07-15 13:31:53.336506336 +0000 UTC m=+173.456068359" Jul 15 13:32:02.340054 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:02.340013 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:32:02.340569 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:02.340128 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:32:02.344971 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:02.344947 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:32:02.348687 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:02.348663 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:32:02.470669 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:02.470639 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-795449f957-qvqfn"] Jul 15 13:32:27.492822 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:27.492785 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-795449f957-qvqfn" podUID="ff0be648-735b-4184-ad74-4767d73b5854" containerName="console" containerID="cri-o://000bd323fd85e55b2de40ac694d779f4919fee859455716f4e4ab2ebaaebaaef" gracePeriod=15 Jul 15 13:32:27.728756 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:27.728732 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:32:27.764123 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:27.764056 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff0be648-735b-4184-ad74-4767d73b5854-console-oauth-config\") pod \"ff0be648-735b-4184-ad74-4767d73b5854\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " Jul 15 13:32:27.764123 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:27.764100 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff0be648-735b-4184-ad74-4767d73b5854-console-config\") pod \"ff0be648-735b-4184-ad74-4767d73b5854\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " Jul 15 13:32:27.764123 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:27.764117 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff0be648-735b-4184-ad74-4767d73b5854-oauth-serving-cert\") pod \"ff0be648-735b-4184-ad74-4767d73b5854\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " Jul 15 13:32:27.764383 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:27.764144 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff0be648-735b-4184-ad74-4767d73b5854-console-serving-cert\") pod \"ff0be648-735b-4184-ad74-4767d73b5854\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " Jul 15 13:32:27.764383 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:27.764177 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff0be648-735b-4184-ad74-4767d73b5854-service-ca\") pod \"ff0be648-735b-4184-ad74-4767d73b5854\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " Jul 15 13:32:27.764383 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:27.764204 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hb8q\" (UniqueName: \"kubernetes.io/projected/ff0be648-735b-4184-ad74-4767d73b5854-kube-api-access-9hb8q\") pod \"ff0be648-735b-4184-ad74-4767d73b5854\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " Jul 15 13:32:27.764383 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:27.764257 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff0be648-735b-4184-ad74-4767d73b5854-trusted-ca-bundle\") pod \"ff0be648-735b-4184-ad74-4767d73b5854\" (UID: \"ff0be648-735b-4184-ad74-4767d73b5854\") " Jul 15 13:32:27.764657 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:27.764516 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff0be648-735b-4184-ad74-4767d73b5854-console-config" (OuterVolumeSpecName: "console-config") pod "ff0be648-735b-4184-ad74-4767d73b5854" (UID: "ff0be648-735b-4184-ad74-4767d73b5854"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:32:27.764741 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:27.764715 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff0be648-735b-4184-ad74-4767d73b5854-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ff0be648-735b-4184-ad74-4767d73b5854" (UID: "ff0be648-735b-4184-ad74-4767d73b5854"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:32:27.764872 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:27.764844 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff0be648-735b-4184-ad74-4767d73b5854-service-ca" (OuterVolumeSpecName: "service-ca") pod "ff0be648-735b-4184-ad74-4767d73b5854" (UID: "ff0be648-735b-4184-ad74-4767d73b5854"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:32:27.764954 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:27.764937 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff0be648-735b-4184-ad74-4767d73b5854-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ff0be648-735b-4184-ad74-4767d73b5854" (UID: "ff0be648-735b-4184-ad74-4767d73b5854"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:32:27.766427 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:27.766399 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff0be648-735b-4184-ad74-4767d73b5854-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ff0be648-735b-4184-ad74-4767d73b5854" (UID: "ff0be648-735b-4184-ad74-4767d73b5854"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:32:27.766700 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:27.766672 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff0be648-735b-4184-ad74-4767d73b5854-kube-api-access-9hb8q" (OuterVolumeSpecName: "kube-api-access-9hb8q") pod "ff0be648-735b-4184-ad74-4767d73b5854" (UID: "ff0be648-735b-4184-ad74-4767d73b5854"). InnerVolumeSpecName "kube-api-access-9hb8q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:32:27.766770 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:27.766735 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff0be648-735b-4184-ad74-4767d73b5854-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ff0be648-735b-4184-ad74-4767d73b5854" (UID: "ff0be648-735b-4184-ad74-4767d73b5854"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:32:27.870338 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:27.866090 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff0be648-735b-4184-ad74-4767d73b5854-trusted-ca-bundle\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:32:27.870338 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:27.866148 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff0be648-735b-4184-ad74-4767d73b5854-console-oauth-config\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:32:27.870338 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:27.866163 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff0be648-735b-4184-ad74-4767d73b5854-console-config\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:32:27.870338 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:27.866176 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff0be648-735b-4184-ad74-4767d73b5854-oauth-serving-cert\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:32:27.870338 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:27.866195 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff0be648-735b-4184-ad74-4767d73b5854-console-serving-cert\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:32:27.870338 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:27.866209 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff0be648-735b-4184-ad74-4767d73b5854-service-ca\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:32:27.870338 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:27.866222 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hb8q\" (UniqueName: \"kubernetes.io/projected/ff0be648-735b-4184-ad74-4767d73b5854-kube-api-access-9hb8q\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:32:28.443235 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:28.443203 2558 generic.go:356] "Generic (PLEG): container finished" podID="ff0be648-735b-4184-ad74-4767d73b5854" containerID="000bd323fd85e55b2de40ac694d779f4919fee859455716f4e4ab2ebaaebaaef" exitCode=0 Jul 15 13:32:28.443409 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:28.443257 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-795449f957-qvqfn" event={"ID":"ff0be648-735b-4184-ad74-4767d73b5854","Type":"ContainerDied","Data":"000bd323fd85e55b2de40ac694d779f4919fee859455716f4e4ab2ebaaebaaef"} Jul 15 13:32:28.443409 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:28.443262 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-795449f957-qvqfn" Jul 15 13:32:28.443409 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:28.443321 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-795449f957-qvqfn" event={"ID":"ff0be648-735b-4184-ad74-4767d73b5854","Type":"ContainerDied","Data":"5f68713351e4a976892070017255c0ec3d2a368f7237830958da85a3f33c0e79"} Jul 15 13:32:28.443409 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:28.443341 2558 scope.go:117] "RemoveContainer" containerID="000bd323fd85e55b2de40ac694d779f4919fee859455716f4e4ab2ebaaebaaef" Jul 15 13:32:28.452174 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:28.452155 2558 scope.go:117] "RemoveContainer" containerID="000bd323fd85e55b2de40ac694d779f4919fee859455716f4e4ab2ebaaebaaef" Jul 15 13:32:28.452442 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:32:28.452418 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"000bd323fd85e55b2de40ac694d779f4919fee859455716f4e4ab2ebaaebaaef\": container with ID starting with 000bd323fd85e55b2de40ac694d779f4919fee859455716f4e4ab2ebaaebaaef not found: ID does not exist" containerID="000bd323fd85e55b2de40ac694d779f4919fee859455716f4e4ab2ebaaebaaef" Jul 15 13:32:28.452506 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:28.452452 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"000bd323fd85e55b2de40ac694d779f4919fee859455716f4e4ab2ebaaebaaef"} err="failed to get container status \"000bd323fd85e55b2de40ac694d779f4919fee859455716f4e4ab2ebaaebaaef\": rpc error: code = NotFound desc = could not find container \"000bd323fd85e55b2de40ac694d779f4919fee859455716f4e4ab2ebaaebaaef\": container with ID starting with 000bd323fd85e55b2de40ac694d779f4919fee859455716f4e4ab2ebaaebaaef not found: ID does not exist" Jul 15 13:32:28.478561 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:28.478534 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-795449f957-qvqfn"] Jul 15 13:32:28.478698 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:28.478569 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-795449f957-qvqfn"] Jul 15 13:32:30.477567 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:32:30.477534 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff0be648-735b-4184-ad74-4767d73b5854" path="/var/lib/kubelet/pods/ff0be648-735b-4184-ad74-4767d73b5854/volumes" Jul 15 13:33:22.836365 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:22.836277 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw"] Jul 15 13:33:22.836772 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:22.836562 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff0be648-735b-4184-ad74-4767d73b5854" containerName="console" Jul 15 13:33:22.836772 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:22.836573 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff0be648-735b-4184-ad74-4767d73b5854" containerName="console" Jul 15 13:33:22.836772 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:22.836641 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff0be648-735b-4184-ad74-4767d73b5854" containerName="console" Jul 15 13:33:22.839661 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:22.839645 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw" Jul 15 13:33:22.843074 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:22.843055 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 13:33:22.844015 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:22.843977 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fcjpt\"" Jul 15 13:33:22.844143 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:22.844127 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 13:33:22.852072 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:22.852049 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw"] Jul 15 13:33:22.988137 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:22.988086 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn9gp\" (UniqueName: \"kubernetes.io/projected/26e9125e-b44e-4cf9-918f-25060e2c9dc3-kube-api-access-vn9gp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw\" (UID: \"26e9125e-b44e-4cf9-918f-25060e2c9dc3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw" Jul 15 13:33:22.988137 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:22.988139 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26e9125e-b44e-4cf9-918f-25060e2c9dc3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw\" (UID: \"26e9125e-b44e-4cf9-918f-25060e2c9dc3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw" Jul 15 13:33:22.988363 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:22.988235 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26e9125e-b44e-4cf9-918f-25060e2c9dc3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw\" (UID: \"26e9125e-b44e-4cf9-918f-25060e2c9dc3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw" Jul 15 13:33:23.089230 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:23.089140 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26e9125e-b44e-4cf9-918f-25060e2c9dc3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw\" (UID: \"26e9125e-b44e-4cf9-918f-25060e2c9dc3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw" Jul 15 13:33:23.089230 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:23.089194 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn9gp\" (UniqueName: \"kubernetes.io/projected/26e9125e-b44e-4cf9-918f-25060e2c9dc3-kube-api-access-vn9gp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw\" (UID: \"26e9125e-b44e-4cf9-918f-25060e2c9dc3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw" Jul 15 13:33:23.089230 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:23.089224 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26e9125e-b44e-4cf9-918f-25060e2c9dc3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw\" (UID: \"26e9125e-b44e-4cf9-918f-25060e2c9dc3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw" Jul 15 13:33:23.089649 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:23.089633 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26e9125e-b44e-4cf9-918f-25060e2c9dc3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw\" (UID: \"26e9125e-b44e-4cf9-918f-25060e2c9dc3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw" Jul 15 13:33:23.089691 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:23.089642 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26e9125e-b44e-4cf9-918f-25060e2c9dc3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw\" (UID: \"26e9125e-b44e-4cf9-918f-25060e2c9dc3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw" Jul 15 13:33:23.099458 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:23.099418 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn9gp\" (UniqueName: \"kubernetes.io/projected/26e9125e-b44e-4cf9-918f-25060e2c9dc3-kube-api-access-vn9gp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw\" (UID: \"26e9125e-b44e-4cf9-918f-25060e2c9dc3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw" Jul 15 13:33:23.148595 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:23.148557 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw" Jul 15 13:33:23.293873 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:23.293758 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw"] Jul 15 13:33:23.296662 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:33:23.296634 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26e9125e_b44e_4cf9_918f_25060e2c9dc3.slice/crio-f7b085443c30f445530815ccd0ece49385d887a15c365369159fa74f25d1efa5 WatchSource:0}: Error finding container f7b085443c30f445530815ccd0ece49385d887a15c365369159fa74f25d1efa5: Status 404 returned error can't find the container with id f7b085443c30f445530815ccd0ece49385d887a15c365369159fa74f25d1efa5 Jul 15 13:33:23.647881 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:23.647844 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw" event={"ID":"26e9125e-b44e-4cf9-918f-25060e2c9dc3","Type":"ContainerStarted","Data":"f7b085443c30f445530815ccd0ece49385d887a15c365369159fa74f25d1efa5"} Jul 15 13:33:30.682680 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:30.682644 2558 generic.go:356] "Generic (PLEG): container finished" podID="26e9125e-b44e-4cf9-918f-25060e2c9dc3" containerID="96a0900e364b8b4e53e05670915b2122b2d3e50ba9b8e32c827fb65124bd661c" exitCode=0 Jul 15 13:33:30.683115 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:30.682734 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw" event={"ID":"26e9125e-b44e-4cf9-918f-25060e2c9dc3","Type":"ContainerDied","Data":"96a0900e364b8b4e53e05670915b2122b2d3e50ba9b8e32c827fb65124bd661c"} Jul 15 13:33:33.696180 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:33.696141 2558 generic.go:356] "Generic (PLEG): container finished" podID="26e9125e-b44e-4cf9-918f-25060e2c9dc3" containerID="4ca7c57cab4918c0691891cd8d3a4757be7fcf4fd3bc297f430ac49074623bde" exitCode=0 Jul 15 13:33:33.696180 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:33.696181 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw" event={"ID":"26e9125e-b44e-4cf9-918f-25060e2c9dc3","Type":"ContainerDied","Data":"4ca7c57cab4918c0691891cd8d3a4757be7fcf4fd3bc297f430ac49074623bde"} Jul 15 13:33:39.725241 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:39.725203 2558 generic.go:356] "Generic (PLEG): container finished" podID="26e9125e-b44e-4cf9-918f-25060e2c9dc3" containerID="4a4a816b5840e36f8edeff7f9069f9a830f12fdb366f342bcc4bb1c90f971dfe" exitCode=0 Jul 15 13:33:39.725717 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:39.725258 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw" event={"ID":"26e9125e-b44e-4cf9-918f-25060e2c9dc3","Type":"ContainerDied","Data":"4a4a816b5840e36f8edeff7f9069f9a830f12fdb366f342bcc4bb1c90f971dfe"} Jul 15 13:33:40.851985 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:40.851962 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw" Jul 15 13:33:41.044755 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:41.044649 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vn9gp\" (UniqueName: \"kubernetes.io/projected/26e9125e-b44e-4cf9-918f-25060e2c9dc3-kube-api-access-vn9gp\") pod \"26e9125e-b44e-4cf9-918f-25060e2c9dc3\" (UID: \"26e9125e-b44e-4cf9-918f-25060e2c9dc3\") " Jul 15 13:33:41.044755 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:41.044748 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26e9125e-b44e-4cf9-918f-25060e2c9dc3-bundle\") pod \"26e9125e-b44e-4cf9-918f-25060e2c9dc3\" (UID: \"26e9125e-b44e-4cf9-918f-25060e2c9dc3\") " Jul 15 13:33:41.044984 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:41.044804 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26e9125e-b44e-4cf9-918f-25060e2c9dc3-util\") pod \"26e9125e-b44e-4cf9-918f-25060e2c9dc3\" (UID: \"26e9125e-b44e-4cf9-918f-25060e2c9dc3\") " Jul 15 13:33:41.045415 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:41.045381 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26e9125e-b44e-4cf9-918f-25060e2c9dc3-bundle" (OuterVolumeSpecName: "bundle") pod "26e9125e-b44e-4cf9-918f-25060e2c9dc3" (UID: "26e9125e-b44e-4cf9-918f-25060e2c9dc3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:33:41.046918 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:41.046892 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26e9125e-b44e-4cf9-918f-25060e2c9dc3-kube-api-access-vn9gp" (OuterVolumeSpecName: "kube-api-access-vn9gp") pod "26e9125e-b44e-4cf9-918f-25060e2c9dc3" (UID: "26e9125e-b44e-4cf9-918f-25060e2c9dc3"). InnerVolumeSpecName "kube-api-access-vn9gp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:33:41.050167 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:41.050138 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26e9125e-b44e-4cf9-918f-25060e2c9dc3-util" (OuterVolumeSpecName: "util") pod "26e9125e-b44e-4cf9-918f-25060e2c9dc3" (UID: "26e9125e-b44e-4cf9-918f-25060e2c9dc3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:33:41.145279 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:41.145247 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26e9125e-b44e-4cf9-918f-25060e2c9dc3-bundle\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:33:41.145279 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:41.145270 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26e9125e-b44e-4cf9-918f-25060e2c9dc3-util\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:33:41.145279 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:41.145280 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vn9gp\" (UniqueName: \"kubernetes.io/projected/26e9125e-b44e-4cf9-918f-25060e2c9dc3-kube-api-access-vn9gp\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:33:41.735230 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:41.735196 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw" event={"ID":"26e9125e-b44e-4cf9-918f-25060e2c9dc3","Type":"ContainerDied","Data":"f7b085443c30f445530815ccd0ece49385d887a15c365369159fa74f25d1efa5"} Jul 15 13:33:41.735230 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:41.735227 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m4bjw" Jul 15 13:33:41.735427 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:41.735270 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7b085443c30f445530815ccd0ece49385d887a15c365369159fa74f25d1efa5" Jul 15 13:33:46.108501 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:46.108456 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8hfn9"] Jul 15 13:33:46.108965 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:46.108742 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26e9125e-b44e-4cf9-918f-25060e2c9dc3" containerName="util" Jul 15 13:33:46.108965 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:46.108753 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="26e9125e-b44e-4cf9-918f-25060e2c9dc3" containerName="util" Jul 15 13:33:46.108965 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:46.108766 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26e9125e-b44e-4cf9-918f-25060e2c9dc3" containerName="pull" Jul 15 13:33:46.108965 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:46.108771 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="26e9125e-b44e-4cf9-918f-25060e2c9dc3" containerName="pull" Jul 15 13:33:46.108965 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:46.108783 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26e9125e-b44e-4cf9-918f-25060e2c9dc3" containerName="extract" Jul 15 13:33:46.108965 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:46.108789 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="26e9125e-b44e-4cf9-918f-25060e2c9dc3" containerName="extract" Jul 15 13:33:46.108965 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:46.108839 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="26e9125e-b44e-4cf9-918f-25060e2c9dc3" containerName="extract" Jul 15 13:33:46.112361 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:46.112343 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8hfn9" Jul 15 13:33:46.115318 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:46.115301 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-kxthk\"" Jul 15 13:33:46.115738 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:46.115718 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 15 13:33:46.116008 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:46.115988 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 15 13:33:46.134424 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:46.134397 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8hfn9"] Jul 15 13:33:46.280355 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:46.280298 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ccmn\" (UniqueName: \"kubernetes.io/projected/3347a4df-c310-4c81-8da4-c1acd55d61ca-kube-api-access-4ccmn\") pod \"cert-manager-operator-controller-manager-55c444bf86-8hfn9\" (UID: \"3347a4df-c310-4c81-8da4-c1acd55d61ca\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8hfn9" Jul 15 13:33:46.280355 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:46.280358 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3347a4df-c310-4c81-8da4-c1acd55d61ca-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8hfn9\" (UID: \"3347a4df-c310-4c81-8da4-c1acd55d61ca\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8hfn9" Jul 15 13:33:46.380985 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:46.380888 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ccmn\" (UniqueName: \"kubernetes.io/projected/3347a4df-c310-4c81-8da4-c1acd55d61ca-kube-api-access-4ccmn\") pod \"cert-manager-operator-controller-manager-55c444bf86-8hfn9\" (UID: \"3347a4df-c310-4c81-8da4-c1acd55d61ca\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8hfn9" Jul 15 13:33:46.380985 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:46.380945 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3347a4df-c310-4c81-8da4-c1acd55d61ca-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8hfn9\" (UID: \"3347a4df-c310-4c81-8da4-c1acd55d61ca\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8hfn9" Jul 15 13:33:46.381284 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:46.381268 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3347a4df-c310-4c81-8da4-c1acd55d61ca-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8hfn9\" (UID: \"3347a4df-c310-4c81-8da4-c1acd55d61ca\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8hfn9" Jul 15 13:33:46.399828 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:46.399804 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ccmn\" (UniqueName: \"kubernetes.io/projected/3347a4df-c310-4c81-8da4-c1acd55d61ca-kube-api-access-4ccmn\") pod \"cert-manager-operator-controller-manager-55c444bf86-8hfn9\" (UID: \"3347a4df-c310-4c81-8da4-c1acd55d61ca\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8hfn9" Jul 15 13:33:46.421614 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:46.421569 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8hfn9" Jul 15 13:33:46.576804 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:46.576780 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8hfn9"] Jul 15 13:33:46.582116 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:33:46.582088 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3347a4df_c310_4c81_8da4_c1acd55d61ca.slice/crio-31b3159b1c9b3b2d53eae6ce343e8658bf7d76004f2600373e11865b536bda26 WatchSource:0}: Error finding container 31b3159b1c9b3b2d53eae6ce343e8658bf7d76004f2600373e11865b536bda26: Status 404 returned error can't find the container with id 31b3159b1c9b3b2d53eae6ce343e8658bf7d76004f2600373e11865b536bda26 Jul 15 13:33:46.757990 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:46.757958 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8hfn9" event={"ID":"3347a4df-c310-4c81-8da4-c1acd55d61ca","Type":"ContainerStarted","Data":"31b3159b1c9b3b2d53eae6ce343e8658bf7d76004f2600373e11865b536bda26"} Jul 15 13:33:48.769926 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:48.769885 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8hfn9" event={"ID":"3347a4df-c310-4c81-8da4-c1acd55d61ca","Type":"ContainerStarted","Data":"c28999a33f93df0a090e1de825f86f09e076a1e8b62012da3cf2539158a12031"} Jul 15 13:33:48.805621 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:48.802303 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8hfn9" podStartSLOduration=1.383966226 podStartE2EDuration="2.802283338s" totalImagesPullingTime="1.418317112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:33:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:33:48.800973794 +0000 UTC m=+288.920535813" watchObservedRunningTime="2026-07-15 13:33:48.802283338 +0000 UTC m=+288.921845357" Jul 15 13:33:49.580695 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:49.580658 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj"] Jul 15 13:33:49.583279 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:49.583261 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj" Jul 15 13:33:49.586680 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:49.586661 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 13:33:49.587045 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:49.587023 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fcjpt\"" Jul 15 13:33:49.587766 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:49.587747 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 13:33:49.604229 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:49.604202 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmt6k\" (UniqueName: \"kubernetes.io/projected/4fbe97a3-2a86-46fc-b2a8-f6c52992bc10-kube-api-access-hmt6k\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj\" (UID: \"4fbe97a3-2a86-46fc-b2a8-f6c52992bc10\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj" Jul 15 13:33:49.604364 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:49.604241 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4fbe97a3-2a86-46fc-b2a8-f6c52992bc10-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj\" (UID: \"4fbe97a3-2a86-46fc-b2a8-f6c52992bc10\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj" Jul 15 13:33:49.604364 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:49.604323 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4fbe97a3-2a86-46fc-b2a8-f6c52992bc10-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj\" (UID: \"4fbe97a3-2a86-46fc-b2a8-f6c52992bc10\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj" Jul 15 13:33:49.605465 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:49.605439 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj"] Jul 15 13:33:49.705063 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:49.705029 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4fbe97a3-2a86-46fc-b2a8-f6c52992bc10-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj\" (UID: \"4fbe97a3-2a86-46fc-b2a8-f6c52992bc10\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj" Jul 15 13:33:49.705219 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:49.705088 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmt6k\" (UniqueName: \"kubernetes.io/projected/4fbe97a3-2a86-46fc-b2a8-f6c52992bc10-kube-api-access-hmt6k\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj\" (UID: \"4fbe97a3-2a86-46fc-b2a8-f6c52992bc10\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj" Jul 15 13:33:49.705219 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:49.705111 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4fbe97a3-2a86-46fc-b2a8-f6c52992bc10-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj\" (UID: \"4fbe97a3-2a86-46fc-b2a8-f6c52992bc10\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj" Jul 15 13:33:49.705431 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:49.705411 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4fbe97a3-2a86-46fc-b2a8-f6c52992bc10-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj\" (UID: \"4fbe97a3-2a86-46fc-b2a8-f6c52992bc10\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj" Jul 15 13:33:49.705475 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:49.705438 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4fbe97a3-2a86-46fc-b2a8-f6c52992bc10-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj\" (UID: \"4fbe97a3-2a86-46fc-b2a8-f6c52992bc10\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj" Jul 15 13:33:49.715090 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:49.715067 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmt6k\" (UniqueName: \"kubernetes.io/projected/4fbe97a3-2a86-46fc-b2a8-f6c52992bc10-kube-api-access-hmt6k\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj\" (UID: \"4fbe97a3-2a86-46fc-b2a8-f6c52992bc10\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj" Jul 15 13:33:49.893135 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:49.893049 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj" Jul 15 13:33:50.038153 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:50.038113 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj"] Jul 15 13:33:50.041096 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:33:50.041071 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fbe97a3_2a86_46fc_b2a8_f6c52992bc10.slice/crio-f05bca614d90bc39a6dba1d564826cb234259e04c45c308c22cc4bf9d362cbf4 WatchSource:0}: Error finding container f05bca614d90bc39a6dba1d564826cb234259e04c45c308c22cc4bf9d362cbf4: Status 404 returned error can't find the container with id f05bca614d90bc39a6dba1d564826cb234259e04c45c308c22cc4bf9d362cbf4 Jul 15 13:33:50.089038 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:50.089008 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-drjvh"] Jul 15 13:33:50.091878 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:50.091861 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-drjvh" Jul 15 13:33:50.095423 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:50.095403 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 15 13:33:50.096539 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:50.096108 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 15 13:33:50.105404 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:50.105383 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-drjvh"] Jul 15 13:33:50.107872 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:50.107836 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c51bec1d-830f-472f-a93e-532f1dd3a584-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-drjvh\" (UID: \"c51bec1d-830f-472f-a93e-532f1dd3a584\") " pod="cert-manager/cert-manager-webhook-6486ffd997-drjvh" Jul 15 13:33:50.107983 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:50.107935 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmrtm\" (UniqueName: \"kubernetes.io/projected/c51bec1d-830f-472f-a93e-532f1dd3a584-kube-api-access-rmrtm\") pod \"cert-manager-webhook-6486ffd997-drjvh\" (UID: \"c51bec1d-830f-472f-a93e-532f1dd3a584\") " pod="cert-manager/cert-manager-webhook-6486ffd997-drjvh" Jul 15 13:33:50.208509 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:50.208475 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmrtm\" (UniqueName: \"kubernetes.io/projected/c51bec1d-830f-472f-a93e-532f1dd3a584-kube-api-access-rmrtm\") pod \"cert-manager-webhook-6486ffd997-drjvh\" (UID: \"c51bec1d-830f-472f-a93e-532f1dd3a584\") " pod="cert-manager/cert-manager-webhook-6486ffd997-drjvh" Jul 15 13:33:50.208696 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:50.208529 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c51bec1d-830f-472f-a93e-532f1dd3a584-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-drjvh\" (UID: \"c51bec1d-830f-472f-a93e-532f1dd3a584\") " pod="cert-manager/cert-manager-webhook-6486ffd997-drjvh" Jul 15 13:33:50.226630 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:50.226577 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c51bec1d-830f-472f-a93e-532f1dd3a584-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-drjvh\" (UID: \"c51bec1d-830f-472f-a93e-532f1dd3a584\") " pod="cert-manager/cert-manager-webhook-6486ffd997-drjvh" Jul 15 13:33:50.226768 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:50.226708 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmrtm\" (UniqueName: \"kubernetes.io/projected/c51bec1d-830f-472f-a93e-532f1dd3a584-kube-api-access-rmrtm\") pod \"cert-manager-webhook-6486ffd997-drjvh\" (UID: \"c51bec1d-830f-472f-a93e-532f1dd3a584\") " pod="cert-manager/cert-manager-webhook-6486ffd997-drjvh" Jul 15 13:33:50.412267 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:50.412176 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-drjvh" Jul 15 13:33:50.543862 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:50.543774 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-drjvh"] Jul 15 13:33:50.547447 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:33:50.547418 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc51bec1d_830f_472f_a93e_532f1dd3a584.slice/crio-543aedc7e55c7bd5875c70446df8122017faf2661fce0593769b6d43d3d19e30 WatchSource:0}: Error finding container 543aedc7e55c7bd5875c70446df8122017faf2661fce0593769b6d43d3d19e30: Status 404 returned error can't find the container with id 543aedc7e55c7bd5875c70446df8122017faf2661fce0593769b6d43d3d19e30 Jul 15 13:33:50.780314 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:50.780278 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-drjvh" event={"ID":"c51bec1d-830f-472f-a93e-532f1dd3a584","Type":"ContainerStarted","Data":"543aedc7e55c7bd5875c70446df8122017faf2661fce0593769b6d43d3d19e30"} Jul 15 13:33:50.781825 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:50.781798 2558 generic.go:356] "Generic (PLEG): container finished" podID="4fbe97a3-2a86-46fc-b2a8-f6c52992bc10" containerID="592404722d6083934ae5257fc483e43d210d84f143b94b0b523fc0a5f8aa9764" exitCode=0 Jul 15 13:33:50.781964 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:50.781841 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj" event={"ID":"4fbe97a3-2a86-46fc-b2a8-f6c52992bc10","Type":"ContainerDied","Data":"592404722d6083934ae5257fc483e43d210d84f143b94b0b523fc0a5f8aa9764"} Jul 15 13:33:50.781964 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:50.781883 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj" event={"ID":"4fbe97a3-2a86-46fc-b2a8-f6c52992bc10","Type":"ContainerStarted","Data":"f05bca614d90bc39a6dba1d564826cb234259e04c45c308c22cc4bf9d362cbf4"} Jul 15 13:33:54.802846 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:54.802807 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-drjvh" event={"ID":"c51bec1d-830f-472f-a93e-532f1dd3a584","Type":"ContainerStarted","Data":"80b2168b7d24b9db6e52a3fb2891eb8f6f05276a5a35c622677485011f9289d4"} Jul 15 13:33:54.803281 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:54.802863 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-drjvh" Jul 15 13:33:54.804698 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:54.804675 2558 generic.go:356] "Generic (PLEG): container finished" podID="4fbe97a3-2a86-46fc-b2a8-f6c52992bc10" containerID="14dc0b7c7c5d153b50a5fdf28ae56371cc21890b6cc79d4eb100ab98ba1a1bf9" exitCode=0 Jul 15 13:33:54.804788 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:54.804705 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj" event={"ID":"4fbe97a3-2a86-46fc-b2a8-f6c52992bc10","Type":"ContainerDied","Data":"14dc0b7c7c5d153b50a5fdf28ae56371cc21890b6cc79d4eb100ab98ba1a1bf9"} Jul 15 13:33:54.826430 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:54.826374 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-drjvh" podStartSLOduration=1.5638761049999998 podStartE2EDuration="4.826353972s" totalImagesPullingTime="3.262477867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:33:54.824171152 +0000 UTC m=+294.943733174" watchObservedRunningTime="2026-07-15 13:33:54.826353972 +0000 UTC m=+294.945915996" Jul 15 13:33:55.810998 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:55.810964 2558 generic.go:356] "Generic (PLEG): container finished" podID="4fbe97a3-2a86-46fc-b2a8-f6c52992bc10" containerID="afdf03bfb6153f6bc3fcdf088f3206d135dbb0ef770e07750d97ccce6acbb009" exitCode=0 Jul 15 13:33:55.811383 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:55.811057 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj" event={"ID":"4fbe97a3-2a86-46fc-b2a8-f6c52992bc10","Type":"ContainerDied","Data":"afdf03bfb6153f6bc3fcdf088f3206d135dbb0ef770e07750d97ccce6acbb009"} Jul 15 13:33:56.946142 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:56.946116 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj" Jul 15 13:33:56.960582 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:56.960554 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmt6k\" (UniqueName: \"kubernetes.io/projected/4fbe97a3-2a86-46fc-b2a8-f6c52992bc10-kube-api-access-hmt6k\") pod \"4fbe97a3-2a86-46fc-b2a8-f6c52992bc10\" (UID: \"4fbe97a3-2a86-46fc-b2a8-f6c52992bc10\") " Jul 15 13:33:56.960728 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:56.960590 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4fbe97a3-2a86-46fc-b2a8-f6c52992bc10-bundle\") pod \"4fbe97a3-2a86-46fc-b2a8-f6c52992bc10\" (UID: \"4fbe97a3-2a86-46fc-b2a8-f6c52992bc10\") " Jul 15 13:33:56.960728 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:56.960643 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4fbe97a3-2a86-46fc-b2a8-f6c52992bc10-util\") pod \"4fbe97a3-2a86-46fc-b2a8-f6c52992bc10\" (UID: \"4fbe97a3-2a86-46fc-b2a8-f6c52992bc10\") " Jul 15 13:33:56.961050 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:56.961024 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fbe97a3-2a86-46fc-b2a8-f6c52992bc10-bundle" (OuterVolumeSpecName: "bundle") pod "4fbe97a3-2a86-46fc-b2a8-f6c52992bc10" (UID: "4fbe97a3-2a86-46fc-b2a8-f6c52992bc10"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:33:56.963210 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:56.963176 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fbe97a3-2a86-46fc-b2a8-f6c52992bc10-kube-api-access-hmt6k" (OuterVolumeSpecName: "kube-api-access-hmt6k") pod "4fbe97a3-2a86-46fc-b2a8-f6c52992bc10" (UID: "4fbe97a3-2a86-46fc-b2a8-f6c52992bc10"). InnerVolumeSpecName "kube-api-access-hmt6k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:33:56.965516 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:56.965478 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fbe97a3-2a86-46fc-b2a8-f6c52992bc10-util" (OuterVolumeSpecName: "util") pod "4fbe97a3-2a86-46fc-b2a8-f6c52992bc10" (UID: "4fbe97a3-2a86-46fc-b2a8-f6c52992bc10"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:33:57.062154 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:57.062115 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4fbe97a3-2a86-46fc-b2a8-f6c52992bc10-util\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:33:57.062154 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:57.062146 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmt6k\" (UniqueName: \"kubernetes.io/projected/4fbe97a3-2a86-46fc-b2a8-f6c52992bc10-kube-api-access-hmt6k\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:33:57.062154 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:57.062157 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4fbe97a3-2a86-46fc-b2a8-f6c52992bc10-bundle\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:33:57.820536 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:57.820501 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj" event={"ID":"4fbe97a3-2a86-46fc-b2a8-f6c52992bc10","Type":"ContainerDied","Data":"f05bca614d90bc39a6dba1d564826cb234259e04c45c308c22cc4bf9d362cbf4"} Jul 15 13:33:57.820536 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:57.820538 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fprhvj" Jul 15 13:33:57.820763 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:33:57.820558 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f05bca614d90bc39a6dba1d564826cb234259e04c45c308c22cc4bf9d362cbf4" Jul 15 13:34:00.327159 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:00.327125 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/1.log" Jul 15 13:34:00.331110 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:00.331084 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/1.log" Jul 15 13:34:00.333846 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:00.333826 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkf79_c92079f2-6ca8-4000-b0b8-128ba9dccd98/ovn-acl-logging/0.log" Jul 15 13:34:00.337804 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:00.337781 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkf79_c92079f2-6ca8-4000-b0b8-128ba9dccd98/ovn-acl-logging/0.log" Jul 15 13:34:00.338870 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:00.338849 2558 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 13:34:00.813195 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:00.813168 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-drjvh" Jul 15 13:34:03.981141 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:03.981105 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5pmdp"] Jul 15 13:34:03.981518 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:03.981390 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fbe97a3-2a86-46fc-b2a8-f6c52992bc10" containerName="pull" Jul 15 13:34:03.981518 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:03.981401 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fbe97a3-2a86-46fc-b2a8-f6c52992bc10" containerName="pull" Jul 15 13:34:03.981518 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:03.981410 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fbe97a3-2a86-46fc-b2a8-f6c52992bc10" containerName="extract" Jul 15 13:34:03.981518 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:03.981416 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fbe97a3-2a86-46fc-b2a8-f6c52992bc10" containerName="extract" Jul 15 13:34:03.981518 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:03.981424 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fbe97a3-2a86-46fc-b2a8-f6c52992bc10" containerName="util" Jul 15 13:34:03.981518 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:03.981429 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fbe97a3-2a86-46fc-b2a8-f6c52992bc10" containerName="util" Jul 15 13:34:03.981518 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:03.981478 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fbe97a3-2a86-46fc-b2a8-f6c52992bc10" containerName="extract" Jul 15 13:34:03.984310 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:03.984293 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5pmdp" Jul 15 13:34:03.987068 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:03.987044 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 15 13:34:03.987254 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:03.987239 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-vq552\"" Jul 15 13:34:03.988205 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:03.988190 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 15 13:34:03.996583 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:03.996560 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5pmdp"] Jul 15 13:34:04.017452 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:04.017419 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swcj4\" (UniqueName: \"kubernetes.io/projected/6de5ed7c-2327-4120-ae44-dc1d8a46ff5d-kube-api-access-swcj4\") pod \"openshift-lws-operator-fd8ccff4c-5pmdp\" (UID: \"6de5ed7c-2327-4120-ae44-dc1d8a46ff5d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5pmdp" Jul 15 13:34:04.017648 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:04.017488 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6de5ed7c-2327-4120-ae44-dc1d8a46ff5d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5pmdp\" (UID: \"6de5ed7c-2327-4120-ae44-dc1d8a46ff5d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5pmdp" Jul 15 13:34:04.118662 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:04.118630 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swcj4\" (UniqueName: \"kubernetes.io/projected/6de5ed7c-2327-4120-ae44-dc1d8a46ff5d-kube-api-access-swcj4\") pod \"openshift-lws-operator-fd8ccff4c-5pmdp\" (UID: \"6de5ed7c-2327-4120-ae44-dc1d8a46ff5d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5pmdp" Jul 15 13:34:04.118842 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:04.118709 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6de5ed7c-2327-4120-ae44-dc1d8a46ff5d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5pmdp\" (UID: \"6de5ed7c-2327-4120-ae44-dc1d8a46ff5d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5pmdp" Jul 15 13:34:04.119083 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:04.119060 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6de5ed7c-2327-4120-ae44-dc1d8a46ff5d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5pmdp\" (UID: \"6de5ed7c-2327-4120-ae44-dc1d8a46ff5d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5pmdp" Jul 15 13:34:04.127364 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:04.127337 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swcj4\" (UniqueName: \"kubernetes.io/projected/6de5ed7c-2327-4120-ae44-dc1d8a46ff5d-kube-api-access-swcj4\") pod \"openshift-lws-operator-fd8ccff4c-5pmdp\" (UID: \"6de5ed7c-2327-4120-ae44-dc1d8a46ff5d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5pmdp" Jul 15 13:34:04.294168 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:04.294065 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5pmdp" Jul 15 13:34:04.428937 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:04.428908 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5pmdp"] Jul 15 13:34:04.430663 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:34:04.430639 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6de5ed7c_2327_4120_ae44_dc1d8a46ff5d.slice/crio-3e5805fb20db4374a329de747229df8062fe74593f665b6babdd391de4024fab WatchSource:0}: Error finding container 3e5805fb20db4374a329de747229df8062fe74593f665b6babdd391de4024fab: Status 404 returned error can't find the container with id 3e5805fb20db4374a329de747229df8062fe74593f665b6babdd391de4024fab Jul 15 13:34:04.432439 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:04.432413 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 13:34:04.859078 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:04.859032 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5pmdp" event={"ID":"6de5ed7c-2327-4120-ae44-dc1d8a46ff5d","Type":"ContainerStarted","Data":"3e5805fb20db4374a329de747229df8062fe74593f665b6babdd391de4024fab"} Jul 15 13:34:06.870630 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:06.870572 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5pmdp" event={"ID":"6de5ed7c-2327-4120-ae44-dc1d8a46ff5d","Type":"ContainerStarted","Data":"bb59e12f5e148c85c7a31812dcd55760caef4ab7ce66bd65b6f1767868d6da3b"} Jul 15 13:34:06.891257 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:06.891200 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5pmdp" podStartSLOduration=2.240678728 podStartE2EDuration="3.891181505s" totalImagesPullingTime="1.650502777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:34:06.889262686 +0000 UTC m=+307.008824702" watchObservedRunningTime="2026-07-15 13:34:06.891181505 +0000 UTC m=+307.010743523" Jul 15 13:34:09.579389 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:09.579350 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7"] Jul 15 13:34:09.582863 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:09.582847 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7" Jul 15 13:34:09.585879 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:09.585859 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 13:34:09.587101 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:09.587068 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fcjpt\"" Jul 15 13:34:09.587214 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:09.587076 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 13:34:09.592529 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:09.592506 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7"] Jul 15 13:34:09.666977 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:09.666943 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gqxv\" (UniqueName: \"kubernetes.io/projected/cada9909-adfd-4d14-8e0a-337f9ff74574-kube-api-access-2gqxv\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7\" (UID: \"cada9909-adfd-4d14-8e0a-337f9ff74574\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7" Jul 15 13:34:09.667159 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:09.666995 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cada9909-adfd-4d14-8e0a-337f9ff74574-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7\" (UID: \"cada9909-adfd-4d14-8e0a-337f9ff74574\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7" Jul 15 13:34:09.667159 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:09.667021 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cada9909-adfd-4d14-8e0a-337f9ff74574-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7\" (UID: \"cada9909-adfd-4d14-8e0a-337f9ff74574\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7" Jul 15 13:34:09.767935 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:09.767900 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gqxv\" (UniqueName: \"kubernetes.io/projected/cada9909-adfd-4d14-8e0a-337f9ff74574-kube-api-access-2gqxv\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7\" (UID: \"cada9909-adfd-4d14-8e0a-337f9ff74574\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7" Jul 15 13:34:09.768095 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:09.767953 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cada9909-adfd-4d14-8e0a-337f9ff74574-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7\" (UID: \"cada9909-adfd-4d14-8e0a-337f9ff74574\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7" Jul 15 13:34:09.768095 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:09.767972 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cada9909-adfd-4d14-8e0a-337f9ff74574-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7\" (UID: \"cada9909-adfd-4d14-8e0a-337f9ff74574\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7" Jul 15 13:34:09.768420 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:09.768397 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cada9909-adfd-4d14-8e0a-337f9ff74574-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7\" (UID: \"cada9909-adfd-4d14-8e0a-337f9ff74574\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7" Jul 15 13:34:09.768461 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:09.768404 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cada9909-adfd-4d14-8e0a-337f9ff74574-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7\" (UID: \"cada9909-adfd-4d14-8e0a-337f9ff74574\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7" Jul 15 13:34:09.777315 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:09.777287 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gqxv\" (UniqueName: \"kubernetes.io/projected/cada9909-adfd-4d14-8e0a-337f9ff74574-kube-api-access-2gqxv\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7\" (UID: \"cada9909-adfd-4d14-8e0a-337f9ff74574\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7" Jul 15 13:34:09.892798 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:09.892714 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7" Jul 15 13:34:10.033456 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:10.033427 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7"] Jul 15 13:34:10.035904 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:34:10.035875 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcada9909_adfd_4d14_8e0a_337f9ff74574.slice/crio-5c635719bc69c4a2488fa4067442663bb7e1ac8eb7b3fbbee04767ab4c0a4c80 WatchSource:0}: Error finding container 5c635719bc69c4a2488fa4067442663bb7e1ac8eb7b3fbbee04767ab4c0a4c80: Status 404 returned error can't find the container with id 5c635719bc69c4a2488fa4067442663bb7e1ac8eb7b3fbbee04767ab4c0a4c80 Jul 15 13:34:10.889343 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:10.889311 2558 generic.go:356] "Generic (PLEG): container finished" podID="cada9909-adfd-4d14-8e0a-337f9ff74574" containerID="eca41034ba6ebe60094085ae76071d5f78acfb6fe2dfaf9f4872fb261a2a81f2" exitCode=0 Jul 15 13:34:10.889749 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:10.889365 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7" event={"ID":"cada9909-adfd-4d14-8e0a-337f9ff74574","Type":"ContainerDied","Data":"eca41034ba6ebe60094085ae76071d5f78acfb6fe2dfaf9f4872fb261a2a81f2"} Jul 15 13:34:10.889749 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:10.889419 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7" event={"ID":"cada9909-adfd-4d14-8e0a-337f9ff74574","Type":"ContainerStarted","Data":"5c635719bc69c4a2488fa4067442663bb7e1ac8eb7b3fbbee04767ab4c0a4c80"} Jul 15 13:34:12.900033 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:12.900000 2558 generic.go:356] "Generic (PLEG): container finished" podID="cada9909-adfd-4d14-8e0a-337f9ff74574" containerID="adaa41cfa62c83b17d5c4b75f1a0fb45cfe524b323bb6b65c37917f578e3f6f2" exitCode=0 Jul 15 13:34:12.900434 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:12.900066 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7" event={"ID":"cada9909-adfd-4d14-8e0a-337f9ff74574","Type":"ContainerDied","Data":"adaa41cfa62c83b17d5c4b75f1a0fb45cfe524b323bb6b65c37917f578e3f6f2"} Jul 15 13:34:13.906311 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:13.906280 2558 generic.go:356] "Generic (PLEG): container finished" podID="cada9909-adfd-4d14-8e0a-337f9ff74574" containerID="87c6e0ddd9c405676ef7982637260930226b8b611c5f32d2151f089942606681" exitCode=0 Jul 15 13:34:13.906709 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:13.906342 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7" event={"ID":"cada9909-adfd-4d14-8e0a-337f9ff74574","Type":"ContainerDied","Data":"87c6e0ddd9c405676ef7982637260930226b8b611c5f32d2151f089942606681"} Jul 15 13:34:15.032953 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:15.032929 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7" Jul 15 13:34:15.112230 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:15.112122 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gqxv\" (UniqueName: \"kubernetes.io/projected/cada9909-adfd-4d14-8e0a-337f9ff74574-kube-api-access-2gqxv\") pod \"cada9909-adfd-4d14-8e0a-337f9ff74574\" (UID: \"cada9909-adfd-4d14-8e0a-337f9ff74574\") " Jul 15 13:34:15.112421 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:15.112273 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cada9909-adfd-4d14-8e0a-337f9ff74574-util\") pod \"cada9909-adfd-4d14-8e0a-337f9ff74574\" (UID: \"cada9909-adfd-4d14-8e0a-337f9ff74574\") " Jul 15 13:34:15.112421 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:15.112303 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cada9909-adfd-4d14-8e0a-337f9ff74574-bundle\") pod \"cada9909-adfd-4d14-8e0a-337f9ff74574\" (UID: \"cada9909-adfd-4d14-8e0a-337f9ff74574\") " Jul 15 13:34:15.113013 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:15.112991 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cada9909-adfd-4d14-8e0a-337f9ff74574-bundle" (OuterVolumeSpecName: "bundle") pod "cada9909-adfd-4d14-8e0a-337f9ff74574" (UID: "cada9909-adfd-4d14-8e0a-337f9ff74574"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:34:15.114216 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:15.114184 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cada9909-adfd-4d14-8e0a-337f9ff74574-kube-api-access-2gqxv" (OuterVolumeSpecName: "kube-api-access-2gqxv") pod "cada9909-adfd-4d14-8e0a-337f9ff74574" (UID: "cada9909-adfd-4d14-8e0a-337f9ff74574"). InnerVolumeSpecName "kube-api-access-2gqxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:34:15.118147 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:15.118123 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cada9909-adfd-4d14-8e0a-337f9ff74574-util" (OuterVolumeSpecName: "util") pod "cada9909-adfd-4d14-8e0a-337f9ff74574" (UID: "cada9909-adfd-4d14-8e0a-337f9ff74574"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:34:15.213298 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:15.213253 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gqxv\" (UniqueName: \"kubernetes.io/projected/cada9909-adfd-4d14-8e0a-337f9ff74574-kube-api-access-2gqxv\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:34:15.213298 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:15.213285 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cada9909-adfd-4d14-8e0a-337f9ff74574-util\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:34:15.213298 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:15.213295 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cada9909-adfd-4d14-8e0a-337f9ff74574-bundle\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:34:15.916863 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:15.916835 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7" Jul 15 13:34:15.917034 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:15.916834 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhs9j7" event={"ID":"cada9909-adfd-4d14-8e0a-337f9ff74574","Type":"ContainerDied","Data":"5c635719bc69c4a2488fa4067442663bb7e1ac8eb7b3fbbee04767ab4c0a4c80"} Jul 15 13:34:15.917034 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:15.916958 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c635719bc69c4a2488fa4067442663bb7e1ac8eb7b3fbbee04767ab4c0a4c80" Jul 15 13:34:22.757366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.757332 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw"] Jul 15 13:34:22.757843 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.757624 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cada9909-adfd-4d14-8e0a-337f9ff74574" containerName="extract" Jul 15 13:34:22.757843 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.757635 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cada9909-adfd-4d14-8e0a-337f9ff74574" containerName="extract" Jul 15 13:34:22.757843 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.757644 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cada9909-adfd-4d14-8e0a-337f9ff74574" containerName="pull" Jul 15 13:34:22.757843 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.757649 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cada9909-adfd-4d14-8e0a-337f9ff74574" containerName="pull" Jul 15 13:34:22.757843 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.757666 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cada9909-adfd-4d14-8e0a-337f9ff74574" containerName="util" Jul 15 13:34:22.757843 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.757672 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cada9909-adfd-4d14-8e0a-337f9ff74574" containerName="util" Jul 15 13:34:22.757843 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.757721 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="cada9909-adfd-4d14-8e0a-337f9ff74574" containerName="extract" Jul 15 13:34:22.759663 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.759647 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw" Jul 15 13:34:22.763365 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.763347 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 13:34:22.763513 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.763458 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 13:34:22.763613 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.763583 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 13:34:22.764455 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.764439 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 13:34:22.764695 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.764682 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cp25j\"" Jul 15 13:34:22.781916 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.781887 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw"] Jul 15 13:34:22.875471 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.875429 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84978f4d9d-92pvw\" (UID: \"d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3\") " pod="opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw" Jul 15 13:34:22.875471 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.875474 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3-manifests\") pod \"opendatahub-operator-controller-manager-84978f4d9d-92pvw\" (UID: \"d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3\") " pod="opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw" Jul 15 13:34:22.875761 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.875551 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3-webhook-cert\") pod \"opendatahub-operator-controller-manager-84978f4d9d-92pvw\" (UID: \"d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3\") " pod="opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw" Jul 15 13:34:22.875761 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.875573 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hprjz\" (UniqueName: \"kubernetes.io/projected/d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3-kube-api-access-hprjz\") pod \"opendatahub-operator-controller-manager-84978f4d9d-92pvw\" (UID: \"d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3\") " pod="opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw" Jul 15 13:34:22.875761 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.875634 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3-tmp\") pod \"opendatahub-operator-controller-manager-84978f4d9d-92pvw\" (UID: \"d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3\") " pod="opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw" Jul 15 13:34:22.976736 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.976699 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3-tmp\") pod \"opendatahub-operator-controller-manager-84978f4d9d-92pvw\" (UID: \"d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3\") " pod="opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw" Jul 15 13:34:22.976943 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.976777 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84978f4d9d-92pvw\" (UID: \"d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3\") " pod="opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw" Jul 15 13:34:22.976943 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.976804 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3-manifests\") pod \"opendatahub-operator-controller-manager-84978f4d9d-92pvw\" (UID: \"d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3\") " pod="opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw" Jul 15 13:34:22.976943 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.976847 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3-webhook-cert\") pod \"opendatahub-operator-controller-manager-84978f4d9d-92pvw\" (UID: \"d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3\") " pod="opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw" Jul 15 13:34:22.976943 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.976872 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hprjz\" (UniqueName: \"kubernetes.io/projected/d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3-kube-api-access-hprjz\") pod \"opendatahub-operator-controller-manager-84978f4d9d-92pvw\" (UID: \"d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3\") " pod="opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw" Jul 15 13:34:22.977210 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.977176 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3-manifests\") pod \"opendatahub-operator-controller-manager-84978f4d9d-92pvw\" (UID: \"d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3\") " pod="opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw" Jul 15 13:34:22.979159 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.979134 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3-tmp\") pod \"opendatahub-operator-controller-manager-84978f4d9d-92pvw\" (UID: \"d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3\") " pod="opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw" Jul 15 13:34:22.979253 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.979204 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84978f4d9d-92pvw\" (UID: \"d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3\") " pod="opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw" Jul 15 13:34:22.979293 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.979270 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3-webhook-cert\") pod \"opendatahub-operator-controller-manager-84978f4d9d-92pvw\" (UID: \"d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3\") " pod="opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw" Jul 15 13:34:22.988835 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:22.988809 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hprjz\" (UniqueName: \"kubernetes.io/projected/d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3-kube-api-access-hprjz\") pod \"opendatahub-operator-controller-manager-84978f4d9d-92pvw\" (UID: \"d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3\") " pod="opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw" Jul 15 13:34:23.070192 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:23.070102 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw" Jul 15 13:34:23.210537 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:23.210509 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw"] Jul 15 13:34:23.213239 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:34:23.213213 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9f8b1b6_1a6b_45d1_8e4f_dca805d134b3.slice/crio-b64b072085c692c5ef2ab92c909434d64059ec420cb6a53bffd15ca10f47470f WatchSource:0}: Error finding container b64b072085c692c5ef2ab92c909434d64059ec420cb6a53bffd15ca10f47470f: Status 404 returned error can't find the container with id b64b072085c692c5ef2ab92c909434d64059ec420cb6a53bffd15ca10f47470f Jul 15 13:34:23.954489 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:23.954458 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw" event={"ID":"d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3","Type":"ContainerStarted","Data":"b64b072085c692c5ef2ab92c909434d64059ec420cb6a53bffd15ca10f47470f"} Jul 15 13:34:26.971915 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:26.971877 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw" event={"ID":"d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3","Type":"ContainerStarted","Data":"3f80217cf152bdf3d8f748a012af52a2decc824532552604189eee24b4b0eb3c"} Jul 15 13:34:27.978620 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:27.978572 2558 generic.go:356] "Generic (PLEG): container finished" podID="d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3" containerID="3f80217cf152bdf3d8f748a012af52a2decc824532552604189eee24b4b0eb3c" exitCode=0 Jul 15 13:34:27.978948 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:27.978634 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw" event={"ID":"d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3","Type":"ContainerDied","Data":"3f80217cf152bdf3d8f748a012af52a2decc824532552604189eee24b4b0eb3c"} Jul 15 13:34:28.984924 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:28.984888 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw" event={"ID":"d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3","Type":"ContainerStarted","Data":"110685cf12eccd4b60d2d730afc414ab0ffda9c3156991e4cb871cd2ff35f74f"} Jul 15 13:34:28.985296 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:28.985007 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw" Jul 15 13:34:29.014119 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:29.014062 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw" podStartSLOduration=1.91983689 podStartE2EDuration="7.014044133s" totalImagesPullingTime="4.02561158s" totalInitContainerRuntime="1.068595663s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:34:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:34:29.013978338 +0000 UTC m=+329.133540349" watchObservedRunningTime="2026-07-15 13:34:29.014044133 +0000 UTC m=+329.133606151" Jul 15 13:34:39.993188 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:39.993154 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-84978f4d9d-92pvw" Jul 15 13:34:42.447723 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:42.447689 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-74d75685f8-jv6pl"] Jul 15 13:34:42.456543 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:42.456518 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-74d75685f8-jv6pl" Jul 15 13:34:42.461503 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:42.461467 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 15 13:34:42.461503 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:42.461483 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-492d4\"" Jul 15 13:34:42.461764 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:42.461542 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 15 13:34:42.461907 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:42.461892 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 15 13:34:42.470360 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:42.470332 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-74d75685f8-jv6pl"] Jul 15 13:34:42.545481 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:42.545447 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b6815a6f-6782-4b35-8c18-f9f2fb019fa0-manager-config\") pod \"lws-controller-manager-74d75685f8-jv6pl\" (UID: \"b6815a6f-6782-4b35-8c18-f9f2fb019fa0\") " pod="openshift-lws-operator/lws-controller-manager-74d75685f8-jv6pl" Jul 15 13:34:42.545674 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:42.545502 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6815a6f-6782-4b35-8c18-f9f2fb019fa0-cert\") pod \"lws-controller-manager-74d75685f8-jv6pl\" (UID: \"b6815a6f-6782-4b35-8c18-f9f2fb019fa0\") " pod="openshift-lws-operator/lws-controller-manager-74d75685f8-jv6pl" Jul 15 13:34:42.545674 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:42.545570 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b6815a6f-6782-4b35-8c18-f9f2fb019fa0-metrics-cert\") pod \"lws-controller-manager-74d75685f8-jv6pl\" (UID: \"b6815a6f-6782-4b35-8c18-f9f2fb019fa0\") " pod="openshift-lws-operator/lws-controller-manager-74d75685f8-jv6pl" Jul 15 13:34:42.545674 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:42.545633 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjdh8\" (UniqueName: \"kubernetes.io/projected/b6815a6f-6782-4b35-8c18-f9f2fb019fa0-kube-api-access-vjdh8\") pod \"lws-controller-manager-74d75685f8-jv6pl\" (UID: \"b6815a6f-6782-4b35-8c18-f9f2fb019fa0\") " pod="openshift-lws-operator/lws-controller-manager-74d75685f8-jv6pl" Jul 15 13:34:42.646784 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:42.646740 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6815a6f-6782-4b35-8c18-f9f2fb019fa0-cert\") pod \"lws-controller-manager-74d75685f8-jv6pl\" (UID: \"b6815a6f-6782-4b35-8c18-f9f2fb019fa0\") " pod="openshift-lws-operator/lws-controller-manager-74d75685f8-jv6pl" Jul 15 13:34:42.646784 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:42.646783 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b6815a6f-6782-4b35-8c18-f9f2fb019fa0-metrics-cert\") pod \"lws-controller-manager-74d75685f8-jv6pl\" (UID: \"b6815a6f-6782-4b35-8c18-f9f2fb019fa0\") " pod="openshift-lws-operator/lws-controller-manager-74d75685f8-jv6pl" Jul 15 13:34:42.647061 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:42.646814 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjdh8\" (UniqueName: \"kubernetes.io/projected/b6815a6f-6782-4b35-8c18-f9f2fb019fa0-kube-api-access-vjdh8\") pod \"lws-controller-manager-74d75685f8-jv6pl\" (UID: \"b6815a6f-6782-4b35-8c18-f9f2fb019fa0\") " pod="openshift-lws-operator/lws-controller-manager-74d75685f8-jv6pl" Jul 15 13:34:42.647061 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:42.646894 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b6815a6f-6782-4b35-8c18-f9f2fb019fa0-manager-config\") pod \"lws-controller-manager-74d75685f8-jv6pl\" (UID: \"b6815a6f-6782-4b35-8c18-f9f2fb019fa0\") " pod="openshift-lws-operator/lws-controller-manager-74d75685f8-jv6pl" Jul 15 13:34:42.647752 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:42.647717 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b6815a6f-6782-4b35-8c18-f9f2fb019fa0-manager-config\") pod \"lws-controller-manager-74d75685f8-jv6pl\" (UID: \"b6815a6f-6782-4b35-8c18-f9f2fb019fa0\") " pod="openshift-lws-operator/lws-controller-manager-74d75685f8-jv6pl" Jul 15 13:34:42.649636 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:42.649584 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b6815a6f-6782-4b35-8c18-f9f2fb019fa0-metrics-cert\") pod \"lws-controller-manager-74d75685f8-jv6pl\" (UID: \"b6815a6f-6782-4b35-8c18-f9f2fb019fa0\") " pod="openshift-lws-operator/lws-controller-manager-74d75685f8-jv6pl" Jul 15 13:34:42.649755 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:42.649590 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6815a6f-6782-4b35-8c18-f9f2fb019fa0-cert\") pod \"lws-controller-manager-74d75685f8-jv6pl\" (UID: \"b6815a6f-6782-4b35-8c18-f9f2fb019fa0\") " pod="openshift-lws-operator/lws-controller-manager-74d75685f8-jv6pl" Jul 15 13:34:42.669427 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:42.669394 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjdh8\" (UniqueName: \"kubernetes.io/projected/b6815a6f-6782-4b35-8c18-f9f2fb019fa0-kube-api-access-vjdh8\") pod \"lws-controller-manager-74d75685f8-jv6pl\" (UID: \"b6815a6f-6782-4b35-8c18-f9f2fb019fa0\") " pod="openshift-lws-operator/lws-controller-manager-74d75685f8-jv6pl" Jul 15 13:34:42.767458 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:42.767354 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-74d75685f8-jv6pl" Jul 15 13:34:42.969491 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:34:42.969461 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6815a6f_6782_4b35_8c18_f9f2fb019fa0.slice/crio-655cc9395c7018036b3e3955d2c9564d63949c95fe809737d9a833b9b6ee51c7 WatchSource:0}: Error finding container 655cc9395c7018036b3e3955d2c9564d63949c95fe809737d9a833b9b6ee51c7: Status 404 returned error can't find the container with id 655cc9395c7018036b3e3955d2c9564d63949c95fe809737d9a833b9b6ee51c7 Jul 15 13:34:42.984420 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:42.984391 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-74d75685f8-jv6pl"] Jul 15 13:34:43.048254 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:43.048166 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-74d75685f8-jv6pl" event={"ID":"b6815a6f-6782-4b35-8c18-f9f2fb019fa0","Type":"ContainerStarted","Data":"655cc9395c7018036b3e3955d2c9564d63949c95fe809737d9a833b9b6ee51c7"} Jul 15 13:34:45.060110 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:45.060067 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-74d75685f8-jv6pl" event={"ID":"b6815a6f-6782-4b35-8c18-f9f2fb019fa0","Type":"ContainerStarted","Data":"fa4a52549cf040a8f603a82ec16a9b5cf3e37d58c6fe1b3a22d6bde85522870d"} Jul 15 13:34:45.060576 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:45.060217 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-74d75685f8-jv6pl" Jul 15 13:34:45.079397 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:45.079338 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-74d75685f8-jv6pl" podStartSLOduration=1.490249554 podStartE2EDuration="3.07932119s" totalImagesPullingTime="1.589071636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:34:45.078537987 +0000 UTC m=+345.198100007" watchObservedRunningTime="2026-07-15 13:34:45.07932119 +0000 UTC m=+345.198883209" Jul 15 13:34:50.949925 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:50.949890 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z"] Jul 15 13:34:50.954678 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:50.954653 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:50.959800 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:50.959775 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-l4v4k\"" Jul 15 13:34:50.960269 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:50.960254 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 15 13:34:50.969783 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:50.969759 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z"] Jul 15 13:34:51.104850 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.104809 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx"] Jul 15 13:34:51.108903 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.108864 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.118401 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.118366 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.118548 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.118408 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.118548 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.118470 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.118548 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.118500 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.118548 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.118532 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.118828 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.118561 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.118828 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.118582 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sds9l\" (UniqueName: \"kubernetes.io/projected/e1afdf25-cc0c-4985-a560-0fa96d3797b5-kube-api-access-sds9l\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.118828 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.118693 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.118828 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.118731 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.132262 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.132224 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx"] Jul 15 13:34:51.219446 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.219351 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3895ff6-6580-4cdc-b6d8-4de2fae59247-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.219446 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.219404 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.219446 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.219422 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.219769 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.219501 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3895ff6-6580-4cdc-b6d8-4de2fae59247-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.219769 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.219551 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.219769 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.219576 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3895ff6-6580-4cdc-b6d8-4de2fae59247-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.219769 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.219664 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.219769 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.219693 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sds9l\" (UniqueName: \"kubernetes.io/projected/e1afdf25-cc0c-4985-a560-0fa96d3797b5-kube-api-access-sds9l\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.219769 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.219718 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3895ff6-6580-4cdc-b6d8-4de2fae59247-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.219769 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.219772 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3895ff6-6580-4cdc-b6d8-4de2fae59247-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.220116 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.219797 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3895ff6-6580-4cdc-b6d8-4de2fae59247-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.220116 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.219824 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.220116 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.219849 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.220116 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.219874 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8p9c\" (UniqueName: \"kubernetes.io/projected/c3895ff6-6580-4cdc-b6d8-4de2fae59247-kube-api-access-c8p9c\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.220116 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.219931 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.220116 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.219965 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.220116 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.219988 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3895ff6-6580-4cdc-b6d8-4de2fae59247-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.220116 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.220015 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3895ff6-6580-4cdc-b6d8-4de2fae59247-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.220116 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.220043 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.220116 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.220068 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.220538 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.220145 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.220538 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.220280 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.220631 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.220587 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.222121 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.222099 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.222575 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.222558 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.232354 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.232321 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.232487 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.232466 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sds9l\" (UniqueName: \"kubernetes.io/projected/e1afdf25-cc0c-4985-a560-0fa96d3797b5-kube-api-access-sds9l\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.266236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.266203 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:51.321487 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.321455 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3895ff6-6580-4cdc-b6d8-4de2fae59247-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.321703 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.321508 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3895ff6-6580-4cdc-b6d8-4de2fae59247-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.321703 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.321534 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3895ff6-6580-4cdc-b6d8-4de2fae59247-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.321703 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.321558 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8p9c\" (UniqueName: \"kubernetes.io/projected/c3895ff6-6580-4cdc-b6d8-4de2fae59247-kube-api-access-c8p9c\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.321703 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.321638 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3895ff6-6580-4cdc-b6d8-4de2fae59247-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.321703 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.321666 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3895ff6-6580-4cdc-b6d8-4de2fae59247-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.321703 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.321691 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3895ff6-6580-4cdc-b6d8-4de2fae59247-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.322004 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.321734 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3895ff6-6580-4cdc-b6d8-4de2fae59247-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.322004 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.321765 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3895ff6-6580-4cdc-b6d8-4de2fae59247-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.322217 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.322197 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3895ff6-6580-4cdc-b6d8-4de2fae59247-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.322595 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.322419 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3895ff6-6580-4cdc-b6d8-4de2fae59247-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.322800 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.322761 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3895ff6-6580-4cdc-b6d8-4de2fae59247-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.322900 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.322886 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3895ff6-6580-4cdc-b6d8-4de2fae59247-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.323047 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.323024 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3895ff6-6580-4cdc-b6d8-4de2fae59247-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.324864 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.324841 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3895ff6-6580-4cdc-b6d8-4de2fae59247-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.325045 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.325027 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3895ff6-6580-4cdc-b6d8-4de2fae59247-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.332677 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.332644 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3895ff6-6580-4cdc-b6d8-4de2fae59247-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.332779 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.332644 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8p9c\" (UniqueName: \"kubernetes.io/projected/c3895ff6-6580-4cdc-b6d8-4de2fae59247-kube-api-access-c8p9c\") pod \"data-science-gateway-data-science-gateway-class-6576859cf495zfx\" (UID: \"c3895ff6-6580-4cdc-b6d8-4de2fae59247\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.420762 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.420726 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:51.429374 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.429348 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z"] Jul 15 13:34:51.431556 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:34:51.431531 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1afdf25_cc0c_4985_a560_0fa96d3797b5.slice/crio-9a0d2846a1afa53a378c1830741609810b84485f4057a4624f35f7cdc5592bca WatchSource:0}: Error finding container 9a0d2846a1afa53a378c1830741609810b84485f4057a4624f35f7cdc5592bca: Status 404 returned error can't find the container with id 9a0d2846a1afa53a378c1830741609810b84485f4057a4624f35f7cdc5592bca Jul 15 13:34:51.604197 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:51.604160 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx"] Jul 15 13:34:51.608284 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:34:51.608249 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3895ff6_6580_4cdc_b6d8_4de2fae59247.slice/crio-f427077b03320ad1d4c7e762102adf12a82678b1c606d57992b83ed6987ba29a WatchSource:0}: Error finding container f427077b03320ad1d4c7e762102adf12a82678b1c606d57992b83ed6987ba29a: Status 404 returned error can't find the container with id f427077b03320ad1d4c7e762102adf12a82678b1c606d57992b83ed6987ba29a Jul 15 13:34:52.097621 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:52.097561 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" event={"ID":"c3895ff6-6580-4cdc-b6d8-4de2fae59247","Type":"ContainerStarted","Data":"f427077b03320ad1d4c7e762102adf12a82678b1c606d57992b83ed6987ba29a"} Jul 15 13:34:52.099549 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:52.099489 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" event={"ID":"e1afdf25-cc0c-4985-a560-0fa96d3797b5","Type":"ContainerStarted","Data":"9a0d2846a1afa53a378c1830741609810b84485f4057a4624f35f7cdc5592bca"} Jul 15 13:34:54.423824 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:54.423797 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-97nx8"] Jul 15 13:34:54.426800 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:54.426779 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nx8" Jul 15 13:34:54.429748 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:54.429707 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 13:34:54.429848 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:54.429812 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 13:34:54.429895 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:54.429859 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 13:34:54.431310 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:54.431290 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 15 13:34:54.433356 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:54.433337 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-8wxl8\"" Jul 15 13:34:54.443009 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:54.442976 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 13:34:54.443125 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:54.443054 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 13:34:54.443125 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:54.443099 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 13:34:54.461711 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:54.461546 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb6zx\" (UniqueName: \"kubernetes.io/projected/a31756f1-d65a-4227-845b-c8c71d27fcc3-kube-api-access-kb6zx\") pod \"llmisvc-controller-manager-777c6bd7d5-97nx8\" (UID: \"a31756f1-d65a-4227-845b-c8c71d27fcc3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nx8" Jul 15 13:34:54.461711 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:54.461624 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a31756f1-d65a-4227-845b-c8c71d27fcc3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-97nx8\" (UID: \"a31756f1-d65a-4227-845b-c8c71d27fcc3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nx8" Jul 15 13:34:54.466660 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:54.466635 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-97nx8"] Jul 15 13:34:54.562840 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:54.562790 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb6zx\" (UniqueName: \"kubernetes.io/projected/a31756f1-d65a-4227-845b-c8c71d27fcc3-kube-api-access-kb6zx\") pod \"llmisvc-controller-manager-777c6bd7d5-97nx8\" (UID: \"a31756f1-d65a-4227-845b-c8c71d27fcc3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nx8" Jul 15 13:34:54.563022 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:54.562894 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a31756f1-d65a-4227-845b-c8c71d27fcc3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-97nx8\" (UID: \"a31756f1-d65a-4227-845b-c8c71d27fcc3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nx8" Jul 15 13:34:54.563088 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:34:54.563057 2558 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 15 13:34:54.563144 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:34:54.563130 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a31756f1-d65a-4227-845b-c8c71d27fcc3-cert podName:a31756f1-d65a-4227-845b-c8c71d27fcc3 nodeName:}" failed. No retries permitted until 2026-07-15 13:34:55.063110405 +0000 UTC m=+355.182672416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a31756f1-d65a-4227-845b-c8c71d27fcc3-cert") pod "llmisvc-controller-manager-777c6bd7d5-97nx8" (UID: "a31756f1-d65a-4227-845b-c8c71d27fcc3") : secret "llmisvc-webhook-server-cert" not found Jul 15 13:34:54.581666 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:54.580944 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb6zx\" (UniqueName: \"kubernetes.io/projected/a31756f1-d65a-4227-845b-c8c71d27fcc3-kube-api-access-kb6zx\") pod \"llmisvc-controller-manager-777c6bd7d5-97nx8\" (UID: \"a31756f1-d65a-4227-845b-c8c71d27fcc3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nx8" Jul 15 13:34:55.067238 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:55.067198 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a31756f1-d65a-4227-845b-c8c71d27fcc3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-97nx8\" (UID: \"a31756f1-d65a-4227-845b-c8c71d27fcc3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nx8" Jul 15 13:34:55.069880 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:55.069857 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a31756f1-d65a-4227-845b-c8c71d27fcc3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-97nx8\" (UID: \"a31756f1-d65a-4227-845b-c8c71d27fcc3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nx8" Jul 15 13:34:55.130001 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:55.129951 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" event={"ID":"c3895ff6-6580-4cdc-b6d8-4de2fae59247","Type":"ContainerStarted","Data":"bcc405b9a7c06d4c29550e1a2a398bbb0cf8393b94801da401b5a4e5f1541013"} Jul 15 13:34:55.131939 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:55.131909 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" event={"ID":"e1afdf25-cc0c-4985-a560-0fa96d3797b5","Type":"ContainerStarted","Data":"515f61f774ca97dd886b68b5aa6422fd520a6d3d4dcfa6d169aaf927dbccdc75"} Jul 15 13:34:55.155423 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:55.155368 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" podStartSLOduration=1.336281289 podStartE2EDuration="4.155351514s" totalImagesPullingTime="2.819070225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:34:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:34:55.153765246 +0000 UTC m=+355.273327264" watchObservedRunningTime="2026-07-15 13:34:55.155351514 +0000 UTC m=+355.274913533" Jul 15 13:34:55.180746 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:55.180680 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" podStartSLOduration=2.171535431 podStartE2EDuration="5.180656149s" totalImagesPullingTime="3.009120718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:34:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:34:55.180057947 +0000 UTC m=+355.299619966" watchObservedRunningTime="2026-07-15 13:34:55.180656149 +0000 UTC m=+355.300218166" Jul 15 13:34:55.266681 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:55.266641 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:34:55.268178 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:55.268146 2558 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 15 13:34:55.268327 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:55.268205 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" podUID="e1afdf25-cc0c-4985-a560-0fa96d3797b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 15 13:34:55.338492 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:55.338406 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nx8" Jul 15 13:34:55.421315 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:55.421281 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:55.426212 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:55.426149 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:55.700554 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:55.700522 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-97nx8"] Jul 15 13:34:55.704167 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:34:55.704131 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda31756f1_d65a_4227_845b_c8c71d27fcc3.slice/crio-84229c3c3188743adbe79ba711c86079bff5538c236f7a060c31cfccab309042 WatchSource:0}: Error finding container 84229c3c3188743adbe79ba711c86079bff5538c236f7a060c31cfccab309042: Status 404 returned error can't find the container with id 84229c3c3188743adbe79ba711c86079bff5538c236f7a060c31cfccab309042 Jul 15 13:34:56.068939 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:56.068852 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-74d75685f8-jv6pl" Jul 15 13:34:56.139753 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:56.139720 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nx8" event={"ID":"a31756f1-d65a-4227-845b-c8c71d27fcc3","Type":"ContainerStarted","Data":"84229c3c3188743adbe79ba711c86079bff5538c236f7a060c31cfccab309042"} Jul 15 13:34:56.140190 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:56.140166 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:56.141333 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:56.141312 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf495zfx" Jul 15 13:34:56.208628 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:56.208573 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z"] Jul 15 13:34:56.266940 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:56.266903 2558 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 15 13:34:56.267108 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:56.266977 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" podUID="e1afdf25-cc0c-4985-a560-0fa96d3797b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 15 13:34:57.267060 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:57.267016 2558 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 15 13:34:57.267449 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:57.267083 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" podUID="e1afdf25-cc0c-4985-a560-0fa96d3797b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 15 13:34:58.152872 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:34:58.152827 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" podUID="e1afdf25-cc0c-4985-a560-0fa96d3797b5" containerName="istio-proxy" containerID="cri-o://515f61f774ca97dd886b68b5aa6422fd520a6d3d4dcfa6d169aaf927dbccdc75" gracePeriod=30 Jul 15 13:35:00.166357 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:00.166257 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nx8" event={"ID":"a31756f1-d65a-4227-845b-c8c71d27fcc3","Type":"ContainerStarted","Data":"52856ebcd96400060ed5a42a4cdf0dda7ea5fec10c0a4c66cd28ab3fe9fe29fd"} Jul 15 13:35:00.166769 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:00.166425 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nx8" Jul 15 13:35:00.189421 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:00.189361 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nx8" podStartSLOduration=2.025829477 podStartE2EDuration="6.189345777s" totalImagesPullingTime="4.1635163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:34:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:35:00.188801578 +0000 UTC m=+360.308363597" watchObservedRunningTime="2026-07-15 13:35:00.189345777 +0000 UTC m=+360.308907807" Jul 15 13:35:03.391870 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.391843 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:35:03.440884 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.440850 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istio-podinfo\") pod \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " Jul 15 13:35:03.440884 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.440886 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-workload-certs\") pod \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " Jul 15 13:35:03.441131 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.440904 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-credential-socket\") pod \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " Jul 15 13:35:03.441131 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.440932 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sds9l\" (UniqueName: \"kubernetes.io/projected/e1afdf25-cc0c-4985-a560-0fa96d3797b5-kube-api-access-sds9l\") pod \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " Jul 15 13:35:03.441131 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.440961 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-workload-socket\") pod \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " Jul 15 13:35:03.441131 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.441018 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istiod-ca-cert\") pod \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " Jul 15 13:35:03.441131 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.441052 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istio-token\") pod \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " Jul 15 13:35:03.441131 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.441092 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istio-envoy\") pod \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " Jul 15 13:35:03.441131 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.441118 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istio-data\") pod \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\" (UID: \"e1afdf25-cc0c-4985-a560-0fa96d3797b5\") " Jul 15 13:35:03.441470 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.441194 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e1afdf25-cc0c-4985-a560-0fa96d3797b5" (UID: "e1afdf25-cc0c-4985-a560-0fa96d3797b5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:35:03.441470 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.441254 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e1afdf25-cc0c-4985-a560-0fa96d3797b5" (UID: "e1afdf25-cc0c-4985-a560-0fa96d3797b5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:35:03.441470 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.441420 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e1afdf25-cc0c-4985-a560-0fa96d3797b5" (UID: "e1afdf25-cc0c-4985-a560-0fa96d3797b5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:35:03.441632 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.441482 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-workload-certs\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:35:03.441632 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.441497 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istio-data" (OuterVolumeSpecName: "istio-data") pod "e1afdf25-cc0c-4985-a560-0fa96d3797b5" (UID: "e1afdf25-cc0c-4985-a560-0fa96d3797b5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:35:03.441632 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.441502 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-credential-socket\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:35:03.441771 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.441676 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e1afdf25-cc0c-4985-a560-0fa96d3797b5" (UID: "e1afdf25-cc0c-4985-a560-0fa96d3797b5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:35:03.443380 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.443356 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e1afdf25-cc0c-4985-a560-0fa96d3797b5" (UID: "e1afdf25-cc0c-4985-a560-0fa96d3797b5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 13:35:03.443503 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.443489 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1afdf25-cc0c-4985-a560-0fa96d3797b5-kube-api-access-sds9l" (OuterVolumeSpecName: "kube-api-access-sds9l") pod "e1afdf25-cc0c-4985-a560-0fa96d3797b5" (UID: "e1afdf25-cc0c-4985-a560-0fa96d3797b5"). InnerVolumeSpecName "kube-api-access-sds9l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:35:03.443621 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.443585 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istio-token" (OuterVolumeSpecName: "istio-token") pod "e1afdf25-cc0c-4985-a560-0fa96d3797b5" (UID: "e1afdf25-cc0c-4985-a560-0fa96d3797b5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:35:03.443697 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.443682 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e1afdf25-cc0c-4985-a560-0fa96d3797b5" (UID: "e1afdf25-cc0c-4985-a560-0fa96d3797b5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:35:03.542720 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.542684 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istio-podinfo\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:35:03.542720 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.542711 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sds9l\" (UniqueName: \"kubernetes.io/projected/e1afdf25-cc0c-4985-a560-0fa96d3797b5-kube-api-access-sds9l\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:35:03.542720 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.542720 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-workload-socket\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:35:03.542720 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.542729 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istiod-ca-cert\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:35:03.542720 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.542738 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istio-token\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:35:03.543141 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.542746 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istio-envoy\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:35:03.543141 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:03.542753 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1afdf25-cc0c-4985-a560-0fa96d3797b5-istio-data\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:35:04.188646 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:04.188583 2558 generic.go:356] "Generic (PLEG): container finished" podID="e1afdf25-cc0c-4985-a560-0fa96d3797b5" containerID="515f61f774ca97dd886b68b5aa6422fd520a6d3d4dcfa6d169aaf927dbccdc75" exitCode=0 Jul 15 13:35:04.188814 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:04.188661 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" Jul 15 13:35:04.188814 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:04.188671 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" event={"ID":"e1afdf25-cc0c-4985-a560-0fa96d3797b5","Type":"ContainerDied","Data":"515f61f774ca97dd886b68b5aa6422fd520a6d3d4dcfa6d169aaf927dbccdc75"} Jul 15 13:35:04.188814 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:04.188737 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z" event={"ID":"e1afdf25-cc0c-4985-a560-0fa96d3797b5","Type":"ContainerDied","Data":"9a0d2846a1afa53a378c1830741609810b84485f4057a4624f35f7cdc5592bca"} Jul 15 13:35:04.188814 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:04.188765 2558 scope.go:117] "RemoveContainer" containerID="515f61f774ca97dd886b68b5aa6422fd520a6d3d4dcfa6d169aaf927dbccdc75" Jul 15 13:35:04.198450 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:04.198432 2558 scope.go:117] "RemoveContainer" containerID="515f61f774ca97dd886b68b5aa6422fd520a6d3d4dcfa6d169aaf927dbccdc75" Jul 15 13:35:04.198801 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:35:04.198775 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"515f61f774ca97dd886b68b5aa6422fd520a6d3d4dcfa6d169aaf927dbccdc75\": container with ID starting with 515f61f774ca97dd886b68b5aa6422fd520a6d3d4dcfa6d169aaf927dbccdc75 not found: ID does not exist" containerID="515f61f774ca97dd886b68b5aa6422fd520a6d3d4dcfa6d169aaf927dbccdc75" Jul 15 13:35:04.198860 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:04.198811 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"515f61f774ca97dd886b68b5aa6422fd520a6d3d4dcfa6d169aaf927dbccdc75"} err="failed to get container status \"515f61f774ca97dd886b68b5aa6422fd520a6d3d4dcfa6d169aaf927dbccdc75\": rpc error: code = NotFound desc = could not find container \"515f61f774ca97dd886b68b5aa6422fd520a6d3d4dcfa6d169aaf927dbccdc75\": container with ID starting with 515f61f774ca97dd886b68b5aa6422fd520a6d3d4dcfa6d169aaf927dbccdc75 not found: ID does not exist" Jul 15 13:35:04.211590 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:04.211564 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z"] Jul 15 13:35:04.216082 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:04.216060 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-nfv8z"] Jul 15 13:35:04.479446 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:04.479369 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1afdf25-cc0c-4985-a560-0fa96d3797b5" path="/var/lib/kubelet/pods/e1afdf25-cc0c-4985-a560-0fa96d3797b5/volumes" Jul 15 13:35:31.174152 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:31.174122 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nx8" Jul 15 13:35:43.787327 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:43.787293 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zmj5p"] Jul 15 13:35:43.787728 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:43.787632 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1afdf25-cc0c-4985-a560-0fa96d3797b5" containerName="istio-proxy" Jul 15 13:35:43.787728 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:43.787644 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1afdf25-cc0c-4985-a560-0fa96d3797b5" containerName="istio-proxy" Jul 15 13:35:43.787728 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:43.787719 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1afdf25-cc0c-4985-a560-0fa96d3797b5" containerName="istio-proxy" Jul 15 13:35:43.795093 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:43.795061 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zmj5p" Jul 15 13:35:43.797750 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:43.797661 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-5qxjj\"" Jul 15 13:35:43.798911 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:43.798882 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 13:35:43.799035 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:43.798892 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 13:35:43.801452 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:43.801426 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zmj5p"] Jul 15 13:35:43.893787 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:43.893754 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9jww\" (UniqueName: \"kubernetes.io/projected/16547d11-59d8-462e-bec7-767ed0f22563-kube-api-access-w9jww\") pod \"kuadrant-operator-catalog-zmj5p\" (UID: \"16547d11-59d8-462e-bec7-767ed0f22563\") " pod="kuadrant-system/kuadrant-operator-catalog-zmj5p" Jul 15 13:35:43.994261 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:43.994221 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9jww\" (UniqueName: \"kubernetes.io/projected/16547d11-59d8-462e-bec7-767ed0f22563-kube-api-access-w9jww\") pod \"kuadrant-operator-catalog-zmj5p\" (UID: \"16547d11-59d8-462e-bec7-767ed0f22563\") " pod="kuadrant-system/kuadrant-operator-catalog-zmj5p" Jul 15 13:35:44.006413 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:44.006378 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9jww\" (UniqueName: \"kubernetes.io/projected/16547d11-59d8-462e-bec7-767ed0f22563-kube-api-access-w9jww\") pod \"kuadrant-operator-catalog-zmj5p\" (UID: \"16547d11-59d8-462e-bec7-767ed0f22563\") " pod="kuadrant-system/kuadrant-operator-catalog-zmj5p" Jul 15 13:35:44.106406 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:44.106320 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zmj5p" Jul 15 13:35:44.140075 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:44.140042 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zmj5p"] Jul 15 13:35:44.237975 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:44.237873 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zmj5p"] Jul 15 13:35:44.240436 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:35:44.240412 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16547d11_59d8_462e_bec7_767ed0f22563.slice/crio-f913ea4dbf273f0b98e3e9b293d748ef2656c337b1133776a068be9bf597a55b WatchSource:0}: Error finding container f913ea4dbf273f0b98e3e9b293d748ef2656c337b1133776a068be9bf597a55b: Status 404 returned error can't find the container with id f913ea4dbf273f0b98e3e9b293d748ef2656c337b1133776a068be9bf597a55b Jul 15 13:35:44.352226 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:44.352190 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p9k8q"] Jul 15 13:35:44.354931 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:44.354914 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-p9k8q" Jul 15 13:35:44.364943 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:44.364919 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p9k8q"] Jul 15 13:35:44.375461 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:44.375435 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zmj5p" event={"ID":"16547d11-59d8-462e-bec7-767ed0f22563","Type":"ContainerStarted","Data":"f913ea4dbf273f0b98e3e9b293d748ef2656c337b1133776a068be9bf597a55b"} Jul 15 13:35:44.396319 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:44.396285 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvzs7\" (UniqueName: \"kubernetes.io/projected/b6ef1293-4c65-40b4-b677-8b1afe31db33-kube-api-access-qvzs7\") pod \"kuadrant-operator-catalog-p9k8q\" (UID: \"b6ef1293-4c65-40b4-b677-8b1afe31db33\") " pod="kuadrant-system/kuadrant-operator-catalog-p9k8q" Jul 15 13:35:44.497288 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:44.497253 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvzs7\" (UniqueName: \"kubernetes.io/projected/b6ef1293-4c65-40b4-b677-8b1afe31db33-kube-api-access-qvzs7\") pod \"kuadrant-operator-catalog-p9k8q\" (UID: \"b6ef1293-4c65-40b4-b677-8b1afe31db33\") " pod="kuadrant-system/kuadrant-operator-catalog-p9k8q" Jul 15 13:35:44.506730 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:44.506697 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvzs7\" (UniqueName: \"kubernetes.io/projected/b6ef1293-4c65-40b4-b677-8b1afe31db33-kube-api-access-qvzs7\") pod \"kuadrant-operator-catalog-p9k8q\" (UID: \"b6ef1293-4c65-40b4-b677-8b1afe31db33\") " pod="kuadrant-system/kuadrant-operator-catalog-p9k8q" Jul 15 13:35:44.665101 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:44.665012 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-p9k8q" Jul 15 13:35:44.811023 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:44.810990 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p9k8q"] Jul 15 13:35:44.830959 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:35:44.830932 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6ef1293_4c65_40b4_b677_8b1afe31db33.slice/crio-417d390548718550395b50d9a8954f73d11bd3d8fbd30bfc93a3ab2a48faef66 WatchSource:0}: Error finding container 417d390548718550395b50d9a8954f73d11bd3d8fbd30bfc93a3ab2a48faef66: Status 404 returned error can't find the container with id 417d390548718550395b50d9a8954f73d11bd3d8fbd30bfc93a3ab2a48faef66 Jul 15 13:35:45.382984 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:45.382949 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-p9k8q" event={"ID":"b6ef1293-4c65-40b4-b677-8b1afe31db33","Type":"ContainerStarted","Data":"417d390548718550395b50d9a8954f73d11bd3d8fbd30bfc93a3ab2a48faef66"} Jul 15 13:35:46.389750 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:46.389717 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-p9k8q" event={"ID":"b6ef1293-4c65-40b4-b677-8b1afe31db33","Type":"ContainerStarted","Data":"5dd57aa99090dd034ce15644b7e079873606d4d2b977d41e1d829daa94a08551"} Jul 15 13:35:46.391398 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:46.391371 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zmj5p" event={"ID":"16547d11-59d8-462e-bec7-767ed0f22563","Type":"ContainerStarted","Data":"d56606b67afb0343292b268453a02b5b03e2b67ce37d25a0bfd04bc11e9b8294"} Jul 15 13:35:46.391511 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:46.391471 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-zmj5p" podUID="16547d11-59d8-462e-bec7-767ed0f22563" containerName="registry-server" containerID="cri-o://d56606b67afb0343292b268453a02b5b03e2b67ce37d25a0bfd04bc11e9b8294" gracePeriod=2 Jul 15 13:35:46.416335 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:46.416292 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-p9k8q" podStartSLOduration=0.958408575 podStartE2EDuration="2.416277018s" totalImagesPullingTime="1.457868443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:35:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:35:46.414886982 +0000 UTC m=+406.534449002" watchObservedRunningTime="2026-07-15 13:35:46.416277018 +0000 UTC m=+406.535839027" Jul 15 13:35:46.453344 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:46.453289 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zmj5p" podStartSLOduration=1.408662454 podStartE2EDuration="3.453272276s" totalImagesPullingTime="2.044609822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:35:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:35:46.453156868 +0000 UTC m=+406.572718888" watchObservedRunningTime="2026-07-15 13:35:46.453272276 +0000 UTC m=+406.572834295" Jul 15 13:35:46.630726 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:46.630698 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zmj5p_16547d11-59d8-462e-bec7-767ed0f22563/registry-server/0.log" Jul 15 13:35:46.633064 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:46.633049 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zmj5p" Jul 15 13:35:46.716912 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:46.716878 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9jww\" (UniqueName: \"kubernetes.io/projected/16547d11-59d8-462e-bec7-767ed0f22563-kube-api-access-w9jww\") pod \"16547d11-59d8-462e-bec7-767ed0f22563\" (UID: \"16547d11-59d8-462e-bec7-767ed0f22563\") " Jul 15 13:35:46.719001 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:46.718977 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16547d11-59d8-462e-bec7-767ed0f22563-kube-api-access-w9jww" (OuterVolumeSpecName: "kube-api-access-w9jww") pod "16547d11-59d8-462e-bec7-767ed0f22563" (UID: "16547d11-59d8-462e-bec7-767ed0f22563"). InnerVolumeSpecName "kube-api-access-w9jww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:35:46.818465 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:46.818371 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9jww\" (UniqueName: \"kubernetes.io/projected/16547d11-59d8-462e-bec7-767ed0f22563-kube-api-access-w9jww\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:35:47.397664 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:47.397633 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zmj5p_16547d11-59d8-462e-bec7-767ed0f22563/registry-server/0.log" Jul 15 13:35:47.398067 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:47.397679 2558 generic.go:356] "Generic (PLEG): container finished" podID="16547d11-59d8-462e-bec7-767ed0f22563" containerID="d56606b67afb0343292b268453a02b5b03e2b67ce37d25a0bfd04bc11e9b8294" exitCode=2 Jul 15 13:35:47.398067 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:47.397734 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zmj5p" Jul 15 13:35:47.398067 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:47.397768 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zmj5p" event={"ID":"16547d11-59d8-462e-bec7-767ed0f22563","Type":"ContainerDied","Data":"d56606b67afb0343292b268453a02b5b03e2b67ce37d25a0bfd04bc11e9b8294"} Jul 15 13:35:47.398067 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:47.397818 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zmj5p" event={"ID":"16547d11-59d8-462e-bec7-767ed0f22563","Type":"ContainerDied","Data":"f913ea4dbf273f0b98e3e9b293d748ef2656c337b1133776a068be9bf597a55b"} Jul 15 13:35:47.398067 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:47.397840 2558 scope.go:117] "RemoveContainer" containerID="d56606b67afb0343292b268453a02b5b03e2b67ce37d25a0bfd04bc11e9b8294" Jul 15 13:35:47.406488 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:47.406473 2558 scope.go:117] "RemoveContainer" containerID="d56606b67afb0343292b268453a02b5b03e2b67ce37d25a0bfd04bc11e9b8294" Jul 15 13:35:47.406748 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:35:47.406729 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d56606b67afb0343292b268453a02b5b03e2b67ce37d25a0bfd04bc11e9b8294\": container with ID starting with d56606b67afb0343292b268453a02b5b03e2b67ce37d25a0bfd04bc11e9b8294 not found: ID does not exist" containerID="d56606b67afb0343292b268453a02b5b03e2b67ce37d25a0bfd04bc11e9b8294" Jul 15 13:35:47.406793 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:47.406757 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d56606b67afb0343292b268453a02b5b03e2b67ce37d25a0bfd04bc11e9b8294"} err="failed to get container status \"d56606b67afb0343292b268453a02b5b03e2b67ce37d25a0bfd04bc11e9b8294\": rpc error: code = NotFound desc = could not find container \"d56606b67afb0343292b268453a02b5b03e2b67ce37d25a0bfd04bc11e9b8294\": container with ID starting with d56606b67afb0343292b268453a02b5b03e2b67ce37d25a0bfd04bc11e9b8294 not found: ID does not exist" Jul 15 13:35:47.423034 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:47.423014 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zmj5p"] Jul 15 13:35:47.427093 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:47.427069 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zmj5p"] Jul 15 13:35:48.478359 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:48.478327 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16547d11-59d8-462e-bec7-767ed0f22563" path="/var/lib/kubelet/pods/16547d11-59d8-462e-bec7-767ed0f22563/volumes" Jul 15 13:35:54.665326 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:54.665291 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-p9k8q" Jul 15 13:35:54.665784 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:54.665356 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-p9k8q" Jul 15 13:35:54.688136 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:54.688102 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-p9k8q" Jul 15 13:35:55.459243 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:35:55.459217 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-p9k8q" Jul 15 13:36:00.201081 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.201044 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-98b95d89b-zkbxt"] Jul 15 13:36:00.201576 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.201448 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16547d11-59d8-462e-bec7-767ed0f22563" containerName="registry-server" Jul 15 13:36:00.201576 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.201461 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="16547d11-59d8-462e-bec7-767ed0f22563" containerName="registry-server" Jul 15 13:36:00.201576 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.201517 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="16547d11-59d8-462e-bec7-767ed0f22563" containerName="registry-server" Jul 15 13:36:00.204479 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.204449 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:00.216989 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.216961 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-98b95d89b-zkbxt"] Jul 15 13:36:00.332727 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.332682 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61764a61-b244-4d87-b8f7-60e3475d704f-console-oauth-config\") pod \"console-98b95d89b-zkbxt\" (UID: \"61764a61-b244-4d87-b8f7-60e3475d704f\") " pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:00.332727 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.332720 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb5wv\" (UniqueName: \"kubernetes.io/projected/61764a61-b244-4d87-b8f7-60e3475d704f-kube-api-access-mb5wv\") pod \"console-98b95d89b-zkbxt\" (UID: \"61764a61-b244-4d87-b8f7-60e3475d704f\") " pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:00.332932 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.332745 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61764a61-b244-4d87-b8f7-60e3475d704f-console-serving-cert\") pod \"console-98b95d89b-zkbxt\" (UID: \"61764a61-b244-4d87-b8f7-60e3475d704f\") " pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:00.332932 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.332804 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61764a61-b244-4d87-b8f7-60e3475d704f-trusted-ca-bundle\") pod \"console-98b95d89b-zkbxt\" (UID: \"61764a61-b244-4d87-b8f7-60e3475d704f\") " pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:00.332932 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.332869 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61764a61-b244-4d87-b8f7-60e3475d704f-console-config\") pod \"console-98b95d89b-zkbxt\" (UID: \"61764a61-b244-4d87-b8f7-60e3475d704f\") " pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:00.332932 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.332889 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61764a61-b244-4d87-b8f7-60e3475d704f-service-ca\") pod \"console-98b95d89b-zkbxt\" (UID: \"61764a61-b244-4d87-b8f7-60e3475d704f\") " pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:00.333097 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.332942 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61764a61-b244-4d87-b8f7-60e3475d704f-oauth-serving-cert\") pod \"console-98b95d89b-zkbxt\" (UID: \"61764a61-b244-4d87-b8f7-60e3475d704f\") " pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:00.433395 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.433357 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61764a61-b244-4d87-b8f7-60e3475d704f-console-oauth-config\") pod \"console-98b95d89b-zkbxt\" (UID: \"61764a61-b244-4d87-b8f7-60e3475d704f\") " pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:00.433395 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.433387 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb5wv\" (UniqueName: \"kubernetes.io/projected/61764a61-b244-4d87-b8f7-60e3475d704f-kube-api-access-mb5wv\") pod \"console-98b95d89b-zkbxt\" (UID: \"61764a61-b244-4d87-b8f7-60e3475d704f\") " pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:00.433646 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.433407 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61764a61-b244-4d87-b8f7-60e3475d704f-console-serving-cert\") pod \"console-98b95d89b-zkbxt\" (UID: \"61764a61-b244-4d87-b8f7-60e3475d704f\") " pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:00.433646 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.433424 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61764a61-b244-4d87-b8f7-60e3475d704f-trusted-ca-bundle\") pod \"console-98b95d89b-zkbxt\" (UID: \"61764a61-b244-4d87-b8f7-60e3475d704f\") " pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:00.433646 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.433454 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61764a61-b244-4d87-b8f7-60e3475d704f-console-config\") pod \"console-98b95d89b-zkbxt\" (UID: \"61764a61-b244-4d87-b8f7-60e3475d704f\") " pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:00.433646 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.433470 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61764a61-b244-4d87-b8f7-60e3475d704f-service-ca\") pod \"console-98b95d89b-zkbxt\" (UID: \"61764a61-b244-4d87-b8f7-60e3475d704f\") " pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:00.433646 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.433496 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61764a61-b244-4d87-b8f7-60e3475d704f-oauth-serving-cert\") pod \"console-98b95d89b-zkbxt\" (UID: \"61764a61-b244-4d87-b8f7-60e3475d704f\") " pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:00.434275 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.434234 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61764a61-b244-4d87-b8f7-60e3475d704f-service-ca\") pod \"console-98b95d89b-zkbxt\" (UID: \"61764a61-b244-4d87-b8f7-60e3475d704f\") " pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:00.434379 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.434332 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61764a61-b244-4d87-b8f7-60e3475d704f-oauth-serving-cert\") pod \"console-98b95d89b-zkbxt\" (UID: \"61764a61-b244-4d87-b8f7-60e3475d704f\") " pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:00.434431 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.434414 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61764a61-b244-4d87-b8f7-60e3475d704f-trusted-ca-bundle\") pod \"console-98b95d89b-zkbxt\" (UID: \"61764a61-b244-4d87-b8f7-60e3475d704f\") " pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:00.434465 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.434445 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61764a61-b244-4d87-b8f7-60e3475d704f-console-config\") pod \"console-98b95d89b-zkbxt\" (UID: \"61764a61-b244-4d87-b8f7-60e3475d704f\") " pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:00.435905 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.435877 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61764a61-b244-4d87-b8f7-60e3475d704f-console-oauth-config\") pod \"console-98b95d89b-zkbxt\" (UID: \"61764a61-b244-4d87-b8f7-60e3475d704f\") " pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:00.436188 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.436170 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61764a61-b244-4d87-b8f7-60e3475d704f-console-serving-cert\") pod \"console-98b95d89b-zkbxt\" (UID: \"61764a61-b244-4d87-b8f7-60e3475d704f\") " pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:00.443073 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.443046 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb5wv\" (UniqueName: \"kubernetes.io/projected/61764a61-b244-4d87-b8f7-60e3475d704f-kube-api-access-mb5wv\") pod \"console-98b95d89b-zkbxt\" (UID: \"61764a61-b244-4d87-b8f7-60e3475d704f\") " pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:00.515159 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.515074 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:00.653765 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:00.653740 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-98b95d89b-zkbxt"] Jul 15 13:36:00.655661 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:36:00.655627 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61764a61_b244_4d87_b8f7_60e3475d704f.slice/crio-500e92ca9956618e81e9a5c2fe3ad2c9933085e12b7bc2d3bfc0218f8a38fd86 WatchSource:0}: Error finding container 500e92ca9956618e81e9a5c2fe3ad2c9933085e12b7bc2d3bfc0218f8a38fd86: Status 404 returned error can't find the container with id 500e92ca9956618e81e9a5c2fe3ad2c9933085e12b7bc2d3bfc0218f8a38fd86 Jul 15 13:36:01.467195 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:01.467153 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98b95d89b-zkbxt" event={"ID":"61764a61-b244-4d87-b8f7-60e3475d704f","Type":"ContainerStarted","Data":"4735812c7bcb595ecd16d4076375654f399b237072506e9279dc79d988acd5c2"} Jul 15 13:36:01.467594 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:01.467218 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98b95d89b-zkbxt" event={"ID":"61764a61-b244-4d87-b8f7-60e3475d704f","Type":"ContainerStarted","Data":"500e92ca9956618e81e9a5c2fe3ad2c9933085e12b7bc2d3bfc0218f8a38fd86"} Jul 15 13:36:01.490594 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:01.490544 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-98b95d89b-zkbxt" podStartSLOduration=1.490528501 podStartE2EDuration="1.490528501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:36:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:36:01.488866627 +0000 UTC m=+421.608428648" watchObservedRunningTime="2026-07-15 13:36:01.490528501 +0000 UTC m=+421.610090519" Jul 15 13:36:10.515269 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:10.515238 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:10.515877 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:10.515305 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:10.520916 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:10.520891 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:11.523193 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:11.523164 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-98b95d89b-zkbxt" Jul 15 13:36:11.577927 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:11.577891 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86f89c8b9c-l6d8m"] Jul 15 13:36:13.689037 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:13.688997 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d"] Jul 15 13:36:13.692924 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:13.692903 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d" Jul 15 13:36:13.695763 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:13.695743 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wd5w4\"" Jul 15 13:36:13.702097 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:13.702070 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d"] Jul 15 13:36:13.752237 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:13.752194 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db1aed43-29cc-4167-a979-5d8644e689b3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d\" (UID: \"db1aed43-29cc-4167-a979-5d8644e689b3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d" Jul 15 13:36:13.752417 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:13.752247 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67ssd\" (UniqueName: \"kubernetes.io/projected/db1aed43-29cc-4167-a979-5d8644e689b3-kube-api-access-67ssd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d\" (UID: \"db1aed43-29cc-4167-a979-5d8644e689b3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d" Jul 15 13:36:13.752417 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:13.752382 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db1aed43-29cc-4167-a979-5d8644e689b3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d\" (UID: \"db1aed43-29cc-4167-a979-5d8644e689b3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d" Jul 15 13:36:13.804881 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:13.804844 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j"] Jul 15 13:36:13.808432 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:13.808410 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j" Jul 15 13:36:13.817664 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:13.817623 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j"] Jul 15 13:36:13.853801 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:13.853763 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db1aed43-29cc-4167-a979-5d8644e689b3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d\" (UID: \"db1aed43-29cc-4167-a979-5d8644e689b3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d" Jul 15 13:36:13.853983 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:13.853817 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67ssd\" (UniqueName: \"kubernetes.io/projected/db1aed43-29cc-4167-a979-5d8644e689b3-kube-api-access-67ssd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d\" (UID: \"db1aed43-29cc-4167-a979-5d8644e689b3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d" Jul 15 13:36:13.853983 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:13.853872 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db1aed43-29cc-4167-a979-5d8644e689b3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d\" (UID: \"db1aed43-29cc-4167-a979-5d8644e689b3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d" Jul 15 13:36:13.854257 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:13.854241 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db1aed43-29cc-4167-a979-5d8644e689b3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d\" (UID: \"db1aed43-29cc-4167-a979-5d8644e689b3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d" Jul 15 13:36:13.854299 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:13.854239 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db1aed43-29cc-4167-a979-5d8644e689b3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d\" (UID: \"db1aed43-29cc-4167-a979-5d8644e689b3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d" Jul 15 13:36:13.863413 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:13.863377 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67ssd\" (UniqueName: \"kubernetes.io/projected/db1aed43-29cc-4167-a979-5d8644e689b3-kube-api-access-67ssd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d\" (UID: \"db1aed43-29cc-4167-a979-5d8644e689b3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d" Jul 15 13:36:13.955310 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:13.955206 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f569c5f0-be5d-4479-88d5-f5f2e2645e20-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j\" (UID: \"f569c5f0-be5d-4479-88d5-f5f2e2645e20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j" Jul 15 13:36:13.955310 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:13.955258 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f569c5f0-be5d-4479-88d5-f5f2e2645e20-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j\" (UID: \"f569c5f0-be5d-4479-88d5-f5f2e2645e20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j" Jul 15 13:36:13.955310 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:13.955280 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j28wf\" (UniqueName: \"kubernetes.io/projected/f569c5f0-be5d-4479-88d5-f5f2e2645e20-kube-api-access-j28wf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j\" (UID: \"f569c5f0-be5d-4479-88d5-f5f2e2645e20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j" Jul 15 13:36:14.003368 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.003328 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d" Jul 15 13:36:14.055868 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.055829 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f569c5f0-be5d-4479-88d5-f5f2e2645e20-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j\" (UID: \"f569c5f0-be5d-4479-88d5-f5f2e2645e20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j" Jul 15 13:36:14.056017 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.055878 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j28wf\" (UniqueName: \"kubernetes.io/projected/f569c5f0-be5d-4479-88d5-f5f2e2645e20-kube-api-access-j28wf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j\" (UID: \"f569c5f0-be5d-4479-88d5-f5f2e2645e20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j" Jul 15 13:36:14.056017 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.056006 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f569c5f0-be5d-4479-88d5-f5f2e2645e20-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j\" (UID: \"f569c5f0-be5d-4479-88d5-f5f2e2645e20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j" Jul 15 13:36:14.056416 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.056334 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f569c5f0-be5d-4479-88d5-f5f2e2645e20-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j\" (UID: \"f569c5f0-be5d-4479-88d5-f5f2e2645e20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j" Jul 15 13:36:14.056416 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.056368 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f569c5f0-be5d-4479-88d5-f5f2e2645e20-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j\" (UID: \"f569c5f0-be5d-4479-88d5-f5f2e2645e20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j" Jul 15 13:36:14.067406 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.067365 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j28wf\" (UniqueName: \"kubernetes.io/projected/f569c5f0-be5d-4479-88d5-f5f2e2645e20-kube-api-access-j28wf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j\" (UID: \"f569c5f0-be5d-4479-88d5-f5f2e2645e20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j" Jul 15 13:36:14.091727 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.091460 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz"] Jul 15 13:36:14.099233 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.099203 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz" Jul 15 13:36:14.105580 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.105550 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz"] Jul 15 13:36:14.119246 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.119204 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j" Jul 15 13:36:14.156481 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.156448 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e5d7159-0c90-477b-b211-096de53b6f3a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz\" (UID: \"2e5d7159-0c90-477b-b211-096de53b6f3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz" Jul 15 13:36:14.156701 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.156576 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrsr8\" (UniqueName: \"kubernetes.io/projected/2e5d7159-0c90-477b-b211-096de53b6f3a-kube-api-access-xrsr8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz\" (UID: \"2e5d7159-0c90-477b-b211-096de53b6f3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz" Jul 15 13:36:14.156701 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.156692 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e5d7159-0c90-477b-b211-096de53b6f3a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz\" (UID: \"2e5d7159-0c90-477b-b211-096de53b6f3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz" Jul 15 13:36:14.166656 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.166624 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d"] Jul 15 13:36:14.168893 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:36:14.168866 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1aed43_29cc_4167_a979_5d8644e689b3.slice/crio-c78dede7f24fc253375bfa5eacaf3c5147ba5f37d574f16f67687ac27062fc81 WatchSource:0}: Error finding container c78dede7f24fc253375bfa5eacaf3c5147ba5f37d574f16f67687ac27062fc81: Status 404 returned error can't find the container with id c78dede7f24fc253375bfa5eacaf3c5147ba5f37d574f16f67687ac27062fc81 Jul 15 13:36:14.257483 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.257454 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrsr8\" (UniqueName: \"kubernetes.io/projected/2e5d7159-0c90-477b-b211-096de53b6f3a-kube-api-access-xrsr8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz\" (UID: \"2e5d7159-0c90-477b-b211-096de53b6f3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz" Jul 15 13:36:14.257594 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.257532 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e5d7159-0c90-477b-b211-096de53b6f3a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz\" (UID: \"2e5d7159-0c90-477b-b211-096de53b6f3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz" Jul 15 13:36:14.257594 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.257569 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e5d7159-0c90-477b-b211-096de53b6f3a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz\" (UID: \"2e5d7159-0c90-477b-b211-096de53b6f3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz" Jul 15 13:36:14.257988 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.257963 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e5d7159-0c90-477b-b211-096de53b6f3a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz\" (UID: \"2e5d7159-0c90-477b-b211-096de53b6f3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz" Jul 15 13:36:14.258098 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.258018 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e5d7159-0c90-477b-b211-096de53b6f3a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz\" (UID: \"2e5d7159-0c90-477b-b211-096de53b6f3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz" Jul 15 13:36:14.266039 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.266009 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrsr8\" (UniqueName: \"kubernetes.io/projected/2e5d7159-0c90-477b-b211-096de53b6f3a-kube-api-access-xrsr8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz\" (UID: \"2e5d7159-0c90-477b-b211-096de53b6f3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz" Jul 15 13:36:14.274081 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.274058 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j"] Jul 15 13:36:14.276137 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:36:14.276115 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf569c5f0_be5d_4479_88d5_f5f2e2645e20.slice/crio-877243ee2d1a434e43a834437822d25639a4b5b03c9c349e8d9042fcc08313ba WatchSource:0}: Error finding container 877243ee2d1a434e43a834437822d25639a4b5b03c9c349e8d9042fcc08313ba: Status 404 returned error can't find the container with id 877243ee2d1a434e43a834437822d25639a4b5b03c9c349e8d9042fcc08313ba Jul 15 13:36:14.412845 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.412807 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz" Jul 15 13:36:14.487456 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.487422 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm"] Jul 15 13:36:14.491027 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.491005 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm" Jul 15 13:36:14.501428 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.501400 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm"] Jul 15 13:36:14.538827 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.538789 2558 generic.go:356] "Generic (PLEG): container finished" podID="db1aed43-29cc-4167-a979-5d8644e689b3" containerID="e73ea6822725656ee13bfccd29416b0b5840fea6af0260b34d30df48f105de4d" exitCode=0 Jul 15 13:36:14.538998 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.538829 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d" event={"ID":"db1aed43-29cc-4167-a979-5d8644e689b3","Type":"ContainerDied","Data":"e73ea6822725656ee13bfccd29416b0b5840fea6af0260b34d30df48f105de4d"} Jul 15 13:36:14.538998 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.538902 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d" event={"ID":"db1aed43-29cc-4167-a979-5d8644e689b3","Type":"ContainerStarted","Data":"c78dede7f24fc253375bfa5eacaf3c5147ba5f37d574f16f67687ac27062fc81"} Jul 15 13:36:14.541254 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.541225 2558 generic.go:356] "Generic (PLEG): container finished" podID="f569c5f0-be5d-4479-88d5-f5f2e2645e20" containerID="4a77b1132b8054d01b2bf69caaec5f22d928a3a8ecfbe513d3494db64c4defd4" exitCode=0 Jul 15 13:36:14.541381 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.541266 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j" event={"ID":"f569c5f0-be5d-4479-88d5-f5f2e2645e20","Type":"ContainerDied","Data":"4a77b1132b8054d01b2bf69caaec5f22d928a3a8ecfbe513d3494db64c4defd4"} Jul 15 13:36:14.541381 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.541308 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j" event={"ID":"f569c5f0-be5d-4479-88d5-f5f2e2645e20","Type":"ContainerStarted","Data":"877243ee2d1a434e43a834437822d25639a4b5b03c9c349e8d9042fcc08313ba"} Jul 15 13:36:14.560654 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.560620 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm\" (UID: \"5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm" Jul 15 13:36:14.560895 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.560804 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm\" (UID: \"5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm" Jul 15 13:36:14.560895 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.560864 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6ks7\" (UniqueName: \"kubernetes.io/projected/5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e-kube-api-access-j6ks7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm\" (UID: \"5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm" Jul 15 13:36:14.564303 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.564279 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz"] Jul 15 13:36:14.566103 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:36:14.566081 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e5d7159_0c90_477b_b211_096de53b6f3a.slice/crio-6926d81aabcb7327dc52b4869e06b09a015983632dd88222cd03c43090ffda03 WatchSource:0}: Error finding container 6926d81aabcb7327dc52b4869e06b09a015983632dd88222cd03c43090ffda03: Status 404 returned error can't find the container with id 6926d81aabcb7327dc52b4869e06b09a015983632dd88222cd03c43090ffda03 Jul 15 13:36:14.661540 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.661504 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm\" (UID: \"5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm" Jul 15 13:36:14.661540 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.661555 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6ks7\" (UniqueName: \"kubernetes.io/projected/5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e-kube-api-access-j6ks7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm\" (UID: \"5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm" Jul 15 13:36:14.661836 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.661722 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm\" (UID: \"5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm" Jul 15 13:36:14.662007 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.661983 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm\" (UID: \"5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm" Jul 15 13:36:14.662145 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.662125 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm\" (UID: \"5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm" Jul 15 13:36:14.673470 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.673435 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6ks7\" (UniqueName: \"kubernetes.io/projected/5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e-kube-api-access-j6ks7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm\" (UID: \"5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm" Jul 15 13:36:14.801990 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.801898 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm" Jul 15 13:36:14.947216 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:14.947188 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm"] Jul 15 13:36:14.949428 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:36:14.949404 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cbbf99b_7f66_49cf_a9e1_ed9091f30b7e.slice/crio-375a70e53b8e6f896e719b81271e60d32970f0aece9ff0433dde5599d902dfb3 WatchSource:0}: Error finding container 375a70e53b8e6f896e719b81271e60d32970f0aece9ff0433dde5599d902dfb3: Status 404 returned error can't find the container with id 375a70e53b8e6f896e719b81271e60d32970f0aece9ff0433dde5599d902dfb3 Jul 15 13:36:15.552073 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:15.551353 2558 generic.go:356] "Generic (PLEG): container finished" podID="2e5d7159-0c90-477b-b211-096de53b6f3a" containerID="280833d6e1c4f8ffbf188b81a3e9046ffe9bfcdf086469426ec237495f3324d1" exitCode=0 Jul 15 13:36:15.552073 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:15.551519 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz" event={"ID":"2e5d7159-0c90-477b-b211-096de53b6f3a","Type":"ContainerDied","Data":"280833d6e1c4f8ffbf188b81a3e9046ffe9bfcdf086469426ec237495f3324d1"} Jul 15 13:36:15.552073 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:15.551566 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz" event={"ID":"2e5d7159-0c90-477b-b211-096de53b6f3a","Type":"ContainerStarted","Data":"6926d81aabcb7327dc52b4869e06b09a015983632dd88222cd03c43090ffda03"} Jul 15 13:36:15.558381 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:15.556215 2558 generic.go:356] "Generic (PLEG): container finished" podID="5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e" containerID="dd60ac39edb1f30385fbdd5bbcc21e36da03add7c86d4a136c3c32e1ae1f3f8e" exitCode=0 Jul 15 13:36:15.558381 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:15.556310 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm" event={"ID":"5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e","Type":"ContainerDied","Data":"dd60ac39edb1f30385fbdd5bbcc21e36da03add7c86d4a136c3c32e1ae1f3f8e"} Jul 15 13:36:15.558381 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:15.556351 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm" event={"ID":"5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e","Type":"ContainerStarted","Data":"375a70e53b8e6f896e719b81271e60d32970f0aece9ff0433dde5599d902dfb3"} Jul 15 13:36:16.565287 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:16.565248 2558 generic.go:356] "Generic (PLEG): container finished" podID="f569c5f0-be5d-4479-88d5-f5f2e2645e20" containerID="432c830891cecab80eb26326f1a4363078a31a36dbe3bc204ba86baaa23ccea7" exitCode=0 Jul 15 13:36:16.565760 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:16.565326 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j" event={"ID":"f569c5f0-be5d-4479-88d5-f5f2e2645e20","Type":"ContainerDied","Data":"432c830891cecab80eb26326f1a4363078a31a36dbe3bc204ba86baaa23ccea7"} Jul 15 13:36:16.567714 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:16.567643 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz" event={"ID":"2e5d7159-0c90-477b-b211-096de53b6f3a","Type":"ContainerStarted","Data":"fcc0e4012480296b02273de0c9ceeb15bbc4593084caf9b809fa49eb8acbfba9"} Jul 15 13:36:16.570020 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:16.569988 2558 generic.go:356] "Generic (PLEG): container finished" podID="db1aed43-29cc-4167-a979-5d8644e689b3" containerID="5f8f90252d8ad7cc1c03fa13b8d3e7b9c3187d84cedd98866dd9d5cb34ccc2a1" exitCode=0 Jul 15 13:36:16.570115 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:16.570037 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d" event={"ID":"db1aed43-29cc-4167-a979-5d8644e689b3","Type":"ContainerDied","Data":"5f8f90252d8ad7cc1c03fa13b8d3e7b9c3187d84cedd98866dd9d5cb34ccc2a1"} Jul 15 13:36:17.577073 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:17.577033 2558 generic.go:356] "Generic (PLEG): container finished" podID="2e5d7159-0c90-477b-b211-096de53b6f3a" containerID="fcc0e4012480296b02273de0c9ceeb15bbc4593084caf9b809fa49eb8acbfba9" exitCode=0 Jul 15 13:36:17.577502 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:17.577121 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz" event={"ID":"2e5d7159-0c90-477b-b211-096de53b6f3a","Type":"ContainerDied","Data":"fcc0e4012480296b02273de0c9ceeb15bbc4593084caf9b809fa49eb8acbfba9"} Jul 15 13:36:17.579470 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:17.579444 2558 generic.go:356] "Generic (PLEG): container finished" podID="db1aed43-29cc-4167-a979-5d8644e689b3" containerID="f6b406d6deb78051cc552c06891dac70d60d9447f5d8cda75336a1ca8fd3efc0" exitCode=0 Jul 15 13:36:17.579632 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:17.579526 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d" event={"ID":"db1aed43-29cc-4167-a979-5d8644e689b3","Type":"ContainerDied","Data":"f6b406d6deb78051cc552c06891dac70d60d9447f5d8cda75336a1ca8fd3efc0"} Jul 15 13:36:17.581913 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:17.581889 2558 generic.go:356] "Generic (PLEG): container finished" podID="f569c5f0-be5d-4479-88d5-f5f2e2645e20" containerID="cbd9031d47c15931177075bb0e7f739fbae1c41aa637eb9755ba6fe802b87573" exitCode=0 Jul 15 13:36:17.582024 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:17.581920 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j" event={"ID":"f569c5f0-be5d-4479-88d5-f5f2e2645e20","Type":"ContainerDied","Data":"cbd9031d47c15931177075bb0e7f739fbae1c41aa637eb9755ba6fe802b87573"} Jul 15 13:36:17.583906 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:17.583876 2558 generic.go:356] "Generic (PLEG): container finished" podID="5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e" containerID="2e168500c89537d3d6704e8823bd025944e21bd21ebd0821d2358602c523a6fd" exitCode=0 Jul 15 13:36:17.584017 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:17.583908 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm" event={"ID":"5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e","Type":"ContainerDied","Data":"2e168500c89537d3d6704e8823bd025944e21bd21ebd0821d2358602c523a6fd"} Jul 15 13:36:18.591301 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:18.591269 2558 generic.go:356] "Generic (PLEG): container finished" podID="2e5d7159-0c90-477b-b211-096de53b6f3a" containerID="41837192097dbb10b23c2dbba8e75c4fc1da5fbaf2ae4c9298982ac2f64e7829" exitCode=0 Jul 15 13:36:18.591724 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:18.591358 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz" event={"ID":"2e5d7159-0c90-477b-b211-096de53b6f3a","Type":"ContainerDied","Data":"41837192097dbb10b23c2dbba8e75c4fc1da5fbaf2ae4c9298982ac2f64e7829"} Jul 15 13:36:18.593456 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:18.593432 2558 generic.go:356] "Generic (PLEG): container finished" podID="5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e" containerID="e955cbbd13bf7a6fc0c48c18de29f4dff35023e0913c3bfdf3f314d97f5b813b" exitCode=0 Jul 15 13:36:18.593545 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:18.593492 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm" event={"ID":"5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e","Type":"ContainerDied","Data":"e955cbbd13bf7a6fc0c48c18de29f4dff35023e0913c3bfdf3f314d97f5b813b"} Jul 15 13:36:18.748569 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:18.748543 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d" Jul 15 13:36:18.768174 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:18.768119 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j" Jul 15 13:36:18.900386 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:18.900279 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f569c5f0-be5d-4479-88d5-f5f2e2645e20-bundle\") pod \"f569c5f0-be5d-4479-88d5-f5f2e2645e20\" (UID: \"f569c5f0-be5d-4479-88d5-f5f2e2645e20\") " Jul 15 13:36:18.900386 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:18.900343 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db1aed43-29cc-4167-a979-5d8644e689b3-bundle\") pod \"db1aed43-29cc-4167-a979-5d8644e689b3\" (UID: \"db1aed43-29cc-4167-a979-5d8644e689b3\") " Jul 15 13:36:18.900386 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:18.900395 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j28wf\" (UniqueName: \"kubernetes.io/projected/f569c5f0-be5d-4479-88d5-f5f2e2645e20-kube-api-access-j28wf\") pod \"f569c5f0-be5d-4479-88d5-f5f2e2645e20\" (UID: \"f569c5f0-be5d-4479-88d5-f5f2e2645e20\") " Jul 15 13:36:18.900699 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:18.900422 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67ssd\" (UniqueName: \"kubernetes.io/projected/db1aed43-29cc-4167-a979-5d8644e689b3-kube-api-access-67ssd\") pod \"db1aed43-29cc-4167-a979-5d8644e689b3\" (UID: \"db1aed43-29cc-4167-a979-5d8644e689b3\") " Jul 15 13:36:18.900699 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:18.900465 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f569c5f0-be5d-4479-88d5-f5f2e2645e20-util\") pod \"f569c5f0-be5d-4479-88d5-f5f2e2645e20\" (UID: \"f569c5f0-be5d-4479-88d5-f5f2e2645e20\") " Jul 15 13:36:18.900699 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:18.900589 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db1aed43-29cc-4167-a979-5d8644e689b3-util\") pod \"db1aed43-29cc-4167-a979-5d8644e689b3\" (UID: \"db1aed43-29cc-4167-a979-5d8644e689b3\") " Jul 15 13:36:18.901109 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:18.901076 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f569c5f0-be5d-4479-88d5-f5f2e2645e20-bundle" (OuterVolumeSpecName: "bundle") pod "f569c5f0-be5d-4479-88d5-f5f2e2645e20" (UID: "f569c5f0-be5d-4479-88d5-f5f2e2645e20"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:36:18.901324 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:18.901297 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db1aed43-29cc-4167-a979-5d8644e689b3-bundle" (OuterVolumeSpecName: "bundle") pod "db1aed43-29cc-4167-a979-5d8644e689b3" (UID: "db1aed43-29cc-4167-a979-5d8644e689b3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:36:18.902683 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:18.902650 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db1aed43-29cc-4167-a979-5d8644e689b3-kube-api-access-67ssd" (OuterVolumeSpecName: "kube-api-access-67ssd") pod "db1aed43-29cc-4167-a979-5d8644e689b3" (UID: "db1aed43-29cc-4167-a979-5d8644e689b3"). InnerVolumeSpecName "kube-api-access-67ssd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:36:18.902769 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:18.902742 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f569c5f0-be5d-4479-88d5-f5f2e2645e20-kube-api-access-j28wf" (OuterVolumeSpecName: "kube-api-access-j28wf") pod "f569c5f0-be5d-4479-88d5-f5f2e2645e20" (UID: "f569c5f0-be5d-4479-88d5-f5f2e2645e20"). InnerVolumeSpecName "kube-api-access-j28wf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:36:18.909513 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:18.909465 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f569c5f0-be5d-4479-88d5-f5f2e2645e20-util" (OuterVolumeSpecName: "util") pod "f569c5f0-be5d-4479-88d5-f5f2e2645e20" (UID: "f569c5f0-be5d-4479-88d5-f5f2e2645e20"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:36:18.909834 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:18.909811 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db1aed43-29cc-4167-a979-5d8644e689b3-util" (OuterVolumeSpecName: "util") pod "db1aed43-29cc-4167-a979-5d8644e689b3" (UID: "db1aed43-29cc-4167-a979-5d8644e689b3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:36:19.002265 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.002223 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67ssd\" (UniqueName: \"kubernetes.io/projected/db1aed43-29cc-4167-a979-5d8644e689b3-kube-api-access-67ssd\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:36:19.002265 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.002259 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f569c5f0-be5d-4479-88d5-f5f2e2645e20-util\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:36:19.002265 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.002271 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db1aed43-29cc-4167-a979-5d8644e689b3-util\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:36:19.002479 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.002280 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f569c5f0-be5d-4479-88d5-f5f2e2645e20-bundle\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:36:19.002479 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.002287 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db1aed43-29cc-4167-a979-5d8644e689b3-bundle\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:36:19.002479 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.002297 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j28wf\" (UniqueName: \"kubernetes.io/projected/f569c5f0-be5d-4479-88d5-f5f2e2645e20-kube-api-access-j28wf\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:36:19.600987 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.600952 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d" Jul 15 13:36:19.600987 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.600972 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d" event={"ID":"db1aed43-29cc-4167-a979-5d8644e689b3","Type":"ContainerDied","Data":"c78dede7f24fc253375bfa5eacaf3c5147ba5f37d574f16f67687ac27062fc81"} Jul 15 13:36:19.601473 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.601025 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c78dede7f24fc253375bfa5eacaf3c5147ba5f37d574f16f67687ac27062fc81" Jul 15 13:36:19.602891 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.602866 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j" Jul 15 13:36:19.603022 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.602893 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j" event={"ID":"f569c5f0-be5d-4479-88d5-f5f2e2645e20","Type":"ContainerDied","Data":"877243ee2d1a434e43a834437822d25639a4b5b03c9c349e8d9042fcc08313ba"} Jul 15 13:36:19.603022 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.602945 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="877243ee2d1a434e43a834437822d25639a4b5b03c9c349e8d9042fcc08313ba" Jul 15 13:36:19.774002 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.773969 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm" Jul 15 13:36:19.776051 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.776028 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz" Jul 15 13:36:19.911619 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.911522 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrsr8\" (UniqueName: \"kubernetes.io/projected/2e5d7159-0c90-477b-b211-096de53b6f3a-kube-api-access-xrsr8\") pod \"2e5d7159-0c90-477b-b211-096de53b6f3a\" (UID: \"2e5d7159-0c90-477b-b211-096de53b6f3a\") " Jul 15 13:36:19.911619 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.911594 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e5d7159-0c90-477b-b211-096de53b6f3a-util\") pod \"2e5d7159-0c90-477b-b211-096de53b6f3a\" (UID: \"2e5d7159-0c90-477b-b211-096de53b6f3a\") " Jul 15 13:36:19.911819 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.911632 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6ks7\" (UniqueName: \"kubernetes.io/projected/5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e-kube-api-access-j6ks7\") pod \"5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e\" (UID: \"5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e\") " Jul 15 13:36:19.911819 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.911706 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e-util\") pod \"5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e\" (UID: \"5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e\") " Jul 15 13:36:19.911819 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.911724 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e5d7159-0c90-477b-b211-096de53b6f3a-bundle\") pod \"2e5d7159-0c90-477b-b211-096de53b6f3a\" (UID: \"2e5d7159-0c90-477b-b211-096de53b6f3a\") " Jul 15 13:36:19.911819 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.911748 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e-bundle\") pod \"5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e\" (UID: \"5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e\") " Jul 15 13:36:19.912301 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.912266 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e5d7159-0c90-477b-b211-096de53b6f3a-bundle" (OuterVolumeSpecName: "bundle") pod "2e5d7159-0c90-477b-b211-096de53b6f3a" (UID: "2e5d7159-0c90-477b-b211-096de53b6f3a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:36:19.912420 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.912289 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e-bundle" (OuterVolumeSpecName: "bundle") pod "5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e" (UID: "5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:36:19.913861 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.913830 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e5d7159-0c90-477b-b211-096de53b6f3a-kube-api-access-xrsr8" (OuterVolumeSpecName: "kube-api-access-xrsr8") pod "2e5d7159-0c90-477b-b211-096de53b6f3a" (UID: "2e5d7159-0c90-477b-b211-096de53b6f3a"). InnerVolumeSpecName "kube-api-access-xrsr8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:36:19.914036 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.914007 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e-kube-api-access-j6ks7" (OuterVolumeSpecName: "kube-api-access-j6ks7") pod "5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e" (UID: "5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e"). InnerVolumeSpecName "kube-api-access-j6ks7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:36:19.917778 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.917748 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e-util" (OuterVolumeSpecName: "util") pod "5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e" (UID: "5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:36:19.920464 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:19.920436 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e5d7159-0c90-477b-b211-096de53b6f3a-util" (OuterVolumeSpecName: "util") pod "2e5d7159-0c90-477b-b211-096de53b6f3a" (UID: "2e5d7159-0c90-477b-b211-096de53b6f3a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:36:20.013220 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:20.013173 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e-util\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:36:20.013220 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:20.013229 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e5d7159-0c90-477b-b211-096de53b6f3a-bundle\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:36:20.013427 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:20.013238 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e-bundle\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:36:20.013427 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:20.013248 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrsr8\" (UniqueName: \"kubernetes.io/projected/2e5d7159-0c90-477b-b211-096de53b6f3a-kube-api-access-xrsr8\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:36:20.013427 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:20.013258 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e5d7159-0c90-477b-b211-096de53b6f3a-util\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:36:20.013427 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:20.013267 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6ks7\" (UniqueName: \"kubernetes.io/projected/5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e-kube-api-access-j6ks7\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:36:20.610402 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:20.610358 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz" event={"ID":"2e5d7159-0c90-477b-b211-096de53b6f3a","Type":"ContainerDied","Data":"6926d81aabcb7327dc52b4869e06b09a015983632dd88222cd03c43090ffda03"} Jul 15 13:36:20.610402 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:20.610389 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz" Jul 15 13:36:20.610937 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:20.610422 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6926d81aabcb7327dc52b4869e06b09a015983632dd88222cd03c43090ffda03" Jul 15 13:36:20.612650 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:20.612620 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm" event={"ID":"5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e","Type":"ContainerDied","Data":"375a70e53b8e6f896e719b81271e60d32970f0aece9ff0433dde5599d902dfb3"} Jul 15 13:36:20.612796 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:20.612671 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="375a70e53b8e6f896e719b81271e60d32970f0aece9ff0433dde5599d902dfb3" Jul 15 13:36:20.612796 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:20.612677 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm" Jul 15 13:36:31.609016 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.608933 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dsqzv"] Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609263 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db1aed43-29cc-4167-a979-5d8644e689b3" containerName="util" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609274 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="db1aed43-29cc-4167-a979-5d8644e689b3" containerName="util" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609282 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e" containerName="util" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609288 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e" containerName="util" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609298 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e5d7159-0c90-477b-b211-096de53b6f3a" containerName="pull" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609304 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e5d7159-0c90-477b-b211-096de53b6f3a" containerName="pull" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609314 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f569c5f0-be5d-4479-88d5-f5f2e2645e20" containerName="util" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609319 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f569c5f0-be5d-4479-88d5-f5f2e2645e20" containerName="util" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609325 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db1aed43-29cc-4167-a979-5d8644e689b3" containerName="pull" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609330 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="db1aed43-29cc-4167-a979-5d8644e689b3" containerName="pull" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609337 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e" containerName="pull" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609342 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e" containerName="pull" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609349 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e5d7159-0c90-477b-b211-096de53b6f3a" containerName="extract" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609354 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e5d7159-0c90-477b-b211-096de53b6f3a" containerName="extract" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609362 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e5d7159-0c90-477b-b211-096de53b6f3a" containerName="util" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609367 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e5d7159-0c90-477b-b211-096de53b6f3a" containerName="util" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609381 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f569c5f0-be5d-4479-88d5-f5f2e2645e20" containerName="pull" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609385 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f569c5f0-be5d-4479-88d5-f5f2e2645e20" containerName="pull" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609390 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f569c5f0-be5d-4479-88d5-f5f2e2645e20" containerName="extract" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609395 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f569c5f0-be5d-4479-88d5-f5f2e2645e20" containerName="extract" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609401 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db1aed43-29cc-4167-a979-5d8644e689b3" containerName="extract" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609406 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="db1aed43-29cc-4167-a979-5d8644e689b3" containerName="extract" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609413 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e" containerName="extract" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609417 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e" containerName="extract" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609485 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e" containerName="extract" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609499 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e5d7159-0c90-477b-b211-096de53b6f3a" containerName="extract" Jul 15 13:36:31.609495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609507 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f569c5f0-be5d-4479-88d5-f5f2e2645e20" containerName="extract" Jul 15 13:36:31.610736 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.609514 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="db1aed43-29cc-4167-a979-5d8644e689b3" containerName="extract" Jul 15 13:36:31.612405 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.612387 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dsqzv" Jul 15 13:36:31.615592 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.615573 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-rjdb5\"" Jul 15 13:36:31.625864 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.625830 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dsqzv"] Jul 15 13:36:31.716354 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.716316 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9cpg\" (UniqueName: \"kubernetes.io/projected/80190304-1c1d-4dc0-9d08-9874d040a9a1-kube-api-access-j9cpg\") pod \"authorino-operator-75cc8d5cb7-dsqzv\" (UID: \"80190304-1c1d-4dc0-9d08-9874d040a9a1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dsqzv" Jul 15 13:36:31.817459 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.817410 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9cpg\" (UniqueName: \"kubernetes.io/projected/80190304-1c1d-4dc0-9d08-9874d040a9a1-kube-api-access-j9cpg\") pod \"authorino-operator-75cc8d5cb7-dsqzv\" (UID: \"80190304-1c1d-4dc0-9d08-9874d040a9a1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dsqzv" Jul 15 13:36:31.830379 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.830338 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9cpg\" (UniqueName: \"kubernetes.io/projected/80190304-1c1d-4dc0-9d08-9874d040a9a1-kube-api-access-j9cpg\") pod \"authorino-operator-75cc8d5cb7-dsqzv\" (UID: \"80190304-1c1d-4dc0-9d08-9874d040a9a1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dsqzv" Jul 15 13:36:31.923376 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:31.923341 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dsqzv" Jul 15 13:36:32.074843 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:32.074819 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dsqzv"] Jul 15 13:36:32.077221 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:36:32.077190 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80190304_1c1d_4dc0_9d08_9874d040a9a1.slice/crio-137446ed30a625a5768a26e7b9a54593ebd39ad9a34eb0a367bce305f7f32f33 WatchSource:0}: Error finding container 137446ed30a625a5768a26e7b9a54593ebd39ad9a34eb0a367bce305f7f32f33: Status 404 returned error can't find the container with id 137446ed30a625a5768a26e7b9a54593ebd39ad9a34eb0a367bce305f7f32f33 Jul 15 13:36:32.685941 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:32.685900 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dsqzv" event={"ID":"80190304-1c1d-4dc0-9d08-9874d040a9a1","Type":"ContainerStarted","Data":"137446ed30a625a5768a26e7b9a54593ebd39ad9a34eb0a367bce305f7f32f33"} Jul 15 13:36:34.698588 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:34.698485 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dsqzv" event={"ID":"80190304-1c1d-4dc0-9d08-9874d040a9a1","Type":"ContainerStarted","Data":"0269a4989c2eae4d273c2785497927f58770ed5bd298489abb41d853cad93d63"} Jul 15 13:36:34.699006 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:34.698629 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dsqzv" Jul 15 13:36:34.718846 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:34.718792 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dsqzv" podStartSLOduration=1.355144561 podStartE2EDuration="3.718774797s" totalImagesPullingTime="2.363630236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:36:34.717739823 +0000 UTC m=+454.837301859" watchObservedRunningTime="2026-07-15 13:36:34.718774797 +0000 UTC m=+454.838336816" Jul 15 13:36:36.602078 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:36.602033 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-86f89c8b9c-l6d8m" podUID="72a08f12-c265-452f-87f1-950313d38b85" containerName="console" containerID="cri-o://4560e8b68ae057c4d6770980b6faebdcd8fb346008c2dc2e012e45544ced4b30" gracePeriod=15 Jul 15 13:36:36.851029 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:36.851001 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:36:36.964589 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:36.964546 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72a08f12-c265-452f-87f1-950313d38b85-trusted-ca-bundle\") pod \"72a08f12-c265-452f-87f1-950313d38b85\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " Jul 15 13:36:36.964589 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:36.964616 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72a08f12-c265-452f-87f1-950313d38b85-service-ca\") pod \"72a08f12-c265-452f-87f1-950313d38b85\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " Jul 15 13:36:36.964888 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:36.964654 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pn4rc\" (UniqueName: \"kubernetes.io/projected/72a08f12-c265-452f-87f1-950313d38b85-kube-api-access-pn4rc\") pod \"72a08f12-c265-452f-87f1-950313d38b85\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " Jul 15 13:36:36.964888 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:36.964700 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72a08f12-c265-452f-87f1-950313d38b85-console-serving-cert\") pod \"72a08f12-c265-452f-87f1-950313d38b85\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " Jul 15 13:36:36.964888 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:36.964736 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72a08f12-c265-452f-87f1-950313d38b85-console-config\") pod \"72a08f12-c265-452f-87f1-950313d38b85\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " Jul 15 13:36:36.964888 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:36.964762 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72a08f12-c265-452f-87f1-950313d38b85-console-oauth-config\") pod \"72a08f12-c265-452f-87f1-950313d38b85\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " Jul 15 13:36:36.964888 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:36.964813 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72a08f12-c265-452f-87f1-950313d38b85-oauth-serving-cert\") pod \"72a08f12-c265-452f-87f1-950313d38b85\" (UID: \"72a08f12-c265-452f-87f1-950313d38b85\") " Jul 15 13:36:36.965210 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:36.965061 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72a08f12-c265-452f-87f1-950313d38b85-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "72a08f12-c265-452f-87f1-950313d38b85" (UID: "72a08f12-c265-452f-87f1-950313d38b85"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:36:36.965210 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:36.965085 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72a08f12-c265-452f-87f1-950313d38b85-service-ca" (OuterVolumeSpecName: "service-ca") pod "72a08f12-c265-452f-87f1-950313d38b85" (UID: "72a08f12-c265-452f-87f1-950313d38b85"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:36:36.965323 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:36.965209 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72a08f12-c265-452f-87f1-950313d38b85-console-config" (OuterVolumeSpecName: "console-config") pod "72a08f12-c265-452f-87f1-950313d38b85" (UID: "72a08f12-c265-452f-87f1-950313d38b85"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:36:36.965419 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:36.965399 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72a08f12-c265-452f-87f1-950313d38b85-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "72a08f12-c265-452f-87f1-950313d38b85" (UID: "72a08f12-c265-452f-87f1-950313d38b85"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:36:36.967041 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:36.967014 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72a08f12-c265-452f-87f1-950313d38b85-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "72a08f12-c265-452f-87f1-950313d38b85" (UID: "72a08f12-c265-452f-87f1-950313d38b85"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:36:36.967131 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:36.967037 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72a08f12-c265-452f-87f1-950313d38b85-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "72a08f12-c265-452f-87f1-950313d38b85" (UID: "72a08f12-c265-452f-87f1-950313d38b85"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:36:36.967131 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:36.967088 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72a08f12-c265-452f-87f1-950313d38b85-kube-api-access-pn4rc" (OuterVolumeSpecName: "kube-api-access-pn4rc") pod "72a08f12-c265-452f-87f1-950313d38b85" (UID: "72a08f12-c265-452f-87f1-950313d38b85"). InnerVolumeSpecName "kube-api-access-pn4rc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:36:37.066108 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:37.066069 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72a08f12-c265-452f-87f1-950313d38b85-trusted-ca-bundle\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:36:37.066108 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:37.066100 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72a08f12-c265-452f-87f1-950313d38b85-service-ca\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:36:37.066108 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:37.066110 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pn4rc\" (UniqueName: \"kubernetes.io/projected/72a08f12-c265-452f-87f1-950313d38b85-kube-api-access-pn4rc\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:36:37.066108 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:37.066119 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72a08f12-c265-452f-87f1-950313d38b85-console-serving-cert\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:36:37.066384 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:37.066129 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72a08f12-c265-452f-87f1-950313d38b85-console-config\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:36:37.066384 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:37.066137 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72a08f12-c265-452f-87f1-950313d38b85-console-oauth-config\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:36:37.066384 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:37.066144 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72a08f12-c265-452f-87f1-950313d38b85-oauth-serving-cert\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:36:37.715791 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:37.715756 2558 generic.go:356] "Generic (PLEG): container finished" podID="72a08f12-c265-452f-87f1-950313d38b85" containerID="4560e8b68ae057c4d6770980b6faebdcd8fb346008c2dc2e012e45544ced4b30" exitCode=0 Jul 15 13:36:37.716245 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:37.715801 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f89c8b9c-l6d8m" Jul 15 13:36:37.716245 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:37.715846 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f89c8b9c-l6d8m" event={"ID":"72a08f12-c265-452f-87f1-950313d38b85","Type":"ContainerDied","Data":"4560e8b68ae057c4d6770980b6faebdcd8fb346008c2dc2e012e45544ced4b30"} Jul 15 13:36:37.716245 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:37.715906 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f89c8b9c-l6d8m" event={"ID":"72a08f12-c265-452f-87f1-950313d38b85","Type":"ContainerDied","Data":"aeef1312338c4c8979440f20b9e9f4343a80e84fe1f1cb7972f248b9e6b03200"} Jul 15 13:36:37.716245 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:37.715934 2558 scope.go:117] "RemoveContainer" containerID="4560e8b68ae057c4d6770980b6faebdcd8fb346008c2dc2e012e45544ced4b30" Jul 15 13:36:37.725575 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:37.725557 2558 scope.go:117] "RemoveContainer" containerID="4560e8b68ae057c4d6770980b6faebdcd8fb346008c2dc2e012e45544ced4b30" Jul 15 13:36:37.725927 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:36:37.725907 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4560e8b68ae057c4d6770980b6faebdcd8fb346008c2dc2e012e45544ced4b30\": container with ID starting with 4560e8b68ae057c4d6770980b6faebdcd8fb346008c2dc2e012e45544ced4b30 not found: ID does not exist" containerID="4560e8b68ae057c4d6770980b6faebdcd8fb346008c2dc2e012e45544ced4b30" Jul 15 13:36:37.725982 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:37.725937 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4560e8b68ae057c4d6770980b6faebdcd8fb346008c2dc2e012e45544ced4b30"} err="failed to get container status \"4560e8b68ae057c4d6770980b6faebdcd8fb346008c2dc2e012e45544ced4b30\": rpc error: code = NotFound desc = could not find container \"4560e8b68ae057c4d6770980b6faebdcd8fb346008c2dc2e012e45544ced4b30\": container with ID starting with 4560e8b68ae057c4d6770980b6faebdcd8fb346008c2dc2e012e45544ced4b30 not found: ID does not exist" Jul 15 13:36:37.743647 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:37.743591 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86f89c8b9c-l6d8m"] Jul 15 13:36:37.757411 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:37.757377 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86f89c8b9c-l6d8m"] Jul 15 13:36:38.479146 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:38.479104 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72a08f12-c265-452f-87f1-950313d38b85" path="/var/lib/kubelet/pods/72a08f12-c265-452f-87f1-950313d38b85/volumes" Jul 15 13:36:45.706221 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:45.706189 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dsqzv" Jul 15 13:36:53.213515 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:53.213474 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9j9cm"] Jul 15 13:36:53.213990 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:53.213974 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72a08f12-c265-452f-87f1-950313d38b85" containerName="console" Jul 15 13:36:53.214036 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:53.213993 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="72a08f12-c265-452f-87f1-950313d38b85" containerName="console" Jul 15 13:36:53.214110 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:53.214099 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="72a08f12-c265-452f-87f1-950313d38b85" containerName="console" Jul 15 13:36:53.219068 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:53.219043 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9j9cm" Jul 15 13:36:53.221987 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:53.221959 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 15 13:36:53.223149 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:53.223127 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wd5w4\"" Jul 15 13:36:53.223271 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:53.223200 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 15 13:36:53.227418 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:53.227393 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9j9cm"] Jul 15 13:36:53.296793 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:53.296759 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c650036b-d74e-4e7b-874b-4bf4d63f92a8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9j9cm\" (UID: \"c650036b-d74e-4e7b-874b-4bf4d63f92a8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9j9cm" Jul 15 13:36:53.296981 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:53.296801 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4smb6\" (UniqueName: \"kubernetes.io/projected/c650036b-d74e-4e7b-874b-4bf4d63f92a8-kube-api-access-4smb6\") pod \"kuadrant-console-plugin-66b5774985-9j9cm\" (UID: \"c650036b-d74e-4e7b-874b-4bf4d63f92a8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9j9cm" Jul 15 13:36:53.296981 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:53.296822 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c650036b-d74e-4e7b-874b-4bf4d63f92a8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9j9cm\" (UID: \"c650036b-d74e-4e7b-874b-4bf4d63f92a8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9j9cm" Jul 15 13:36:53.397384 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:53.397347 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c650036b-d74e-4e7b-874b-4bf4d63f92a8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9j9cm\" (UID: \"c650036b-d74e-4e7b-874b-4bf4d63f92a8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9j9cm" Jul 15 13:36:53.397564 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:53.397391 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4smb6\" (UniqueName: \"kubernetes.io/projected/c650036b-d74e-4e7b-874b-4bf4d63f92a8-kube-api-access-4smb6\") pod \"kuadrant-console-plugin-66b5774985-9j9cm\" (UID: \"c650036b-d74e-4e7b-874b-4bf4d63f92a8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9j9cm" Jul 15 13:36:53.397564 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:53.397422 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c650036b-d74e-4e7b-874b-4bf4d63f92a8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9j9cm\" (UID: \"c650036b-d74e-4e7b-874b-4bf4d63f92a8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9j9cm" Jul 15 13:36:53.397564 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:36:53.397504 2558 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 15 13:36:53.397707 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:36:53.397577 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c650036b-d74e-4e7b-874b-4bf4d63f92a8-plugin-serving-cert podName:c650036b-d74e-4e7b-874b-4bf4d63f92a8 nodeName:}" failed. No retries permitted until 2026-07-15 13:36:53.897556976 +0000 UTC m=+474.017118988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/c650036b-d74e-4e7b-874b-4bf4d63f92a8-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-9j9cm" (UID: "c650036b-d74e-4e7b-874b-4bf4d63f92a8") : secret "plugin-serving-cert" not found Jul 15 13:36:53.398107 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:53.398088 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c650036b-d74e-4e7b-874b-4bf4d63f92a8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9j9cm\" (UID: \"c650036b-d74e-4e7b-874b-4bf4d63f92a8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9j9cm" Jul 15 13:36:53.409676 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:53.409643 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4smb6\" (UniqueName: \"kubernetes.io/projected/c650036b-d74e-4e7b-874b-4bf4d63f92a8-kube-api-access-4smb6\") pod \"kuadrant-console-plugin-66b5774985-9j9cm\" (UID: \"c650036b-d74e-4e7b-874b-4bf4d63f92a8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9j9cm" Jul 15 13:36:53.901011 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:53.900975 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c650036b-d74e-4e7b-874b-4bf4d63f92a8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9j9cm\" (UID: \"c650036b-d74e-4e7b-874b-4bf4d63f92a8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9j9cm" Jul 15 13:36:53.903397 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:53.903369 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c650036b-d74e-4e7b-874b-4bf4d63f92a8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9j9cm\" (UID: \"c650036b-d74e-4e7b-874b-4bf4d63f92a8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9j9cm" Jul 15 13:36:54.129852 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:54.129813 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9j9cm" Jul 15 13:36:54.268378 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:54.268343 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9j9cm"] Jul 15 13:36:54.270682 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:36:54.270653 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc650036b_d74e_4e7b_874b_4bf4d63f92a8.slice/crio-c763e260f6b048c742d2b566d731bc51d951c688e2997e9ecf2eb46d2b3ab639 WatchSource:0}: Error finding container c763e260f6b048c742d2b566d731bc51d951c688e2997e9ecf2eb46d2b3ab639: Status 404 returned error can't find the container with id c763e260f6b048c742d2b566d731bc51d951c688e2997e9ecf2eb46d2b3ab639 Jul 15 13:36:54.814244 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:36:54.814210 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9j9cm" event={"ID":"c650036b-d74e-4e7b-874b-4bf4d63f92a8","Type":"ContainerStarted","Data":"c763e260f6b048c742d2b566d731bc51d951c688e2997e9ecf2eb46d2b3ab639"} Jul 15 13:37:18.964952 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:18.964912 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9j9cm" event={"ID":"c650036b-d74e-4e7b-874b-4bf4d63f92a8","Type":"ContainerStarted","Data":"4405eb01b2e6ecc13ea21711efa2475fe9f086903be03838c0b8680329fd52af"} Jul 15 13:37:19.004020 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:19.003956 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9j9cm" podStartSLOduration=1.496595607 podStartE2EDuration="26.003941569s" totalImagesPullingTime="24.507345962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:36:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:37:19.001887787 +0000 UTC m=+499.121449807" watchObservedRunningTime="2026-07-15 13:37:19.003941569 +0000 UTC m=+499.123503588" Jul 15 13:37:20.447919 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:20.447889 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7xngh"] Jul 15 13:37:20.452858 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:20.452834 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7xngh" Jul 15 13:37:20.457696 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:20.457673 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zsxrl\"" Jul 15 13:37:20.470883 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:20.470842 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7xngh"] Jul 15 13:37:20.557212 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:20.557176 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st2rn\" (UniqueName: \"kubernetes.io/projected/58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4-kube-api-access-st2rn\") pod \"kuadrant-operator-controller-manager-86878c769f-7xngh\" (UID: \"58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7xngh" Jul 15 13:37:20.557397 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:20.557241 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7xngh\" (UID: \"58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7xngh" Jul 15 13:37:20.658593 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:20.658545 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st2rn\" (UniqueName: \"kubernetes.io/projected/58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4-kube-api-access-st2rn\") pod \"kuadrant-operator-controller-manager-86878c769f-7xngh\" (UID: \"58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7xngh" Jul 15 13:37:20.658801 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:20.658670 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7xngh\" (UID: \"58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7xngh" Jul 15 13:37:20.659152 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:20.659117 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7xngh\" (UID: \"58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7xngh" Jul 15 13:37:20.668988 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:20.668963 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st2rn\" (UniqueName: \"kubernetes.io/projected/58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4-kube-api-access-st2rn\") pod \"kuadrant-operator-controller-manager-86878c769f-7xngh\" (UID: \"58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7xngh" Jul 15 13:37:20.763468 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:20.763382 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7xngh" Jul 15 13:37:20.933213 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:20.933179 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7xngh"] Jul 15 13:37:20.934496 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:37:20.934474 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58bf99c1_50d4_4f9d_a0fa_d642d8ea0ca4.slice/crio-6b2da14931e8f4bdbdff66175cd0fbbb703a34e2638562e56eb1294b9310635a WatchSource:0}: Error finding container 6b2da14931e8f4bdbdff66175cd0fbbb703a34e2638562e56eb1294b9310635a: Status 404 returned error can't find the container with id 6b2da14931e8f4bdbdff66175cd0fbbb703a34e2638562e56eb1294b9310635a Jul 15 13:37:20.976591 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:20.976551 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7xngh" event={"ID":"58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4","Type":"ContainerStarted","Data":"6b2da14931e8f4bdbdff66175cd0fbbb703a34e2638562e56eb1294b9310635a"} Jul 15 13:37:26.005678 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:26.005638 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7xngh" event={"ID":"58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4","Type":"ContainerStarted","Data":"0f006a4e5433ce35f88b9c9561927a483e9a081bd99b498a8d45356a3e7dd89d"} Jul 15 13:37:26.006092 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:26.005829 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7xngh" Jul 15 13:37:26.030269 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:26.030218 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7xngh" podStartSLOduration=1.630777031 podStartE2EDuration="6.030203007s" totalImagesPullingTime="4.399425976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:37:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:37:26.028123829 +0000 UTC m=+506.147685851" watchObservedRunningTime="2026-07-15 13:37:26.030203007 +0000 UTC m=+506.149765025" Jul 15 13:37:37.013781 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:37.013747 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7xngh" Jul 15 13:37:54.185184 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:54.185088 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-g7c9d"] Jul 15 13:37:54.188047 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:54.188028 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g7c9d" Jul 15 13:37:54.191510 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:54.191477 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-p2ldb\"" Jul 15 13:37:54.200372 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:54.200343 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-g7c9d"] Jul 15 13:37:54.249807 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:54.249762 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvt45\" (UniqueName: \"kubernetes.io/projected/a80eb6a4-c585-47bd-b35b-51559a5419e2-kube-api-access-cvt45\") pod \"authorino-58cd955675-g7c9d\" (UID: \"a80eb6a4-c585-47bd-b35b-51559a5419e2\") " pod="kuadrant-system/authorino-58cd955675-g7c9d" Jul 15 13:37:54.351222 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:54.351181 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvt45\" (UniqueName: \"kubernetes.io/projected/a80eb6a4-c585-47bd-b35b-51559a5419e2-kube-api-access-cvt45\") pod \"authorino-58cd955675-g7c9d\" (UID: \"a80eb6a4-c585-47bd-b35b-51559a5419e2\") " pod="kuadrant-system/authorino-58cd955675-g7c9d" Jul 15 13:37:54.361280 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:54.361243 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvt45\" (UniqueName: \"kubernetes.io/projected/a80eb6a4-c585-47bd-b35b-51559a5419e2-kube-api-access-cvt45\") pod \"authorino-58cd955675-g7c9d\" (UID: \"a80eb6a4-c585-47bd-b35b-51559a5419e2\") " pod="kuadrant-system/authorino-58cd955675-g7c9d" Jul 15 13:37:54.497770 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:54.497683 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g7c9d" Jul 15 13:37:54.637340 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:54.637313 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-g7c9d"] Jul 15 13:37:54.639102 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:37:54.639072 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda80eb6a4_c585_47bd_b35b_51559a5419e2.slice/crio-df669e029214fff1a4bd3c4306a7ae53499ac4b0a4b35d747d27d14aaebfcc9c WatchSource:0}: Error finding container df669e029214fff1a4bd3c4306a7ae53499ac4b0a4b35d747d27d14aaebfcc9c: Status 404 returned error can't find the container with id df669e029214fff1a4bd3c4306a7ae53499ac4b0a4b35d747d27d14aaebfcc9c Jul 15 13:37:55.162286 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:55.162255 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g7c9d" event={"ID":"a80eb6a4-c585-47bd-b35b-51559a5419e2","Type":"ContainerStarted","Data":"df669e029214fff1a4bd3c4306a7ae53499ac4b0a4b35d747d27d14aaebfcc9c"} Jul 15 13:37:58.181169 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:58.181129 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g7c9d" event={"ID":"a80eb6a4-c585-47bd-b35b-51559a5419e2","Type":"ContainerStarted","Data":"ee3b30b787e8368e9e60f47a4fb80735f0cd1db4026edd5b738677ababf6987e"} Jul 15 13:37:58.200568 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:58.200513 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-g7c9d" podStartSLOduration=0.936029074 podStartE2EDuration="4.20049437s" totalImagesPullingTime="3.264465296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:37:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:37:58.199799655 +0000 UTC m=+538.319361675" watchObservedRunningTime="2026-07-15 13:37:58.20049437 +0000 UTC m=+538.320056388" Jul 15 13:37:59.495919 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:37:59.495884 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-g7c9d"] Jul 15 13:38:00.195196 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:00.195146 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-g7c9d" podUID="a80eb6a4-c585-47bd-b35b-51559a5419e2" containerName="authorino" containerID="cri-o://ee3b30b787e8368e9e60f47a4fb80735f0cd1db4026edd5b738677ababf6987e" gracePeriod=30 Jul 15 13:38:00.459384 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:00.459302 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g7c9d" Jul 15 13:38:00.610845 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:00.610801 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvt45\" (UniqueName: \"kubernetes.io/projected/a80eb6a4-c585-47bd-b35b-51559a5419e2-kube-api-access-cvt45\") pod \"a80eb6a4-c585-47bd-b35b-51559a5419e2\" (UID: \"a80eb6a4-c585-47bd-b35b-51559a5419e2\") " Jul 15 13:38:00.612990 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:00.612957 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a80eb6a4-c585-47bd-b35b-51559a5419e2-kube-api-access-cvt45" (OuterVolumeSpecName: "kube-api-access-cvt45") pod "a80eb6a4-c585-47bd-b35b-51559a5419e2" (UID: "a80eb6a4-c585-47bd-b35b-51559a5419e2"). InnerVolumeSpecName "kube-api-access-cvt45". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:38:00.712236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:00.712146 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvt45\" (UniqueName: \"kubernetes.io/projected/a80eb6a4-c585-47bd-b35b-51559a5419e2-kube-api-access-cvt45\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:38:01.201390 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:01.201357 2558 generic.go:356] "Generic (PLEG): container finished" podID="a80eb6a4-c585-47bd-b35b-51559a5419e2" containerID="ee3b30b787e8368e9e60f47a4fb80735f0cd1db4026edd5b738677ababf6987e" exitCode=0 Jul 15 13:38:01.201578 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:01.201430 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g7c9d" Jul 15 13:38:01.201578 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:01.201448 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g7c9d" event={"ID":"a80eb6a4-c585-47bd-b35b-51559a5419e2","Type":"ContainerDied","Data":"ee3b30b787e8368e9e60f47a4fb80735f0cd1db4026edd5b738677ababf6987e"} Jul 15 13:38:01.201578 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:01.201492 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g7c9d" event={"ID":"a80eb6a4-c585-47bd-b35b-51559a5419e2","Type":"ContainerDied","Data":"df669e029214fff1a4bd3c4306a7ae53499ac4b0a4b35d747d27d14aaebfcc9c"} Jul 15 13:38:01.201578 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:01.201508 2558 scope.go:117] "RemoveContainer" containerID="ee3b30b787e8368e9e60f47a4fb80735f0cd1db4026edd5b738677ababf6987e" Jul 15 13:38:01.210570 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:01.210547 2558 scope.go:117] "RemoveContainer" containerID="ee3b30b787e8368e9e60f47a4fb80735f0cd1db4026edd5b738677ababf6987e" Jul 15 13:38:01.210961 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:38:01.210940 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee3b30b787e8368e9e60f47a4fb80735f0cd1db4026edd5b738677ababf6987e\": container with ID starting with ee3b30b787e8368e9e60f47a4fb80735f0cd1db4026edd5b738677ababf6987e not found: ID does not exist" containerID="ee3b30b787e8368e9e60f47a4fb80735f0cd1db4026edd5b738677ababf6987e" Jul 15 13:38:01.211032 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:01.210973 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee3b30b787e8368e9e60f47a4fb80735f0cd1db4026edd5b738677ababf6987e"} err="failed to get container status \"ee3b30b787e8368e9e60f47a4fb80735f0cd1db4026edd5b738677ababf6987e\": rpc error: code = NotFound desc = could not find container \"ee3b30b787e8368e9e60f47a4fb80735f0cd1db4026edd5b738677ababf6987e\": container with ID starting with ee3b30b787e8368e9e60f47a4fb80735f0cd1db4026edd5b738677ababf6987e not found: ID does not exist" Jul 15 13:38:01.226198 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:01.226168 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-g7c9d"] Jul 15 13:38:01.230753 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:01.230721 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-g7c9d"] Jul 15 13:38:02.479071 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:02.479031 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a80eb6a4-c585-47bd-b35b-51559a5419e2" path="/var/lib/kubelet/pods/a80eb6a4-c585-47bd-b35b-51559a5419e2/volumes" Jul 15 13:38:37.172735 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:37.172693 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f944z"] Jul 15 13:38:37.173342 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:37.173216 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a80eb6a4-c585-47bd-b35b-51559a5419e2" containerName="authorino" Jul 15 13:38:37.173342 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:37.173236 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a80eb6a4-c585-47bd-b35b-51559a5419e2" containerName="authorino" Jul 15 13:38:37.173459 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:37.173350 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a80eb6a4-c585-47bd-b35b-51559a5419e2" containerName="authorino" Jul 15 13:38:37.177698 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:37.177675 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-f944z" Jul 15 13:38:37.181800 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:37.181776 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-p2ldb\"" Jul 15 13:38:37.185978 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:37.185956 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f944z"] Jul 15 13:38:37.224258 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:37.224219 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxcbq\" (UniqueName: \"kubernetes.io/projected/3ab14346-0213-4bff-a1fb-452d16c34e86-kube-api-access-lxcbq\") pod \"authorino-5d4b67c446-f944z\" (UID: \"3ab14346-0213-4bff-a1fb-452d16c34e86\") " pod="kuadrant-system/authorino-5d4b67c446-f944z" Jul 15 13:38:37.325484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:37.325438 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxcbq\" (UniqueName: \"kubernetes.io/projected/3ab14346-0213-4bff-a1fb-452d16c34e86-kube-api-access-lxcbq\") pod \"authorino-5d4b67c446-f944z\" (UID: \"3ab14346-0213-4bff-a1fb-452d16c34e86\") " pod="kuadrant-system/authorino-5d4b67c446-f944z" Jul 15 13:38:37.335783 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:37.335751 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxcbq\" (UniqueName: \"kubernetes.io/projected/3ab14346-0213-4bff-a1fb-452d16c34e86-kube-api-access-lxcbq\") pod \"authorino-5d4b67c446-f944z\" (UID: \"3ab14346-0213-4bff-a1fb-452d16c34e86\") " pod="kuadrant-system/authorino-5d4b67c446-f944z" Jul 15 13:38:37.415875 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:37.415833 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f944z"] Jul 15 13:38:37.416159 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:37.416141 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-f944z" Jul 15 13:38:37.447902 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:37.447869 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7dc7df685-k85vt"] Jul 15 13:38:37.450958 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:37.450932 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dc7df685-k85vt" Jul 15 13:38:37.462914 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:37.462854 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7dc7df685-k85vt"] Jul 15 13:38:37.528298 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:37.528251 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmj9f\" (UniqueName: \"kubernetes.io/projected/b898b448-0828-467d-8314-f515c5bc1aa9-kube-api-access-fmj9f\") pod \"authorino-7dc7df685-k85vt\" (UID: \"b898b448-0828-467d-8314-f515c5bc1aa9\") " pod="kuadrant-system/authorino-7dc7df685-k85vt" Jul 15 13:38:37.575222 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:37.575183 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f944z"] Jul 15 13:38:37.575505 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:38:37.575474 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ab14346_0213_4bff_a1fb_452d16c34e86.slice/crio-c5867b28650c4156789f3d7d4daf0b3df8a6d2ffcc7b2065bfe52ff3c59f4804 WatchSource:0}: Error finding container c5867b28650c4156789f3d7d4daf0b3df8a6d2ffcc7b2065bfe52ff3c59f4804: Status 404 returned error can't find the container with id c5867b28650c4156789f3d7d4daf0b3df8a6d2ffcc7b2065bfe52ff3c59f4804 Jul 15 13:38:37.629047 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:37.628996 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmj9f\" (UniqueName: \"kubernetes.io/projected/b898b448-0828-467d-8314-f515c5bc1aa9-kube-api-access-fmj9f\") pod \"authorino-7dc7df685-k85vt\" (UID: \"b898b448-0828-467d-8314-f515c5bc1aa9\") " pod="kuadrant-system/authorino-7dc7df685-k85vt" Jul 15 13:38:37.641043 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:37.641014 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmj9f\" (UniqueName: \"kubernetes.io/projected/b898b448-0828-467d-8314-f515c5bc1aa9-kube-api-access-fmj9f\") pod \"authorino-7dc7df685-k85vt\" (UID: \"b898b448-0828-467d-8314-f515c5bc1aa9\") " pod="kuadrant-system/authorino-7dc7df685-k85vt" Jul 15 13:38:37.761510 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:37.761418 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dc7df685-k85vt" Jul 15 13:38:37.917975 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:37.917948 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7dc7df685-k85vt"] Jul 15 13:38:37.920551 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:38:37.920521 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb898b448_0828_467d_8314_f515c5bc1aa9.slice/crio-fa1d7f922e9ff37d4eb6b4e7ad6c3f4186fa7fcf1721d1391a957686b1c33c22 WatchSource:0}: Error finding container fa1d7f922e9ff37d4eb6b4e7ad6c3f4186fa7fcf1721d1391a957686b1c33c22: Status 404 returned error can't find the container with id fa1d7f922e9ff37d4eb6b4e7ad6c3f4186fa7fcf1721d1391a957686b1c33c22 Jul 15 13:38:38.217124 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:38.217090 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7dc7df685-k85vt"] Jul 15 13:38:38.396326 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:38.396285 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-f944z" event={"ID":"3ab14346-0213-4bff-a1fb-452d16c34e86","Type":"ContainerStarted","Data":"c5867b28650c4156789f3d7d4daf0b3df8a6d2ffcc7b2065bfe52ff3c59f4804"} Jul 15 13:38:38.397788 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:38.397760 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dc7df685-k85vt" event={"ID":"b898b448-0828-467d-8314-f515c5bc1aa9","Type":"ContainerStarted","Data":"4a8286416a6939976b220e8a99c144803996047710b37df03c051359fec0044e"} Jul 15 13:38:38.397930 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:38.397797 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dc7df685-k85vt" event={"ID":"b898b448-0828-467d-8314-f515c5bc1aa9","Type":"ContainerStarted","Data":"fa1d7f922e9ff37d4eb6b4e7ad6c3f4186fa7fcf1721d1391a957686b1c33c22"} Jul 15 13:38:38.397930 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:38.397814 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7dc7df685-k85vt" podUID="b898b448-0828-467d-8314-f515c5bc1aa9" containerName="authorino" containerID="cri-o://4a8286416a6939976b220e8a99c144803996047710b37df03c051359fec0044e" gracePeriod=30 Jul 15 13:38:38.423671 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:38.423578 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7dc7df685-k85vt" podStartSLOduration=1.15122701 podStartE2EDuration="1.423559825s" totalImagesPullingTime="272.332815ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:38:38.423346102 +0000 UTC m=+578.542908120" watchObservedRunningTime="2026-07-15 13:38:38.423559825 +0000 UTC m=+578.543121841" Jul 15 13:38:38.656970 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:38.656937 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dc7df685-k85vt" Jul 15 13:38:38.739751 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:38.739715 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmj9f\" (UniqueName: \"kubernetes.io/projected/b898b448-0828-467d-8314-f515c5bc1aa9-kube-api-access-fmj9f\") pod \"b898b448-0828-467d-8314-f515c5bc1aa9\" (UID: \"b898b448-0828-467d-8314-f515c5bc1aa9\") " Jul 15 13:38:38.741920 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:38.741884 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b898b448-0828-467d-8314-f515c5bc1aa9-kube-api-access-fmj9f" (OuterVolumeSpecName: "kube-api-access-fmj9f") pod "b898b448-0828-467d-8314-f515c5bc1aa9" (UID: "b898b448-0828-467d-8314-f515c5bc1aa9"). InnerVolumeSpecName "kube-api-access-fmj9f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:38:38.841093 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:38.840998 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmj9f\" (UniqueName: \"kubernetes.io/projected/b898b448-0828-467d-8314-f515c5bc1aa9-kube-api-access-fmj9f\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:38:39.404547 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:39.404505 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-f944z" event={"ID":"3ab14346-0213-4bff-a1fb-452d16c34e86","Type":"ContainerStarted","Data":"b614330a16834d97d79494a36628eee189894aaa9974ab33840470cb2a38decd"} Jul 15 13:38:39.405019 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:39.404548 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-f944z" podUID="3ab14346-0213-4bff-a1fb-452d16c34e86" containerName="authorino" containerID="cri-o://b614330a16834d97d79494a36628eee189894aaa9974ab33840470cb2a38decd" gracePeriod=30 Jul 15 13:38:39.405970 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:39.405942 2558 generic.go:356] "Generic (PLEG): container finished" podID="b898b448-0828-467d-8314-f515c5bc1aa9" containerID="4a8286416a6939976b220e8a99c144803996047710b37df03c051359fec0044e" exitCode=0 Jul 15 13:38:39.406073 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:39.405984 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dc7df685-k85vt" Jul 15 13:38:39.406073 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:39.406028 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dc7df685-k85vt" event={"ID":"b898b448-0828-467d-8314-f515c5bc1aa9","Type":"ContainerDied","Data":"4a8286416a6939976b220e8a99c144803996047710b37df03c051359fec0044e"} Jul 15 13:38:39.406073 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:39.406067 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dc7df685-k85vt" event={"ID":"b898b448-0828-467d-8314-f515c5bc1aa9","Type":"ContainerDied","Data":"fa1d7f922e9ff37d4eb6b4e7ad6c3f4186fa7fcf1721d1391a957686b1c33c22"} Jul 15 13:38:39.406191 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:39.406084 2558 scope.go:117] "RemoveContainer" containerID="4a8286416a6939976b220e8a99c144803996047710b37df03c051359fec0044e" Jul 15 13:38:39.416212 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:39.416183 2558 scope.go:117] "RemoveContainer" containerID="4a8286416a6939976b220e8a99c144803996047710b37df03c051359fec0044e" Jul 15 13:38:39.416526 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:38:39.416502 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a8286416a6939976b220e8a99c144803996047710b37df03c051359fec0044e\": container with ID starting with 4a8286416a6939976b220e8a99c144803996047710b37df03c051359fec0044e not found: ID does not exist" containerID="4a8286416a6939976b220e8a99c144803996047710b37df03c051359fec0044e" Jul 15 13:38:39.416578 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:39.416539 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a8286416a6939976b220e8a99c144803996047710b37df03c051359fec0044e"} err="failed to get container status \"4a8286416a6939976b220e8a99c144803996047710b37df03c051359fec0044e\": rpc error: code = NotFound desc = could not find container \"4a8286416a6939976b220e8a99c144803996047710b37df03c051359fec0044e\": container with ID starting with 4a8286416a6939976b220e8a99c144803996047710b37df03c051359fec0044e not found: ID does not exist" Jul 15 13:38:39.425416 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:39.425372 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-f944z" podStartSLOduration=0.990172398 podStartE2EDuration="2.425357546s" totalImagesPullingTime="1.435185148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:38:39.423431141 +0000 UTC m=+579.542993161" watchObservedRunningTime="2026-07-15 13:38:39.425357546 +0000 UTC m=+579.544919566" Jul 15 13:38:39.492470 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:39.492438 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7dc7df685-k85vt"] Jul 15 13:38:39.497011 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:39.496981 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7dc7df685-k85vt"] Jul 15 13:38:39.651289 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:39.651257 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-f944z" Jul 15 13:38:39.749806 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:39.749754 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxcbq\" (UniqueName: \"kubernetes.io/projected/3ab14346-0213-4bff-a1fb-452d16c34e86-kube-api-access-lxcbq\") pod \"3ab14346-0213-4bff-a1fb-452d16c34e86\" (UID: \"3ab14346-0213-4bff-a1fb-452d16c34e86\") " Jul 15 13:38:39.751886 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:39.751854 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ab14346-0213-4bff-a1fb-452d16c34e86-kube-api-access-lxcbq" (OuterVolumeSpecName: "kube-api-access-lxcbq") pod "3ab14346-0213-4bff-a1fb-452d16c34e86" (UID: "3ab14346-0213-4bff-a1fb-452d16c34e86"). InnerVolumeSpecName "kube-api-access-lxcbq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:38:39.850767 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:39.850723 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxcbq\" (UniqueName: \"kubernetes.io/projected/3ab14346-0213-4bff-a1fb-452d16c34e86-kube-api-access-lxcbq\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:38:40.413967 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:40.413926 2558 generic.go:356] "Generic (PLEG): container finished" podID="3ab14346-0213-4bff-a1fb-452d16c34e86" containerID="b614330a16834d97d79494a36628eee189894aaa9974ab33840470cb2a38decd" exitCode=0 Jul 15 13:38:40.413967 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:40.413964 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-f944z" Jul 15 13:38:40.414487 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:40.414011 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-f944z" event={"ID":"3ab14346-0213-4bff-a1fb-452d16c34e86","Type":"ContainerDied","Data":"b614330a16834d97d79494a36628eee189894aaa9974ab33840470cb2a38decd"} Jul 15 13:38:40.414487 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:40.414062 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-f944z" event={"ID":"3ab14346-0213-4bff-a1fb-452d16c34e86","Type":"ContainerDied","Data":"c5867b28650c4156789f3d7d4daf0b3df8a6d2ffcc7b2065bfe52ff3c59f4804"} Jul 15 13:38:40.414487 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:40.414089 2558 scope.go:117] "RemoveContainer" containerID="b614330a16834d97d79494a36628eee189894aaa9974ab33840470cb2a38decd" Jul 15 13:38:40.424094 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:40.424074 2558 scope.go:117] "RemoveContainer" containerID="b614330a16834d97d79494a36628eee189894aaa9974ab33840470cb2a38decd" Jul 15 13:38:40.424426 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:38:40.424404 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b614330a16834d97d79494a36628eee189894aaa9974ab33840470cb2a38decd\": container with ID starting with b614330a16834d97d79494a36628eee189894aaa9974ab33840470cb2a38decd not found: ID does not exist" containerID="b614330a16834d97d79494a36628eee189894aaa9974ab33840470cb2a38decd" Jul 15 13:38:40.424478 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:40.424435 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b614330a16834d97d79494a36628eee189894aaa9974ab33840470cb2a38decd"} err="failed to get container status \"b614330a16834d97d79494a36628eee189894aaa9974ab33840470cb2a38decd\": rpc error: code = NotFound desc = could not find container \"b614330a16834d97d79494a36628eee189894aaa9974ab33840470cb2a38decd\": container with ID starting with b614330a16834d97d79494a36628eee189894aaa9974ab33840470cb2a38decd not found: ID does not exist" Jul 15 13:38:40.443866 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:40.443831 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f944z"] Jul 15 13:38:40.448470 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:40.448425 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f944z"] Jul 15 13:38:40.479683 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:40.479653 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ab14346-0213-4bff-a1fb-452d16c34e86" path="/var/lib/kubelet/pods/3ab14346-0213-4bff-a1fb-452d16c34e86/volumes" Jul 15 13:38:40.480016 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:38:40.480002 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b898b448-0828-467d-8314-f515c5bc1aa9" path="/var/lib/kubelet/pods/b898b448-0828-467d-8314-f515c5bc1aa9/volumes" Jul 15 13:39:00.365949 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:00.365922 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/1.log" Jul 15 13:39:00.367552 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:00.367534 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/1.log" Jul 15 13:39:00.372217 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:00.372197 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkf79_c92079f2-6ca8-4000-b0b8-128ba9dccd98/ovn-acl-logging/0.log" Jul 15 13:39:00.373783 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:00.373758 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkf79_c92079f2-6ca8-4000-b0b8-128ba9dccd98/ovn-acl-logging/0.log" Jul 15 13:39:39.401743 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.401654 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l"] Jul 15 13:39:39.404243 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.402014 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ab14346-0213-4bff-a1fb-452d16c34e86" containerName="authorino" Jul 15 13:39:39.404243 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.402029 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ab14346-0213-4bff-a1fb-452d16c34e86" containerName="authorino" Jul 15 13:39:39.404243 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.402043 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b898b448-0828-467d-8314-f515c5bc1aa9" containerName="authorino" Jul 15 13:39:39.404243 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.402049 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b898b448-0828-467d-8314-f515c5bc1aa9" containerName="authorino" Jul 15 13:39:39.404243 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.402103 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ab14346-0213-4bff-a1fb-452d16c34e86" containerName="authorino" Jul 15 13:39:39.404243 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.402115 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b898b448-0828-467d-8314-f515c5bc1aa9" containerName="authorino" Jul 15 13:39:39.405083 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.405066 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" Jul 15 13:39:39.409445 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.409426 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bdn7z\"" Jul 15 13:39:39.409581 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.409426 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 15 13:39:39.409760 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.409740 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 15 13:39:39.409868 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.409759 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 15 13:39:39.418349 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.418324 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l"] Jul 15 13:39:39.479860 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.479826 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vq5d\" (UniqueName: \"kubernetes.io/projected/5c1db85e-267a-47b0-9fb3-1e62781954e1-kube-api-access-5vq5d\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l\" (UID: \"5c1db85e-267a-47b0-9fb3-1e62781954e1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" Jul 15 13:39:39.480022 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.479870 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c1db85e-267a-47b0-9fb3-1e62781954e1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l\" (UID: \"5c1db85e-267a-47b0-9fb3-1e62781954e1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" Jul 15 13:39:39.480022 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.479911 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c1db85e-267a-47b0-9fb3-1e62781954e1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l\" (UID: \"5c1db85e-267a-47b0-9fb3-1e62781954e1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" Jul 15 13:39:39.480022 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.479960 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c1db85e-267a-47b0-9fb3-1e62781954e1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l\" (UID: \"5c1db85e-267a-47b0-9fb3-1e62781954e1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" Jul 15 13:39:39.480022 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.479982 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c1db85e-267a-47b0-9fb3-1e62781954e1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l\" (UID: \"5c1db85e-267a-47b0-9fb3-1e62781954e1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" Jul 15 13:39:39.480022 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.480000 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1db85e-267a-47b0-9fb3-1e62781954e1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l\" (UID: \"5c1db85e-267a-47b0-9fb3-1e62781954e1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" Jul 15 13:39:39.581099 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.581062 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vq5d\" (UniqueName: \"kubernetes.io/projected/5c1db85e-267a-47b0-9fb3-1e62781954e1-kube-api-access-5vq5d\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l\" (UID: \"5c1db85e-267a-47b0-9fb3-1e62781954e1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" Jul 15 13:39:39.581303 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.581109 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c1db85e-267a-47b0-9fb3-1e62781954e1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l\" (UID: \"5c1db85e-267a-47b0-9fb3-1e62781954e1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" Jul 15 13:39:39.581378 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.581308 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c1db85e-267a-47b0-9fb3-1e62781954e1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l\" (UID: \"5c1db85e-267a-47b0-9fb3-1e62781954e1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" Jul 15 13:39:39.581378 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.581367 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c1db85e-267a-47b0-9fb3-1e62781954e1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l\" (UID: \"5c1db85e-267a-47b0-9fb3-1e62781954e1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" Jul 15 13:39:39.581480 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.581390 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c1db85e-267a-47b0-9fb3-1e62781954e1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l\" (UID: \"5c1db85e-267a-47b0-9fb3-1e62781954e1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" Jul 15 13:39:39.581480 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.581412 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1db85e-267a-47b0-9fb3-1e62781954e1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l\" (UID: \"5c1db85e-267a-47b0-9fb3-1e62781954e1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" Jul 15 13:39:39.581557 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.581521 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c1db85e-267a-47b0-9fb3-1e62781954e1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l\" (UID: \"5c1db85e-267a-47b0-9fb3-1e62781954e1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" Jul 15 13:39:39.581699 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.581682 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c1db85e-267a-47b0-9fb3-1e62781954e1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l\" (UID: \"5c1db85e-267a-47b0-9fb3-1e62781954e1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" Jul 15 13:39:39.581800 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.581783 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c1db85e-267a-47b0-9fb3-1e62781954e1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l\" (UID: \"5c1db85e-267a-47b0-9fb3-1e62781954e1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" Jul 15 13:39:39.583759 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.583730 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c1db85e-267a-47b0-9fb3-1e62781954e1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l\" (UID: \"5c1db85e-267a-47b0-9fb3-1e62781954e1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" Jul 15 13:39:39.584023 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.584003 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1db85e-267a-47b0-9fb3-1e62781954e1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l\" (UID: \"5c1db85e-267a-47b0-9fb3-1e62781954e1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" Jul 15 13:39:39.593592 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.593569 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vq5d\" (UniqueName: \"kubernetes.io/projected/5c1db85e-267a-47b0-9fb3-1e62781954e1-kube-api-access-5vq5d\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l\" (UID: \"5c1db85e-267a-47b0-9fb3-1e62781954e1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" Jul 15 13:39:39.715846 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.715804 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" Jul 15 13:39:39.875104 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.875077 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l"] Jul 15 13:39:39.877760 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:39:39.877737 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c1db85e_267a_47b0_9fb3_1e62781954e1.slice/crio-76a537193239dd73d6181cd442fad7c4e3125042a8b72c2c5bd93308411c7835 WatchSource:0}: Error finding container 76a537193239dd73d6181cd442fad7c4e3125042a8b72c2c5bd93308411c7835: Status 404 returned error can't find the container with id 76a537193239dd73d6181cd442fad7c4e3125042a8b72c2c5bd93308411c7835 Jul 15 13:39:39.879190 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:39.879172 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 13:39:40.750268 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:40.750181 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" event={"ID":"5c1db85e-267a-47b0-9fb3-1e62781954e1","Type":"ContainerStarted","Data":"76a537193239dd73d6181cd442fad7c4e3125042a8b72c2c5bd93308411c7835"} Jul 15 13:39:41.757297 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:41.757256 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" event={"ID":"5c1db85e-267a-47b0-9fb3-1e62781954e1","Type":"ContainerStarted","Data":"5ca4a8eb8215f9e12c5f92b243ed0077ae795ae5091b6b6ae822abda7a0a0449"} Jul 15 13:39:41.781741 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:41.781685 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" podStartSLOduration=1.494384487 podStartE2EDuration="2.781668498s" totalImagesPullingTime="1.287284011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:39:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:39:41.778624422 +0000 UTC m=+641.898186438" watchObservedRunningTime="2026-07-15 13:39:41.781668498 +0000 UTC m=+641.901230517" Jul 15 13:39:49.716458 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:49.716419 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" Jul 15 13:39:49.716953 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:49.716477 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" Jul 15 13:39:49.729290 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:49.729261 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" Jul 15 13:39:49.812827 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:49.812799 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l" Jul 15 13:39:52.885236 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:52.885200 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p"] Jul 15 13:39:52.888724 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:52.888703 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" Jul 15 13:39:52.891491 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:52.891468 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 15 13:39:52.899132 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:52.899110 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p"] Jul 15 13:39:52.998990 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:52.998948 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d66c46b-0d6e-4788-8ac8-23aff85f2122-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twq6p\" (UID: \"4d66c46b-0d6e-4788-8ac8-23aff85f2122\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" Jul 15 13:39:52.998990 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:52.998993 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d66c46b-0d6e-4788-8ac8-23aff85f2122-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twq6p\" (UID: \"4d66c46b-0d6e-4788-8ac8-23aff85f2122\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" Jul 15 13:39:52.999228 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:52.999080 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d66c46b-0d6e-4788-8ac8-23aff85f2122-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twq6p\" (UID: \"4d66c46b-0d6e-4788-8ac8-23aff85f2122\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" Jul 15 13:39:52.999228 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:52.999127 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d66c46b-0d6e-4788-8ac8-23aff85f2122-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twq6p\" (UID: \"4d66c46b-0d6e-4788-8ac8-23aff85f2122\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" Jul 15 13:39:52.999228 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:52.999148 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lfrm\" (UniqueName: \"kubernetes.io/projected/4d66c46b-0d6e-4788-8ac8-23aff85f2122-kube-api-access-9lfrm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twq6p\" (UID: \"4d66c46b-0d6e-4788-8ac8-23aff85f2122\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" Jul 15 13:39:52.999228 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:52.999218 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d66c46b-0d6e-4788-8ac8-23aff85f2122-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twq6p\" (UID: \"4d66c46b-0d6e-4788-8ac8-23aff85f2122\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" Jul 15 13:39:53.099997 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:53.099960 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d66c46b-0d6e-4788-8ac8-23aff85f2122-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twq6p\" (UID: \"4d66c46b-0d6e-4788-8ac8-23aff85f2122\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" Jul 15 13:39:53.099997 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:53.100007 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d66c46b-0d6e-4788-8ac8-23aff85f2122-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twq6p\" (UID: \"4d66c46b-0d6e-4788-8ac8-23aff85f2122\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" Jul 15 13:39:53.100256 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:53.100053 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d66c46b-0d6e-4788-8ac8-23aff85f2122-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twq6p\" (UID: \"4d66c46b-0d6e-4788-8ac8-23aff85f2122\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" Jul 15 13:39:53.100256 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:53.100080 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d66c46b-0d6e-4788-8ac8-23aff85f2122-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twq6p\" (UID: \"4d66c46b-0d6e-4788-8ac8-23aff85f2122\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" Jul 15 13:39:53.100256 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:53.100212 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lfrm\" (UniqueName: \"kubernetes.io/projected/4d66c46b-0d6e-4788-8ac8-23aff85f2122-kube-api-access-9lfrm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twq6p\" (UID: \"4d66c46b-0d6e-4788-8ac8-23aff85f2122\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" Jul 15 13:39:53.100405 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:53.100357 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d66c46b-0d6e-4788-8ac8-23aff85f2122-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twq6p\" (UID: \"4d66c46b-0d6e-4788-8ac8-23aff85f2122\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" Jul 15 13:39:53.100496 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:53.100469 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d66c46b-0d6e-4788-8ac8-23aff85f2122-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twq6p\" (UID: \"4d66c46b-0d6e-4788-8ac8-23aff85f2122\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" Jul 15 13:39:53.100567 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:53.100514 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d66c46b-0d6e-4788-8ac8-23aff85f2122-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twq6p\" (UID: \"4d66c46b-0d6e-4788-8ac8-23aff85f2122\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" Jul 15 13:39:53.100705 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:53.100684 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d66c46b-0d6e-4788-8ac8-23aff85f2122-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twq6p\" (UID: \"4d66c46b-0d6e-4788-8ac8-23aff85f2122\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" Jul 15 13:39:53.102422 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:53.102393 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d66c46b-0d6e-4788-8ac8-23aff85f2122-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twq6p\" (UID: \"4d66c46b-0d6e-4788-8ac8-23aff85f2122\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" Jul 15 13:39:53.102712 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:53.102693 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d66c46b-0d6e-4788-8ac8-23aff85f2122-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twq6p\" (UID: \"4d66c46b-0d6e-4788-8ac8-23aff85f2122\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" Jul 15 13:39:53.110016 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:53.109990 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lfrm\" (UniqueName: \"kubernetes.io/projected/4d66c46b-0d6e-4788-8ac8-23aff85f2122-kube-api-access-9lfrm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twq6p\" (UID: \"4d66c46b-0d6e-4788-8ac8-23aff85f2122\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" Jul 15 13:39:53.199283 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:53.199239 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" Jul 15 13:39:53.344224 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:53.344166 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p"] Jul 15 13:39:53.345636 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:39:53.345611 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d66c46b_0d6e_4788_8ac8_23aff85f2122.slice/crio-cd809a7c122dce977ec73eb309bc8a42967fc5b52732bb82171c41308717134f WatchSource:0}: Error finding container cd809a7c122dce977ec73eb309bc8a42967fc5b52732bb82171c41308717134f: Status 404 returned error can't find the container with id cd809a7c122dce977ec73eb309bc8a42967fc5b52732bb82171c41308717134f Jul 15 13:39:53.822521 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:53.822376 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" event={"ID":"4d66c46b-0d6e-4788-8ac8-23aff85f2122","Type":"ContainerStarted","Data":"f42c8c5cf262bbf8e37b4fd891edc190bfb6aaeadeaec89620e33d9500088f38"} Jul 15 13:39:53.822521 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:53.822440 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" event={"ID":"4d66c46b-0d6e-4788-8ac8-23aff85f2122","Type":"ContainerStarted","Data":"cd809a7c122dce977ec73eb309bc8a42967fc5b52732bb82171c41308717134f"} Jul 15 13:39:53.842484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:39:53.842426 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" podStartSLOduration=1.6355986740000001 podStartE2EDuration="1.842409887s" totalImagesPullingTime="206.811213ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:39:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:39:53.842110596 +0000 UTC m=+653.961672618" watchObservedRunningTime="2026-07-15 13:39:53.842409887 +0000 UTC m=+653.961971906" Jul 15 13:40:03.200075 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:40:03.200022 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" Jul 15 13:40:03.200575 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:40:03.200108 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" Jul 15 13:40:03.212896 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:40:03.212871 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" Jul 15 13:40:03.887539 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:40:03.887507 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twq6p" Jul 15 13:41:44.693431 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:41:44.693400 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f5cc6f784-g7xsb"] Jul 15 13:41:44.695913 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:41:44.695896 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f5cc6f784-g7xsb" Jul 15 13:41:44.700046 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:41:44.700020 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 15 13:41:44.700183 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:41:44.700047 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-p2ldb\"" Jul 15 13:41:44.706480 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:41:44.706454 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f5cc6f784-g7xsb"] Jul 15 13:41:44.828537 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:41:44.828495 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd2e9142-f8ff-4635-bb0a-59f9e58400cb-tls-cert\") pod \"authorino-7f5cc6f784-g7xsb\" (UID: \"dd2e9142-f8ff-4635-bb0a-59f9e58400cb\") " pod="kuadrant-system/authorino-7f5cc6f784-g7xsb" Jul 15 13:41:44.828729 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:41:44.828665 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqb67\" (UniqueName: \"kubernetes.io/projected/dd2e9142-f8ff-4635-bb0a-59f9e58400cb-kube-api-access-bqb67\") pod \"authorino-7f5cc6f784-g7xsb\" (UID: \"dd2e9142-f8ff-4635-bb0a-59f9e58400cb\") " pod="kuadrant-system/authorino-7f5cc6f784-g7xsb" Jul 15 13:41:44.929502 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:41:44.929461 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd2e9142-f8ff-4635-bb0a-59f9e58400cb-tls-cert\") pod \"authorino-7f5cc6f784-g7xsb\" (UID: \"dd2e9142-f8ff-4635-bb0a-59f9e58400cb\") " pod="kuadrant-system/authorino-7f5cc6f784-g7xsb" Jul 15 13:41:44.929708 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:41:44.929543 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqb67\" (UniqueName: \"kubernetes.io/projected/dd2e9142-f8ff-4635-bb0a-59f9e58400cb-kube-api-access-bqb67\") pod \"authorino-7f5cc6f784-g7xsb\" (UID: \"dd2e9142-f8ff-4635-bb0a-59f9e58400cb\") " pod="kuadrant-system/authorino-7f5cc6f784-g7xsb" Jul 15 13:41:44.932123 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:41:44.932097 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd2e9142-f8ff-4635-bb0a-59f9e58400cb-tls-cert\") pod \"authorino-7f5cc6f784-g7xsb\" (UID: \"dd2e9142-f8ff-4635-bb0a-59f9e58400cb\") " pod="kuadrant-system/authorino-7f5cc6f784-g7xsb" Jul 15 13:41:44.938079 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:41:44.938049 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqb67\" (UniqueName: \"kubernetes.io/projected/dd2e9142-f8ff-4635-bb0a-59f9e58400cb-kube-api-access-bqb67\") pod \"authorino-7f5cc6f784-g7xsb\" (UID: \"dd2e9142-f8ff-4635-bb0a-59f9e58400cb\") " pod="kuadrant-system/authorino-7f5cc6f784-g7xsb" Jul 15 13:41:45.007035 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:41:45.006919 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f5cc6f784-g7xsb" Jul 15 13:41:45.159021 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:41:45.158994 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f5cc6f784-g7xsb"] Jul 15 13:41:45.160895 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:41:45.160866 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd2e9142_f8ff_4635_bb0a_59f9e58400cb.slice/crio-54efb98b72c0825406349c03a829d26d842e951592ee88f2a9fc0c4faed537b7 WatchSource:0}: Error finding container 54efb98b72c0825406349c03a829d26d842e951592ee88f2a9fc0c4faed537b7: Status 404 returned error can't find the container with id 54efb98b72c0825406349c03a829d26d842e951592ee88f2a9fc0c4faed537b7 Jul 15 13:41:45.449543 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:41:45.449513 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f5cc6f784-g7xsb" event={"ID":"dd2e9142-f8ff-4635-bb0a-59f9e58400cb","Type":"ContainerStarted","Data":"54efb98b72c0825406349c03a829d26d842e951592ee88f2a9fc0c4faed537b7"} Jul 15 13:41:46.457095 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:41:46.457060 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f5cc6f784-g7xsb" event={"ID":"dd2e9142-f8ff-4635-bb0a-59f9e58400cb","Type":"ContainerStarted","Data":"01937ba98f64511032c0dd6fc5e3d3a7e657979c21dbb44ec5e694b224643948"} Jul 15 13:41:46.482047 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:41:46.481991 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7f5cc6f784-g7xsb" podStartSLOduration=1.822189899 podStartE2EDuration="2.481971028s" totalImagesPullingTime="659.781129ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:41:46.479092218 +0000 UTC m=+766.598654238" watchObservedRunningTime="2026-07-15 13:41:46.481971028 +0000 UTC m=+766.601533047" Jul 15 13:44:00.407226 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:44:00.407154 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/1.log" Jul 15 13:44:00.407226 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:44:00.407159 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/1.log" Jul 15 13:44:00.414560 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:44:00.414528 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkf79_c92079f2-6ca8-4000-b0b8-128ba9dccd98/ovn-acl-logging/0.log" Jul 15 13:44:00.414740 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:44:00.414690 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkf79_c92079f2-6ca8-4000-b0b8-128ba9dccd98/ovn-acl-logging/0.log" Jul 15 13:48:11.886944 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:48:11.886905 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7xngh"] Jul 15 13:48:11.887534 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:48:11.887210 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7xngh" podUID="58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4" containerName="manager" containerID="cri-o://0f006a4e5433ce35f88b9c9561927a483e9a081bd99b498a8d45356a3e7dd89d" gracePeriod=10 Jul 15 13:48:15.951726 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:48:15.951701 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7xngh" Jul 15 13:48:16.030750 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:48:16.030665 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-st2rn\" (UniqueName: \"kubernetes.io/projected/58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4-kube-api-access-st2rn\") pod \"58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4\" (UID: \"58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4\") " Jul 15 13:48:16.030918 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:48:16.030772 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4-extensions-socket-volume\") pod \"58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4\" (UID: \"58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4\") " Jul 15 13:48:16.031115 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:48:16.031092 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4" (UID: "58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:48:16.032744 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:48:16.032715 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4-kube-api-access-st2rn" (OuterVolumeSpecName: "kube-api-access-st2rn") pod "58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4" (UID: "58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4"). InnerVolumeSpecName "kube-api-access-st2rn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:48:16.131720 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:48:16.131684 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4-extensions-socket-volume\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:48:16.131720 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:48:16.131712 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-st2rn\" (UniqueName: \"kubernetes.io/projected/58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4-kube-api-access-st2rn\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:48:16.700858 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:48:16.700819 2558 generic.go:356] "Generic (PLEG): container finished" podID="58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4" containerID="0f006a4e5433ce35f88b9c9561927a483e9a081bd99b498a8d45356a3e7dd89d" exitCode=0 Jul 15 13:48:16.701032 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:48:16.700869 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7xngh" Jul 15 13:48:16.701032 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:48:16.700907 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7xngh" event={"ID":"58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4","Type":"ContainerDied","Data":"0f006a4e5433ce35f88b9c9561927a483e9a081bd99b498a8d45356a3e7dd89d"} Jul 15 13:48:16.701032 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:48:16.700972 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7xngh" event={"ID":"58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4","Type":"ContainerDied","Data":"6b2da14931e8f4bdbdff66175cd0fbbb703a34e2638562e56eb1294b9310635a"} Jul 15 13:48:16.701032 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:48:16.701003 2558 scope.go:117] "RemoveContainer" containerID="0f006a4e5433ce35f88b9c9561927a483e9a081bd99b498a8d45356a3e7dd89d" Jul 15 13:48:16.711275 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:48:16.711257 2558 scope.go:117] "RemoveContainer" containerID="0f006a4e5433ce35f88b9c9561927a483e9a081bd99b498a8d45356a3e7dd89d" Jul 15 13:48:16.711555 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:48:16.711535 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f006a4e5433ce35f88b9c9561927a483e9a081bd99b498a8d45356a3e7dd89d\": container with ID starting with 0f006a4e5433ce35f88b9c9561927a483e9a081bd99b498a8d45356a3e7dd89d not found: ID does not exist" containerID="0f006a4e5433ce35f88b9c9561927a483e9a081bd99b498a8d45356a3e7dd89d" Jul 15 13:48:16.711632 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:48:16.711564 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f006a4e5433ce35f88b9c9561927a483e9a081bd99b498a8d45356a3e7dd89d"} err="failed to get container status \"0f006a4e5433ce35f88b9c9561927a483e9a081bd99b498a8d45356a3e7dd89d\": rpc error: code = NotFound desc = could not find container \"0f006a4e5433ce35f88b9c9561927a483e9a081bd99b498a8d45356a3e7dd89d\": container with ID starting with 0f006a4e5433ce35f88b9c9561927a483e9a081bd99b498a8d45356a3e7dd89d not found: ID does not exist" Jul 15 13:48:16.720537 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:48:16.720499 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7xngh"] Jul 15 13:48:16.726392 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:48:16.726371 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7xngh"] Jul 15 13:48:18.479859 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:48:18.479821 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4" path="/var/lib/kubelet/pods/58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4/volumes" Jul 15 13:49:00.444849 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:49:00.444805 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/1.log" Jul 15 13:49:00.446877 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:49:00.446858 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/1.log" Jul 15 13:49:00.451238 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:49:00.451213 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkf79_c92079f2-6ca8-4000-b0b8-128ba9dccd98/ovn-acl-logging/0.log" Jul 15 13:49:00.453090 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:49:00.453069 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkf79_c92079f2-6ca8-4000-b0b8-128ba9dccd98/ovn-acl-logging/0.log" Jul 15 13:49:13.091467 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:49:13.091430 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zswkz"] Jul 15 13:49:13.091955 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:49:13.091818 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4" containerName="manager" Jul 15 13:49:13.091955 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:49:13.091831 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4" containerName="manager" Jul 15 13:49:13.091955 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:49:13.091910 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="58bf99c1-50d4-4f9d-a0fa-d642d8ea0ca4" containerName="manager" Jul 15 13:49:13.095929 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:49:13.095910 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zswkz" Jul 15 13:49:13.099435 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:49:13.099409 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zsxrl\"" Jul 15 13:49:13.109500 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:49:13.109475 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zswkz"] Jul 15 13:49:13.139443 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:49:13.139393 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5587ffe-83ba-47c4-b8d9-5f87b66623b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zswkz\" (UID: \"f5587ffe-83ba-47c4-b8d9-5f87b66623b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zswkz" Jul 15 13:49:13.139672 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:49:13.139456 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvlrr\" (UniqueName: \"kubernetes.io/projected/f5587ffe-83ba-47c4-b8d9-5f87b66623b0-kube-api-access-xvlrr\") pod \"kuadrant-operator-controller-manager-86878c769f-zswkz\" (UID: \"f5587ffe-83ba-47c4-b8d9-5f87b66623b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zswkz" Jul 15 13:49:13.240182 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:49:13.240127 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5587ffe-83ba-47c4-b8d9-5f87b66623b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zswkz\" (UID: \"f5587ffe-83ba-47c4-b8d9-5f87b66623b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zswkz" Jul 15 13:49:13.240182 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:49:13.240188 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvlrr\" (UniqueName: \"kubernetes.io/projected/f5587ffe-83ba-47c4-b8d9-5f87b66623b0-kube-api-access-xvlrr\") pod \"kuadrant-operator-controller-manager-86878c769f-zswkz\" (UID: \"f5587ffe-83ba-47c4-b8d9-5f87b66623b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zswkz" Jul 15 13:49:13.240540 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:49:13.240517 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5587ffe-83ba-47c4-b8d9-5f87b66623b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zswkz\" (UID: \"f5587ffe-83ba-47c4-b8d9-5f87b66623b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zswkz" Jul 15 13:49:13.249504 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:49:13.249474 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvlrr\" (UniqueName: \"kubernetes.io/projected/f5587ffe-83ba-47c4-b8d9-5f87b66623b0-kube-api-access-xvlrr\") pod \"kuadrant-operator-controller-manager-86878c769f-zswkz\" (UID: \"f5587ffe-83ba-47c4-b8d9-5f87b66623b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zswkz" Jul 15 13:49:13.406797 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:49:13.406697 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zswkz" Jul 15 13:49:13.555591 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:49:13.555566 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zswkz"] Jul 15 13:49:13.557377 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:49:13.557349 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5587ffe_83ba_47c4_b8d9_5f87b66623b0.slice/crio-e3cd9ae28c5fdec3383c639b2372934f8058446b7fd79eeda36e215a2ca68200 WatchSource:0}: Error finding container e3cd9ae28c5fdec3383c639b2372934f8058446b7fd79eeda36e215a2ca68200: Status 404 returned error can't find the container with id e3cd9ae28c5fdec3383c639b2372934f8058446b7fd79eeda36e215a2ca68200 Jul 15 13:49:14.008585 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:49:14.008545 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zswkz" event={"ID":"f5587ffe-83ba-47c4-b8d9-5f87b66623b0","Type":"ContainerStarted","Data":"18eba92a15a7e883346f5c108a5a27572adef3538d145646073d312f7058fdf3"} Jul 15 13:49:14.008585 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:49:14.008618 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zswkz" event={"ID":"f5587ffe-83ba-47c4-b8d9-5f87b66623b0","Type":"ContainerStarted","Data":"e3cd9ae28c5fdec3383c639b2372934f8058446b7fd79eeda36e215a2ca68200"} Jul 15 13:49:14.008885 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:49:14.008647 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zswkz" Jul 15 13:49:14.032182 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:49:14.032128 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zswkz" podStartSLOduration=1.032111445 podStartE2EDuration="1.032111445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:49:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:49:14.029077333 +0000 UTC m=+1214.148639365" watchObservedRunningTime="2026-07-15 13:49:14.032111445 +0000 UTC m=+1214.151673464" Jul 15 13:49:25.016726 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:49:25.016687 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zswkz" Jul 15 13:54:00.489679 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:54:00.489654 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/1.log" Jul 15 13:54:00.492830 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:54:00.492808 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/1.log" Jul 15 13:54:00.495964 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:54:00.495939 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkf79_c92079f2-6ca8-4000-b0b8-128ba9dccd98/ovn-acl-logging/0.log" Jul 15 13:54:00.498848 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:54:00.498830 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkf79_c92079f2-6ca8-4000-b0b8-128ba9dccd98/ovn-acl-logging/0.log" Jul 15 13:57:04.667652 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.667592 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf"] Jul 15 13:57:04.671252 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.671229 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.675841 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.675809 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-65951df1-gw-openshift-default-dockercfg-c4x9p\"" Jul 15 13:57:04.689956 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.689925 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf"] Jul 15 13:57:04.781514 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.781477 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istio-podinfo\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.781695 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.781526 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-credential-socket\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.781695 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.781620 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istio-token\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.781826 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.781722 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istiod-ca-cert\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.781826 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.781755 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istio-envoy\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.781826 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.781796 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-workload-certs\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.781927 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.781845 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t46hd\" (UniqueName: \"kubernetes.io/projected/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-kube-api-access-t46hd\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.781927 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.781879 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istio-data\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.781927 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.781919 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-workload-socket\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.883051 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.882997 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t46hd\" (UniqueName: \"kubernetes.io/projected/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-kube-api-access-t46hd\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.883051 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.883056 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istio-data\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.883328 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.883095 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-workload-socket\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.883328 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.883122 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istio-podinfo\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.883328 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.883145 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-credential-socket\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.883328 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.883178 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istio-token\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.883328 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.883247 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istiod-ca-cert\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.883328 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.883276 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istio-envoy\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.883328 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.883319 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-workload-certs\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.883684 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.883593 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-workload-socket\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.883684 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.883654 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istio-data\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.883803 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.883685 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-credential-socket\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.884105 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.884078 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-workload-certs\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.884218 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.884105 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istiod-ca-cert\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.885561 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.885542 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istio-envoy\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.885912 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.885892 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istio-podinfo\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.894497 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.894467 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t46hd\" (UniqueName: \"kubernetes.io/projected/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-kube-api-access-t46hd\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.894584 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.894553 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istio-token\") pod \"e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:04.985373 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:04.985323 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:05.134259 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:05.134228 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf"] Jul 15 13:57:05.135321 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:57:05.135298 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36bedae6_cab5_4d41_bd8c_819fa99dc8cf.slice/crio-943a2c4fa28b27d515431d2e703348609fcfa47172a4b3e9658de285cfa8fcef WatchSource:0}: Error finding container 943a2c4fa28b27d515431d2e703348609fcfa47172a4b3e9658de285cfa8fcef: Status 404 returned error can't find the container with id 943a2c4fa28b27d515431d2e703348609fcfa47172a4b3e9658de285cfa8fcef Jul 15 13:57:05.137397 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:05.137367 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 13:57:05.137468 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:05.137428 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 13:57:05.137468 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:05.137455 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 13:57:05.674435 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:05.674401 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" event={"ID":"36bedae6-cab5-4d41-bd8c-819fa99dc8cf","Type":"ContainerStarted","Data":"232dcff14835bf13769375d2d56bd5dc7e91cea9d7138fc4a503de8d46032bd1"} Jul 15 13:57:05.674867 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:05.674454 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" event={"ID":"36bedae6-cab5-4d41-bd8c-819fa99dc8cf","Type":"ContainerStarted","Data":"943a2c4fa28b27d515431d2e703348609fcfa47172a4b3e9658de285cfa8fcef"} Jul 15 13:57:05.703271 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:05.703223 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" podStartSLOduration=1.703206127 podStartE2EDuration="1.703206127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:57:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:57:05.701438968 +0000 UTC m=+1685.821000988" watchObservedRunningTime="2026-07-15 13:57:05.703206127 +0000 UTC m=+1685.822768146" Jul 15 13:57:05.986099 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:05.986008 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:06.997942 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:06.997907 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:07.692876 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:07.692844 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:07.694017 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:07.693985 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:22.695051 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:22.695015 2558 patch_prober.go:28] interesting pod/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 15 13:57:22.695529 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:22.695080 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" podUID="36bedae6-cab5-4d41-bd8c-819fa99dc8cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 15 13:57:22.781893 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:22.781857 2558 generic.go:356] "Generic (PLEG): container finished" podID="36bedae6-cab5-4d41-bd8c-819fa99dc8cf" containerID="232dcff14835bf13769375d2d56bd5dc7e91cea9d7138fc4a503de8d46032bd1" exitCode=0 Jul 15 13:57:22.782055 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:22.781930 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" event={"ID":"36bedae6-cab5-4d41-bd8c-819fa99dc8cf","Type":"ContainerDied","Data":"232dcff14835bf13769375d2d56bd5dc7e91cea9d7138fc4a503de8d46032bd1"} Jul 15 13:57:22.782332 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:22.782319 2558 scope.go:117] "RemoveContainer" containerID="232dcff14835bf13769375d2d56bd5dc7e91cea9d7138fc4a503de8d46032bd1" Jul 15 13:57:22.783359 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:22.783337 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 13:57:22.783417 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:22.783400 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 13:57:22.783452 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:22.783428 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 13:57:23.789033 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:23.788992 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" event={"ID":"36bedae6-cab5-4d41-bd8c-819fa99dc8cf","Type":"ContainerStarted","Data":"748335af8a2d53f3719748e9bd41f13d120cc2154f6739637ee87e0a2be15925"} Jul 15 13:57:23.985674 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:23.985628 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:23.985936 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:23.985911 2558 patch_prober.go:28] interesting pod/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 15 13:57:23.985983 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:23.985961 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" podUID="36bedae6-cab5-4d41-bd8c-819fa99dc8cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 15 13:57:24.986353 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:24.986307 2558 patch_prober.go:28] interesting pod/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 15 13:57:24.986776 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:24.986367 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" podUID="36bedae6-cab5-4d41-bd8c-819fa99dc8cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 15 13:57:25.986267 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:25.986223 2558 patch_prober.go:28] interesting pod/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 15 13:57:25.986453 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:25.986288 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" podUID="36bedae6-cab5-4d41-bd8c-819fa99dc8cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 15 13:57:26.986005 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:26.985966 2558 patch_prober.go:28] interesting pod/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 15 13:57:26.986204 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:26.986038 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" podUID="36bedae6-cab5-4d41-bd8c-819fa99dc8cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 15 13:57:27.990321 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:27.990294 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:27.990779 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:27.990686 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:57:27.991315 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:57:27.991295 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:58:10.622133 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:10.622092 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf"] Jul 15 13:58:10.622760 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:10.622359 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" podUID="36bedae6-cab5-4d41-bd8c-819fa99dc8cf" containerName="istio-proxy" containerID="cri-o://748335af8a2d53f3719748e9bd41f13d120cc2154f6739637ee87e0a2be15925" gracePeriod=30 Jul 15 13:58:12.992729 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:12.992685 2558 patch_prober.go:28] interesting pod/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 13:58:12.993113 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:12.992765 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" podUID="36bedae6-cab5-4d41-bd8c-819fa99dc8cf" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 13:58:15.887036 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:15.886974 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:58:15.929446 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:15.929412 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-workload-certs\") pod \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " Jul 15 13:58:15.929698 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:15.929464 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-workload-socket\") pod \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " Jul 15 13:58:15.929698 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:15.929517 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-credential-socket\") pod \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " Jul 15 13:58:15.929698 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:15.929568 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t46hd\" (UniqueName: \"kubernetes.io/projected/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-kube-api-access-t46hd\") pod \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " Jul 15 13:58:15.929698 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:15.929656 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istio-envoy\") pod \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " Jul 15 13:58:15.929698 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:15.929693 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istio-token\") pod \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " Jul 15 13:58:15.929992 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:15.929768 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istio-podinfo\") pod \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " Jul 15 13:58:15.929992 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:15.929806 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istiod-ca-cert\") pod \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " Jul 15 13:58:15.929992 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:15.929842 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istio-data\") pod \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\" (UID: \"36bedae6-cab5-4d41-bd8c-819fa99dc8cf\") " Jul 15 13:58:15.929992 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:15.929826 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "36bedae6-cab5-4d41-bd8c-819fa99dc8cf" (UID: "36bedae6-cab5-4d41-bd8c-819fa99dc8cf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:58:15.929992 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:15.929875 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "36bedae6-cab5-4d41-bd8c-819fa99dc8cf" (UID: "36bedae6-cab5-4d41-bd8c-819fa99dc8cf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:58:15.930262 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:15.930111 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-workload-socket\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:58:15.930262 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:15.930126 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-credential-socket\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:58:15.930262 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:15.930159 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "36bedae6-cab5-4d41-bd8c-819fa99dc8cf" (UID: "36bedae6-cab5-4d41-bd8c-819fa99dc8cf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:58:15.930427 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:15.930311 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "36bedae6-cab5-4d41-bd8c-819fa99dc8cf" (UID: "36bedae6-cab5-4d41-bd8c-819fa99dc8cf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:58:15.931132 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:15.931101 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istio-data" (OuterVolumeSpecName: "istio-data") pod "36bedae6-cab5-4d41-bd8c-819fa99dc8cf" (UID: "36bedae6-cab5-4d41-bd8c-819fa99dc8cf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:58:15.932426 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:15.932381 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "36bedae6-cab5-4d41-bd8c-819fa99dc8cf" (UID: "36bedae6-cab5-4d41-bd8c-819fa99dc8cf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:58:15.933079 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:15.933049 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "36bedae6-cab5-4d41-bd8c-819fa99dc8cf" (UID: "36bedae6-cab5-4d41-bd8c-819fa99dc8cf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 13:58:15.933183 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:15.933120 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-kube-api-access-t46hd" (OuterVolumeSpecName: "kube-api-access-t46hd") pod "36bedae6-cab5-4d41-bd8c-819fa99dc8cf" (UID: "36bedae6-cab5-4d41-bd8c-819fa99dc8cf"). InnerVolumeSpecName "kube-api-access-t46hd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:58:15.933183 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:15.933140 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istio-token" (OuterVolumeSpecName: "istio-token") pod "36bedae6-cab5-4d41-bd8c-819fa99dc8cf" (UID: "36bedae6-cab5-4d41-bd8c-819fa99dc8cf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:58:16.031555 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:16.031518 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-workload-certs\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:58:16.031555 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:16.031546 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t46hd\" (UniqueName: \"kubernetes.io/projected/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-kube-api-access-t46hd\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:58:16.031555 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:16.031556 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istio-envoy\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:58:16.031855 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:16.031565 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istio-token\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:58:16.031855 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:16.031573 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istio-podinfo\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:58:16.031855 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:16.031581 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istiod-ca-cert\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:58:16.031855 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:16.031588 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36bedae6-cab5-4d41-bd8c-819fa99dc8cf-istio-data\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:58:16.083678 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:16.083630 2558 generic.go:356] "Generic (PLEG): container finished" podID="36bedae6-cab5-4d41-bd8c-819fa99dc8cf" containerID="748335af8a2d53f3719748e9bd41f13d120cc2154f6739637ee87e0a2be15925" exitCode=0 Jul 15 13:58:16.083861 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:16.083692 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" Jul 15 13:58:16.083861 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:16.083699 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" event={"ID":"36bedae6-cab5-4d41-bd8c-819fa99dc8cf","Type":"ContainerDied","Data":"748335af8a2d53f3719748e9bd41f13d120cc2154f6739637ee87e0a2be15925"} Jul 15 13:58:16.083861 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:16.083758 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf" event={"ID":"36bedae6-cab5-4d41-bd8c-819fa99dc8cf","Type":"ContainerDied","Data":"943a2c4fa28b27d515431d2e703348609fcfa47172a4b3e9658de285cfa8fcef"} Jul 15 13:58:16.083861 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:16.083779 2558 scope.go:117] "RemoveContainer" containerID="748335af8a2d53f3719748e9bd41f13d120cc2154f6739637ee87e0a2be15925" Jul 15 13:58:16.095495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:16.095477 2558 scope.go:117] "RemoveContainer" containerID="232dcff14835bf13769375d2d56bd5dc7e91cea9d7138fc4a503de8d46032bd1" Jul 15 13:58:16.103941 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:16.103924 2558 scope.go:117] "RemoveContainer" containerID="748335af8a2d53f3719748e9bd41f13d120cc2154f6739637ee87e0a2be15925" Jul 15 13:58:16.104235 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:58:16.104215 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"748335af8a2d53f3719748e9bd41f13d120cc2154f6739637ee87e0a2be15925\": container with ID starting with 748335af8a2d53f3719748e9bd41f13d120cc2154f6739637ee87e0a2be15925 not found: ID does not exist" containerID="748335af8a2d53f3719748e9bd41f13d120cc2154f6739637ee87e0a2be15925" Jul 15 13:58:16.104282 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:16.104246 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"748335af8a2d53f3719748e9bd41f13d120cc2154f6739637ee87e0a2be15925"} err="failed to get container status \"748335af8a2d53f3719748e9bd41f13d120cc2154f6739637ee87e0a2be15925\": rpc error: code = NotFound desc = could not find container \"748335af8a2d53f3719748e9bd41f13d120cc2154f6739637ee87e0a2be15925\": container with ID starting with 748335af8a2d53f3719748e9bd41f13d120cc2154f6739637ee87e0a2be15925 not found: ID does not exist" Jul 15 13:58:16.104282 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:16.104264 2558 scope.go:117] "RemoveContainer" containerID="232dcff14835bf13769375d2d56bd5dc7e91cea9d7138fc4a503de8d46032bd1" Jul 15 13:58:16.104490 ip-10-0-129-45 kubenswrapper[2558]: E0715 13:58:16.104473 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"232dcff14835bf13769375d2d56bd5dc7e91cea9d7138fc4a503de8d46032bd1\": container with ID starting with 232dcff14835bf13769375d2d56bd5dc7e91cea9d7138fc4a503de8d46032bd1 not found: ID does not exist" containerID="232dcff14835bf13769375d2d56bd5dc7e91cea9d7138fc4a503de8d46032bd1" Jul 15 13:58:16.104549 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:16.104500 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"232dcff14835bf13769375d2d56bd5dc7e91cea9d7138fc4a503de8d46032bd1"} err="failed to get container status \"232dcff14835bf13769375d2d56bd5dc7e91cea9d7138fc4a503de8d46032bd1\": rpc error: code = NotFound desc = could not find container \"232dcff14835bf13769375d2d56bd5dc7e91cea9d7138fc4a503de8d46032bd1\": container with ID starting with 232dcff14835bf13769375d2d56bd5dc7e91cea9d7138fc4a503de8d46032bd1 not found: ID does not exist" Jul 15 13:58:16.113075 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:16.113052 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf"] Jul 15 13:58:16.117796 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:16.117769 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-65951df1-gw-openshift-default-76cb867f87-xxkzf"] Jul 15 13:58:16.478825 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:16.478790 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36bedae6-cab5-4d41-bd8c-819fa99dc8cf" path="/var/lib/kubelet/pods/36bedae6-cab5-4d41-bd8c-819fa99dc8cf/volumes" Jul 15 13:58:23.813225 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.813190 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw"] Jul 15 13:58:23.813745 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.813727 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36bedae6-cab5-4d41-bd8c-819fa99dc8cf" containerName="istio-proxy" Jul 15 13:58:23.813845 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.813747 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="36bedae6-cab5-4d41-bd8c-819fa99dc8cf" containerName="istio-proxy" Jul 15 13:58:23.813845 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.813773 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36bedae6-cab5-4d41-bd8c-819fa99dc8cf" containerName="istio-proxy" Jul 15 13:58:23.813845 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.813781 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="36bedae6-cab5-4d41-bd8c-819fa99dc8cf" containerName="istio-proxy" Jul 15 13:58:23.814000 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.813881 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="36bedae6-cab5-4d41-bd8c-819fa99dc8cf" containerName="istio-proxy" Jul 15 13:58:23.814000 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.813893 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="36bedae6-cab5-4d41-bd8c-819fa99dc8cf" containerName="istio-proxy" Jul 15 13:58:23.819813 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.819791 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.824344 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.824326 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0e9155d7-openshift-default-dockercfg-2fxdz\"" Jul 15 13:58:23.838473 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.838448 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw"] Jul 15 13:58:23.893269 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.893237 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-credential-socket\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.893269 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.893269 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e940665-4bc5-42a5-9c1e-92208291794b-istiod-ca-cert\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.893500 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.893294 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-istio-data\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.893500 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.893322 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e940665-4bc5-42a5-9c1e-92208291794b-istio-token\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.893500 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.893363 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-istio-envoy\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.893500 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.893384 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m48pk\" (UniqueName: \"kubernetes.io/projected/8e940665-4bc5-42a5-9c1e-92208291794b-kube-api-access-m48pk\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.893500 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.893403 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e940665-4bc5-42a5-9c1e-92208291794b-istio-podinfo\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.893500 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.893426 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-workload-socket\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.893500 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.893491 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-workload-certs\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.994085 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.994055 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-credential-socket\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.994085 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.994089 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e940665-4bc5-42a5-9c1e-92208291794b-istiod-ca-cert\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.994332 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.994110 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-istio-data\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.994332 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.994293 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e940665-4bc5-42a5-9c1e-92208291794b-istio-token\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.994332 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.994318 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-istio-envoy\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.994497 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.994341 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m48pk\" (UniqueName: \"kubernetes.io/projected/8e940665-4bc5-42a5-9c1e-92208291794b-kube-api-access-m48pk\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.994497 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.994372 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e940665-4bc5-42a5-9c1e-92208291794b-istio-podinfo\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.994497 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.994414 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-workload-socket\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.994497 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.994448 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-workload-certs\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.994497 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.994469 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-credential-socket\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.994807 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.994493 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-istio-data\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.994807 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.994775 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-workload-socket\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.994913 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.994892 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-workload-certs\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.994984 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.994968 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e940665-4bc5-42a5-9c1e-92208291794b-istiod-ca-cert\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.996705 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.996677 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-istio-envoy\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:23.996825 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:23.996801 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e940665-4bc5-42a5-9c1e-92208291794b-istio-podinfo\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:24.007723 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:24.007699 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m48pk\" (UniqueName: \"kubernetes.io/projected/8e940665-4bc5-42a5-9c1e-92208291794b-kube-api-access-m48pk\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:24.015879 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:24.015853 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e940665-4bc5-42a5-9c1e-92208291794b-istio-token\") pod \"e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:24.129881 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:24.129818 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:24.283382 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:24.283355 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw"] Jul 15 13:58:24.284928 ip-10-0-129-45 kubenswrapper[2558]: W0715 13:58:24.284902 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e940665_4bc5_42a5_9c1e_92208291794b.slice/crio-979fa0bc8b70cff5e908da724953ec9bee248152025dec2b05017268456ad641 WatchSource:0}: Error finding container 979fa0bc8b70cff5e908da724953ec9bee248152025dec2b05017268456ad641: Status 404 returned error can't find the container with id 979fa0bc8b70cff5e908da724953ec9bee248152025dec2b05017268456ad641 Jul 15 13:58:24.287137 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:24.287108 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 13:58:24.287196 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:24.287171 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 13:58:24.287232 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:24.287199 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 13:58:25.134240 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:25.134203 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" event={"ID":"8e940665-4bc5-42a5-9c1e-92208291794b","Type":"ContainerStarted","Data":"aca906a51351274097420f04dfb08fd917f42da675d5c0104b90fb77039f15df"} Jul 15 13:58:25.134708 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:25.134258 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" event={"ID":"8e940665-4bc5-42a5-9c1e-92208291794b","Type":"ContainerStarted","Data":"979fa0bc8b70cff5e908da724953ec9bee248152025dec2b05017268456ad641"} Jul 15 13:58:25.203712 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:25.203664 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" podStartSLOduration=2.203638545 podStartE2EDuration="2.203638545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:58:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:58:25.200554041 +0000 UTC m=+1765.320116071" watchObservedRunningTime="2026-07-15 13:58:25.203638545 +0000 UTC m=+1765.323200629" Jul 15 13:58:26.130425 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:26.130385 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:26.135378 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:26.135351 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:26.140723 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:26.140699 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:26.141455 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:26.141435 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:41.489086 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:41.487633 2558 patch_prober.go:28] interesting pod/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": read tcp 10.132.0.2:52394->10.132.0.55:15021: read: connection reset by peer" start-of-body= Jul 15 13:58:41.489086 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:41.487703 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" podUID="8e940665-4bc5-42a5-9c1e-92208291794b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": read tcp 10.132.0.2:52394->10.132.0.55:15021: read: connection reset by peer" Jul 15 13:58:42.228112 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:42.228081 2558 generic.go:356] "Generic (PLEG): container finished" podID="8e940665-4bc5-42a5-9c1e-92208291794b" containerID="aca906a51351274097420f04dfb08fd917f42da675d5c0104b90fb77039f15df" exitCode=0 Jul 15 13:58:42.228272 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:42.228152 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" event={"ID":"8e940665-4bc5-42a5-9c1e-92208291794b","Type":"ContainerDied","Data":"aca906a51351274097420f04dfb08fd917f42da675d5c0104b90fb77039f15df"} Jul 15 13:58:42.228539 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:42.228522 2558 scope.go:117] "RemoveContainer" containerID="aca906a51351274097420f04dfb08fd917f42da675d5c0104b90fb77039f15df" Jul 15 13:58:42.229484 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:42.229457 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 13:58:42.229558 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:42.229524 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 13:58:42.229558 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:42.229554 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 13:58:43.240019 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:43.239974 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" event={"ID":"8e940665-4bc5-42a5-9c1e-92208291794b","Type":"ContainerStarted","Data":"ecb04e0c2895b5f7fed08c4aefef50c49bc004e340d8dbee7ca9f696fbd4351c"} Jul 15 13:58:44.130649 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:44.130588 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:44.130862 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:44.130831 2558 patch_prober.go:28] interesting pod/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 15 13:58:44.130942 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:44.130895 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" podUID="8e940665-4bc5-42a5-9c1e-92208291794b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 15 13:58:45.131277 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:45.131235 2558 patch_prober.go:28] interesting pod/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 15 13:58:45.131896 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:45.131860 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" podUID="8e940665-4bc5-42a5-9c1e-92208291794b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 15 13:58:46.131156 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:46.131116 2558 patch_prober.go:28] interesting pod/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 15 13:58:46.131369 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:46.131190 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" podUID="8e940665-4bc5-42a5-9c1e-92208291794b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 15 13:58:47.133999 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:47.133966 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:47.134366 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:47.134255 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:58:47.134957 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:58:47.134940 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:59:00.529070 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:00.529030 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/1.log" Jul 15 13:59:00.534803 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:00.534779 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/1.log" Jul 15 13:59:00.535170 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:00.535153 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkf79_c92079f2-6ca8-4000-b0b8-128ba9dccd98/ovn-acl-logging/0.log" Jul 15 13:59:00.540328 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:00.540313 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkf79_c92079f2-6ca8-4000-b0b8-128ba9dccd98/ovn-acl-logging/0.log" Jul 15 13:59:46.371410 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:46.371368 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw"] Jul 15 13:59:46.372023 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:46.371679 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" podUID="8e940665-4bc5-42a5-9c1e-92208291794b" containerName="istio-proxy" containerID="cri-o://ecb04e0c2895b5f7fed08c4aefef50c49bc004e340d8dbee7ca9f696fbd4351c" gracePeriod=30 Jul 15 13:59:47.137345 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:47.137254 2558 patch_prober.go:28] interesting pod/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 13:59:47.137345 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:47.137330 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" podUID="8e940665-4bc5-42a5-9c1e-92208291794b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 13:59:51.615986 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.615957 2558 generic.go:356] "Generic (PLEG): container finished" podID="8e940665-4bc5-42a5-9c1e-92208291794b" containerID="ecb04e0c2895b5f7fed08c4aefef50c49bc004e340d8dbee7ca9f696fbd4351c" exitCode=0 Jul 15 13:59:51.616328 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.616035 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" event={"ID":"8e940665-4bc5-42a5-9c1e-92208291794b","Type":"ContainerDied","Data":"ecb04e0c2895b5f7fed08c4aefef50c49bc004e340d8dbee7ca9f696fbd4351c"} Jul 15 13:59:51.616328 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.616150 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" event={"ID":"8e940665-4bc5-42a5-9c1e-92208291794b","Type":"ContainerDied","Data":"979fa0bc8b70cff5e908da724953ec9bee248152025dec2b05017268456ad641"} Jul 15 13:59:51.616328 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.616175 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="979fa0bc8b70cff5e908da724953ec9bee248152025dec2b05017268456ad641" Jul 15 13:59:51.616328 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.616192 2558 scope.go:117] "RemoveContainer" containerID="aca906a51351274097420f04dfb08fd917f42da675d5c0104b90fb77039f15df" Jul 15 13:59:51.627861 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.627842 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:59:51.644170 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.644120 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-istio-data\") pod \"8e940665-4bc5-42a5-9c1e-92208291794b\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " Jul 15 13:59:51.644170 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.644159 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-istio-envoy\") pod \"8e940665-4bc5-42a5-9c1e-92208291794b\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " Jul 15 13:59:51.644297 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.644192 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e940665-4bc5-42a5-9c1e-92208291794b-istiod-ca-cert\") pod \"8e940665-4bc5-42a5-9c1e-92208291794b\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " Jul 15 13:59:51.644297 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.644232 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e940665-4bc5-42a5-9c1e-92208291794b-istio-podinfo\") pod \"8e940665-4bc5-42a5-9c1e-92208291794b\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " Jul 15 13:59:51.644297 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.644252 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-credential-socket\") pod \"8e940665-4bc5-42a5-9c1e-92208291794b\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " Jul 15 13:59:51.644297 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.644278 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m48pk\" (UniqueName: \"kubernetes.io/projected/8e940665-4bc5-42a5-9c1e-92208291794b-kube-api-access-m48pk\") pod \"8e940665-4bc5-42a5-9c1e-92208291794b\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " Jul 15 13:59:51.644495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.644410 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e940665-4bc5-42a5-9c1e-92208291794b-istio-token\") pod \"8e940665-4bc5-42a5-9c1e-92208291794b\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " Jul 15 13:59:51.644495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.644463 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-workload-socket\") pod \"8e940665-4bc5-42a5-9c1e-92208291794b\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " Jul 15 13:59:51.644495 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.644489 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-workload-certs\") pod \"8e940665-4bc5-42a5-9c1e-92208291794b\" (UID: \"8e940665-4bc5-42a5-9c1e-92208291794b\") " Jul 15 13:59:51.644689 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.644566 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8e940665-4bc5-42a5-9c1e-92208291794b" (UID: "8e940665-4bc5-42a5-9c1e-92208291794b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:59:51.644746 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.644687 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e940665-4bc5-42a5-9c1e-92208291794b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8e940665-4bc5-42a5-9c1e-92208291794b" (UID: "8e940665-4bc5-42a5-9c1e-92208291794b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:59:51.644858 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.644838 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e940665-4bc5-42a5-9c1e-92208291794b-istiod-ca-cert\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:59:51.644940 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.644861 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-credential-socket\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:59:51.644997 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.644935 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8e940665-4bc5-42a5-9c1e-92208291794b" (UID: "8e940665-4bc5-42a5-9c1e-92208291794b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:59:51.645090 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.645068 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-istio-data" (OuterVolumeSpecName: "istio-data") pod "8e940665-4bc5-42a5-9c1e-92208291794b" (UID: "8e940665-4bc5-42a5-9c1e-92208291794b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:59:51.645153 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.645076 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8e940665-4bc5-42a5-9c1e-92208291794b" (UID: "8e940665-4bc5-42a5-9c1e-92208291794b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:59:51.646344 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.646308 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8e940665-4bc5-42a5-9c1e-92208291794b" (UID: "8e940665-4bc5-42a5-9c1e-92208291794b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:59:51.646579 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.646556 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e940665-4bc5-42a5-9c1e-92208291794b-istio-token" (OuterVolumeSpecName: "istio-token") pod "8e940665-4bc5-42a5-9c1e-92208291794b" (UID: "8e940665-4bc5-42a5-9c1e-92208291794b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:59:51.646766 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.646744 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e940665-4bc5-42a5-9c1e-92208291794b-kube-api-access-m48pk" (OuterVolumeSpecName: "kube-api-access-m48pk") pod "8e940665-4bc5-42a5-9c1e-92208291794b" (UID: "8e940665-4bc5-42a5-9c1e-92208291794b"). InnerVolumeSpecName "kube-api-access-m48pk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:59:51.646852 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.646788 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8e940665-4bc5-42a5-9c1e-92208291794b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8e940665-4bc5-42a5-9c1e-92208291794b" (UID: "8e940665-4bc5-42a5-9c1e-92208291794b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 13:59:51.745646 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.745596 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e940665-4bc5-42a5-9c1e-92208291794b-istio-token\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:59:51.745646 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.745638 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-workload-socket\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:59:51.745646 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.745647 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-workload-certs\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:59:51.745837 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.745655 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-istio-data\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:59:51.745837 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.745663 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e940665-4bc5-42a5-9c1e-92208291794b-istio-envoy\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:59:51.745837 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.745670 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e940665-4bc5-42a5-9c1e-92208291794b-istio-podinfo\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:59:51.745837 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:51.745678 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m48pk\" (UniqueName: \"kubernetes.io/projected/8e940665-4bc5-42a5-9c1e-92208291794b-kube-api-access-m48pk\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 13:59:52.622983 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:52.622958 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw" Jul 15 13:59:52.672378 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:52.672348 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw"] Jul 15 13:59:52.677711 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:52.677687 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0e9155d7-openshift-default-7f55b4c4dc-mrsvw"] Jul 15 13:59:54.478564 ip-10-0-129-45 kubenswrapper[2558]: I0715 13:59:54.478533 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e940665-4bc5-42a5-9c1e-92208291794b" path="/var/lib/kubelet/pods/8e940665-4bc5-42a5-9c1e-92208291794b/volumes" Jul 15 14:02:58.180251 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.180214 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv"] Jul 15 14:02:58.180851 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.180615 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e940665-4bc5-42a5-9c1e-92208291794b" containerName="istio-proxy" Jul 15 14:02:58.180851 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.180628 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e940665-4bc5-42a5-9c1e-92208291794b" containerName="istio-proxy" Jul 15 14:02:58.180851 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.180643 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e940665-4bc5-42a5-9c1e-92208291794b" containerName="istio-proxy" Jul 15 14:02:58.180851 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.180649 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e940665-4bc5-42a5-9c1e-92208291794b" containerName="istio-proxy" Jul 15 14:02:58.180851 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.180723 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e940665-4bc5-42a5-9c1e-92208291794b" containerName="istio-proxy" Jul 15 14:02:58.180851 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.180734 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e940665-4bc5-42a5-9c1e-92208291794b" containerName="istio-proxy" Jul 15 14:02:58.183916 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.183895 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.187365 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.187343 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-c382ffa7-openshift-default-dockercfg-74pp7\"" Jul 15 14:02:58.225267 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.225244 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv"] Jul 15 14:02:58.260244 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.260208 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-istio-data\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.260389 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.260250 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b36c73fa-51e6-4395-a276-b4277659854e-istiod-ca-cert\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.260389 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.260274 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czmc8\" (UniqueName: \"kubernetes.io/projected/b36c73fa-51e6-4395-a276-b4277659854e-kube-api-access-czmc8\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.260389 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.260334 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-istio-envoy\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.260553 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.260403 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-credential-socket\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.260553 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.260422 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-workload-certs\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.260553 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.260443 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b36c73fa-51e6-4395-a276-b4277659854e-istio-podinfo\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.260553 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.260466 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-workload-socket\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.260775 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.260561 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b36c73fa-51e6-4395-a276-b4277659854e-istio-token\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.361929 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.361898 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b36c73fa-51e6-4395-a276-b4277659854e-istio-token\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.362074 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.361954 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-istio-data\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.362074 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.361987 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b36c73fa-51e6-4395-a276-b4277659854e-istiod-ca-cert\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.362074 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.362008 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czmc8\" (UniqueName: \"kubernetes.io/projected/b36c73fa-51e6-4395-a276-b4277659854e-kube-api-access-czmc8\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.362074 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.362026 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-istio-envoy\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.362309 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.362083 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-credential-socket\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.362309 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.362111 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-workload-certs\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.362309 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.362145 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b36c73fa-51e6-4395-a276-b4277659854e-istio-podinfo\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.362309 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.362169 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-workload-socket\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.362614 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.362562 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-workload-certs\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.362614 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.362581 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-workload-socket\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.362796 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.362709 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-istio-data\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.362796 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.362719 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-credential-socket\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.362796 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.362790 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b36c73fa-51e6-4395-a276-b4277659854e-istiod-ca-cert\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.364586 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.364557 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-istio-envoy\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.364751 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.364729 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b36c73fa-51e6-4395-a276-b4277659854e-istio-podinfo\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.372370 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.372351 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b36c73fa-51e6-4395-a276-b4277659854e-istio-token\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.373861 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.373832 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czmc8\" (UniqueName: \"kubernetes.io/projected/b36c73fa-51e6-4395-a276-b4277659854e-kube-api-access-czmc8\") pod \"e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.494340 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.494279 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:02:58.646752 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.646716 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv"] Jul 15 14:02:58.649969 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.649923 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:02:58.650104 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.650053 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:02:58.650161 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:58.650135 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:02:59.658810 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:59.658771 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" event={"ID":"b36c73fa-51e6-4395-a276-b4277659854e","Type":"ContainerStarted","Data":"d247567768707618e7b96bbc186de1345e6e904610d058d07221f725eb701fb1"} Jul 15 14:02:59.659196 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:59.658830 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" event={"ID":"b36c73fa-51e6-4395-a276-b4277659854e","Type":"ContainerStarted","Data":"5dcb15af89c38ee5fdad3d3efe5dc2fa427659b1506273a0ec78f973aba16a19"} Jul 15 14:02:59.686461 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:02:59.686408 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" podStartSLOduration=1.686391166 podStartE2EDuration="1.686391166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:02:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:02:59.683979876 +0000 UTC m=+2039.803541923" watchObservedRunningTime="2026-07-15 14:02:59.686391166 +0000 UTC m=+2039.805953185" Jul 15 14:03:00.495358 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:00.495321 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:03:00.500289 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:00.500264 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:03:00.664070 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:00.664042 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:03:00.665026 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:00.665003 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:03:16.412482 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:16.411147 2558 patch_prober.go:28] interesting pod/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": read tcp 10.132.0.2:39670->10.132.0.56:15021: read: connection reset by peer" start-of-body= Jul 15 14:03:16.412482 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:16.411231 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" podUID="b36c73fa-51e6-4395-a276-b4277659854e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": read tcp 10.132.0.2:39670->10.132.0.56:15021: read: connection reset by peer" Jul 15 14:03:16.766548 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:16.766519 2558 generic.go:356] "Generic (PLEG): container finished" podID="b36c73fa-51e6-4395-a276-b4277659854e" containerID="d247567768707618e7b96bbc186de1345e6e904610d058d07221f725eb701fb1" exitCode=0 Jul 15 14:03:16.766738 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:16.766591 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" event={"ID":"b36c73fa-51e6-4395-a276-b4277659854e","Type":"ContainerDied","Data":"d247567768707618e7b96bbc186de1345e6e904610d058d07221f725eb701fb1"} Jul 15 14:03:16.766991 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:16.766977 2558 scope.go:117] "RemoveContainer" containerID="d247567768707618e7b96bbc186de1345e6e904610d058d07221f725eb701fb1" Jul 15 14:03:16.768094 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:16.768066 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:03:16.768171 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:16.768154 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:03:16.768212 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:16.768197 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:03:17.774442 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:17.774409 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" event={"ID":"b36c73fa-51e6-4395-a276-b4277659854e","Type":"ContainerStarted","Data":"de6d264675a6e93b14c3cdd1e2fdaf1a2fba36dc8717956d33a64df08002e102"} Jul 15 14:03:18.494544 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:18.494515 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:03:18.494764 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:18.494744 2558 patch_prober.go:28] interesting pod/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 15 14:03:18.494815 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:18.494791 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" podUID="b36c73fa-51e6-4395-a276-b4277659854e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 15 14:03:19.495253 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:19.495215 2558 patch_prober.go:28] interesting pod/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 15 14:03:19.495692 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:19.495273 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" podUID="b36c73fa-51e6-4395-a276-b4277659854e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 15 14:03:20.495087 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:20.495055 2558 patch_prober.go:28] interesting pod/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 15 14:03:20.495287 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:20.495109 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" podUID="b36c73fa-51e6-4395-a276-b4277659854e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 15 14:03:21.495311 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:21.495273 2558 patch_prober.go:28] interesting pod/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 15 14:03:21.495737 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:21.495330 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" podUID="b36c73fa-51e6-4395-a276-b4277659854e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 15 14:03:22.498034 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:22.497956 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:03:22.498461 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:22.498443 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:03:22.499193 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:22.499173 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:03:39.829638 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:39.829586 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv"] Jul 15 14:03:39.830149 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:39.829882 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" podUID="b36c73fa-51e6-4395-a276-b4277659854e" containerName="istio-proxy" containerID="cri-o://de6d264675a6e93b14c3cdd1e2fdaf1a2fba36dc8717956d33a64df08002e102" gracePeriod=30 Jul 15 14:03:45.085328 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.085300 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:03:45.187214 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.187189 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-istio-envoy\") pod \"b36c73fa-51e6-4395-a276-b4277659854e\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " Jul 15 14:03:45.187364 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.187222 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-workload-certs\") pod \"b36c73fa-51e6-4395-a276-b4277659854e\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " Jul 15 14:03:45.187364 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.187243 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-workload-socket\") pod \"b36c73fa-51e6-4395-a276-b4277659854e\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " Jul 15 14:03:45.187364 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.187267 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-istio-data\") pod \"b36c73fa-51e6-4395-a276-b4277659854e\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " Jul 15 14:03:45.187364 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.187287 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-credential-socket\") pod \"b36c73fa-51e6-4395-a276-b4277659854e\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " Jul 15 14:03:45.187364 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.187317 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b36c73fa-51e6-4395-a276-b4277659854e-istiod-ca-cert\") pod \"b36c73fa-51e6-4395-a276-b4277659854e\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " Jul 15 14:03:45.187364 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.187349 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b36c73fa-51e6-4395-a276-b4277659854e-istio-podinfo\") pod \"b36c73fa-51e6-4395-a276-b4277659854e\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " Jul 15 14:03:45.187738 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.187384 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czmc8\" (UniqueName: \"kubernetes.io/projected/b36c73fa-51e6-4395-a276-b4277659854e-kube-api-access-czmc8\") pod \"b36c73fa-51e6-4395-a276-b4277659854e\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " Jul 15 14:03:45.187738 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.187505 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b36c73fa-51e6-4395-a276-b4277659854e" (UID: "b36c73fa-51e6-4395-a276-b4277659854e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:03:45.187738 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.187549 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b36c73fa-51e6-4395-a276-b4277659854e" (UID: "b36c73fa-51e6-4395-a276-b4277659854e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:03:45.187738 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.187663 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b36c73fa-51e6-4395-a276-b4277659854e-istio-token\") pod \"b36c73fa-51e6-4395-a276-b4277659854e\" (UID: \"b36c73fa-51e6-4395-a276-b4277659854e\") " Jul 15 14:03:45.187738 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.187703 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b36c73fa-51e6-4395-a276-b4277659854e" (UID: "b36c73fa-51e6-4395-a276-b4277659854e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:03:45.187968 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.187792 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b36c73fa-51e6-4395-a276-b4277659854e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b36c73fa-51e6-4395-a276-b4277659854e" (UID: "b36c73fa-51e6-4395-a276-b4277659854e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:03:45.188060 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.188036 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-credential-socket\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:03:45.188139 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.188064 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b36c73fa-51e6-4395-a276-b4277659854e-istiod-ca-cert\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:03:45.188139 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.188079 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-workload-certs\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:03:45.188139 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.188093 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-workload-socket\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:03:45.188298 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.188235 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-istio-data" (OuterVolumeSpecName: "istio-data") pod "b36c73fa-51e6-4395-a276-b4277659854e" (UID: "b36c73fa-51e6-4395-a276-b4277659854e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:03:45.189484 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.189456 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b36c73fa-51e6-4395-a276-b4277659854e" (UID: "b36c73fa-51e6-4395-a276-b4277659854e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:03:45.189646 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.189581 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b36c73fa-51e6-4395-a276-b4277659854e-kube-api-access-czmc8" (OuterVolumeSpecName: "kube-api-access-czmc8") pod "b36c73fa-51e6-4395-a276-b4277659854e" (UID: "b36c73fa-51e6-4395-a276-b4277659854e"). InnerVolumeSpecName "kube-api-access-czmc8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 14:03:45.189646 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.189629 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b36c73fa-51e6-4395-a276-b4277659854e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b36c73fa-51e6-4395-a276-b4277659854e" (UID: "b36c73fa-51e6-4395-a276-b4277659854e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 14:03:45.189802 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.189784 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b36c73fa-51e6-4395-a276-b4277659854e-istio-token" (OuterVolumeSpecName: "istio-token") pod "b36c73fa-51e6-4395-a276-b4277659854e" (UID: "b36c73fa-51e6-4395-a276-b4277659854e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 14:03:45.289268 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.289236 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-istio-envoy\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:03:45.289268 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.289266 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b36c73fa-51e6-4395-a276-b4277659854e-istio-data\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:03:45.289268 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.289276 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b36c73fa-51e6-4395-a276-b4277659854e-istio-podinfo\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:03:45.289445 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.289284 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czmc8\" (UniqueName: \"kubernetes.io/projected/b36c73fa-51e6-4395-a276-b4277659854e-kube-api-access-czmc8\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:03:45.289445 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.289292 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b36c73fa-51e6-4395-a276-b4277659854e-istio-token\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:03:45.929471 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.929434 2558 generic.go:356] "Generic (PLEG): container finished" podID="b36c73fa-51e6-4395-a276-b4277659854e" containerID="de6d264675a6e93b14c3cdd1e2fdaf1a2fba36dc8717956d33a64df08002e102" exitCode=0 Jul 15 14:03:45.929668 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.929479 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" Jul 15 14:03:45.929668 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.929487 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" event={"ID":"b36c73fa-51e6-4395-a276-b4277659854e","Type":"ContainerDied","Data":"de6d264675a6e93b14c3cdd1e2fdaf1a2fba36dc8717956d33a64df08002e102"} Jul 15 14:03:45.929668 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.929532 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv" event={"ID":"b36c73fa-51e6-4395-a276-b4277659854e","Type":"ContainerDied","Data":"5dcb15af89c38ee5fdad3d3efe5dc2fa427659b1506273a0ec78f973aba16a19"} Jul 15 14:03:45.929668 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.929552 2558 scope.go:117] "RemoveContainer" containerID="de6d264675a6e93b14c3cdd1e2fdaf1a2fba36dc8717956d33a64df08002e102" Jul 15 14:03:45.942241 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.942202 2558 scope.go:117] "RemoveContainer" containerID="d247567768707618e7b96bbc186de1345e6e904610d058d07221f725eb701fb1" Jul 15 14:03:45.951215 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.951054 2558 scope.go:117] "RemoveContainer" containerID="de6d264675a6e93b14c3cdd1e2fdaf1a2fba36dc8717956d33a64df08002e102" Jul 15 14:03:45.951554 ip-10-0-129-45 kubenswrapper[2558]: E0715 14:03:45.951525 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de6d264675a6e93b14c3cdd1e2fdaf1a2fba36dc8717956d33a64df08002e102\": container with ID starting with de6d264675a6e93b14c3cdd1e2fdaf1a2fba36dc8717956d33a64df08002e102 not found: ID does not exist" containerID="de6d264675a6e93b14c3cdd1e2fdaf1a2fba36dc8717956d33a64df08002e102" Jul 15 14:03:45.951685 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.951562 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de6d264675a6e93b14c3cdd1e2fdaf1a2fba36dc8717956d33a64df08002e102"} err="failed to get container status \"de6d264675a6e93b14c3cdd1e2fdaf1a2fba36dc8717956d33a64df08002e102\": rpc error: code = NotFound desc = could not find container \"de6d264675a6e93b14c3cdd1e2fdaf1a2fba36dc8717956d33a64df08002e102\": container with ID starting with de6d264675a6e93b14c3cdd1e2fdaf1a2fba36dc8717956d33a64df08002e102 not found: ID does not exist" Jul 15 14:03:45.951685 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.951579 2558 scope.go:117] "RemoveContainer" containerID="d247567768707618e7b96bbc186de1345e6e904610d058d07221f725eb701fb1" Jul 15 14:03:45.951847 ip-10-0-129-45 kubenswrapper[2558]: E0715 14:03:45.951828 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d247567768707618e7b96bbc186de1345e6e904610d058d07221f725eb701fb1\": container with ID starting with d247567768707618e7b96bbc186de1345e6e904610d058d07221f725eb701fb1 not found: ID does not exist" containerID="d247567768707618e7b96bbc186de1345e6e904610d058d07221f725eb701fb1" Jul 15 14:03:45.951888 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.951852 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d247567768707618e7b96bbc186de1345e6e904610d058d07221f725eb701fb1"} err="failed to get container status \"d247567768707618e7b96bbc186de1345e6e904610d058d07221f725eb701fb1\": rpc error: code = NotFound desc = could not find container \"d247567768707618e7b96bbc186de1345e6e904610d058d07221f725eb701fb1\": container with ID starting with d247567768707618e7b96bbc186de1345e6e904610d058d07221f725eb701fb1 not found: ID does not exist" Jul 15 14:03:45.954166 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.954148 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv"] Jul 15 14:03:45.960527 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:45.960504 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-c382ffa7-openshift-default-78479884b7-mgqkv"] Jul 15 14:03:46.479755 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:03:46.479721 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b36c73fa-51e6-4395-a276-b4277659854e" path="/var/lib/kubelet/pods/b36c73fa-51e6-4395-a276-b4277659854e/volumes" Jul 15 14:04:00.574948 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:04:00.574915 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/1.log" Jul 15 14:04:00.578872 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:04:00.578841 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/1.log" Jul 15 14:04:00.582912 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:04:00.582889 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkf79_c92079f2-6ca8-4000-b0b8-128ba9dccd98/ovn-acl-logging/0.log" Jul 15 14:04:00.586864 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:04:00.586842 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkf79_c92079f2-6ca8-4000-b0b8-128ba9dccd98/ovn-acl-logging/0.log" Jul 15 14:05:00.773787 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:05:00.773713 2558 scope.go:117] "RemoveContainer" containerID="ecb04e0c2895b5f7fed08c4aefef50c49bc004e340d8dbee7ca9f696fbd4351c" Jul 15 14:06:37.911302 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:37.911217 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p"] Jul 15 14:06:37.911831 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:37.911773 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b36c73fa-51e6-4395-a276-b4277659854e" containerName="istio-proxy" Jul 15 14:06:37.911831 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:37.911788 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b36c73fa-51e6-4395-a276-b4277659854e" containerName="istio-proxy" Jul 15 14:06:37.911831 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:37.911805 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b36c73fa-51e6-4395-a276-b4277659854e" containerName="istio-proxy" Jul 15 14:06:37.911831 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:37.911814 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b36c73fa-51e6-4395-a276-b4277659854e" containerName="istio-proxy" Jul 15 14:06:37.912056 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:37.911897 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b36c73fa-51e6-4395-a276-b4277659854e" containerName="istio-proxy" Jul 15 14:06:37.912056 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:37.911908 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b36c73fa-51e6-4395-a276-b4277659854e" containerName="istio-proxy" Jul 15 14:06:37.915318 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:37.915294 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:37.918275 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:37.918247 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-59923e-openshift-default-dockercfg-27w8b\"" Jul 15 14:06:37.928148 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:37.928113 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p"] Jul 15 14:06:37.954474 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:37.954434 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-workload-socket\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:37.954474 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:37.954476 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1773d449-445e-4d00-baa8-f753f28bf35f-istio-podinfo\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:37.954731 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:37.954502 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-istio-envoy\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:37.954731 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:37.954586 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1773d449-445e-4d00-baa8-f753f28bf35f-istio-token\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:37.954731 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:37.954654 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1773d449-445e-4d00-baa8-f753f28bf35f-istiod-ca-cert\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:37.954731 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:37.954680 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-workload-certs\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:37.954731 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:37.954729 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-credential-socket\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:37.954960 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:37.954756 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-istio-data\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:37.954960 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:37.954770 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5zf5\" (UniqueName: \"kubernetes.io/projected/1773d449-445e-4d00-baa8-f753f28bf35f-kube-api-access-l5zf5\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:38.055850 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.055804 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-istio-data\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:38.055850 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.055841 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5zf5\" (UniqueName: \"kubernetes.io/projected/1773d449-445e-4d00-baa8-f753f28bf35f-kube-api-access-l5zf5\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:38.056171 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.055888 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-workload-socket\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:38.056171 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.055930 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1773d449-445e-4d00-baa8-f753f28bf35f-istio-podinfo\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:38.056171 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.055969 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-istio-envoy\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:38.056171 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.056004 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1773d449-445e-4d00-baa8-f753f28bf35f-istio-token\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:38.056171 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.056039 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1773d449-445e-4d00-baa8-f753f28bf35f-istiod-ca-cert\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:38.056171 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.056068 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-workload-certs\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:38.056539 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.056249 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-credential-socket\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:38.056539 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.056392 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-istio-data\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:38.056539 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.056409 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-workload-socket\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:38.056754 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.056693 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-workload-certs\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:38.057194 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.057169 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-credential-socket\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:38.057346 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.057249 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1773d449-445e-4d00-baa8-f753f28bf35f-istiod-ca-cert\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:38.058899 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.058873 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-istio-envoy\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:38.059098 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.059076 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1773d449-445e-4d00-baa8-f753f28bf35f-istio-podinfo\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:38.066134 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.066105 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1773d449-445e-4d00-baa8-f753f28bf35f-istio-token\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:38.066466 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.066449 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5zf5\" (UniqueName: \"kubernetes.io/projected/1773d449-445e-4d00-baa8-f753f28bf35f-kube-api-access-l5zf5\") pod \"e2e-inf-b-59923e-openshift-default-665f8d5765-f264p\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:38.228211 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.228180 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:38.372715 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.372681 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p"] Jul 15 14:06:38.374552 ip-10-0-129-45 kubenswrapper[2558]: W0715 14:06:38.374519 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1773d449_445e_4d00_baa8_f753f28bf35f.slice/crio-ecae5d18549e5a145fca27455d5b30dde1bfa90d7d7d73b5946e1e6b9697fc24 WatchSource:0}: Error finding container ecae5d18549e5a145fca27455d5b30dde1bfa90d7d7d73b5946e1e6b9697fc24: Status 404 returned error can't find the container with id ecae5d18549e5a145fca27455d5b30dde1bfa90d7d7d73b5946e1e6b9697fc24 Jul 15 14:06:38.376717 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.376690 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:06:38.376801 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.376751 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:06:38.376801 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.376778 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:06:38.873286 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.873244 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" event={"ID":"1773d449-445e-4d00-baa8-f753f28bf35f","Type":"ContainerStarted","Data":"39a411543c3f4555fe12454e2d209bdedccef1d3dce2e407af4c9fda85234bec"} Jul 15 14:06:38.873469 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.873300 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" event={"ID":"1773d449-445e-4d00-baa8-f753f28bf35f","Type":"ContainerStarted","Data":"ecae5d18549e5a145fca27455d5b30dde1bfa90d7d7d73b5946e1e6b9697fc24"} Jul 15 14:06:38.901203 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:38.901152 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" podStartSLOduration=1.901112758 podStartE2EDuration="1.901112758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:06:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:06:38.899385449 +0000 UTC m=+2259.018947479" watchObservedRunningTime="2026-07-15 14:06:38.901112758 +0000 UTC m=+2259.020674776" Jul 15 14:06:39.229109 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:39.229066 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:39.234307 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:39.234282 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:39.879019 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:39.878983 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:39.880068 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:39.880051 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:55.249257 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:55.248258 2558 patch_prober.go:28] interesting pod/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": read tcp 10.132.0.2:59358->10.132.0.57:15021: read: connection reset by peer" start-of-body= Jul 15 14:06:55.249257 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:55.248335 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" podUID="1773d449-445e-4d00-baa8-f753f28bf35f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": read tcp 10.132.0.2:59358->10.132.0.57:15021: read: connection reset by peer" Jul 15 14:06:55.977596 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:55.977562 2558 generic.go:356] "Generic (PLEG): container finished" podID="1773d449-445e-4d00-baa8-f753f28bf35f" containerID="39a411543c3f4555fe12454e2d209bdedccef1d3dce2e407af4c9fda85234bec" exitCode=0 Jul 15 14:06:55.977774 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:55.977635 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" event={"ID":"1773d449-445e-4d00-baa8-f753f28bf35f","Type":"ContainerDied","Data":"39a411543c3f4555fe12454e2d209bdedccef1d3dce2e407af4c9fda85234bec"} Jul 15 14:06:55.978062 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:55.978049 2558 scope.go:117] "RemoveContainer" containerID="39a411543c3f4555fe12454e2d209bdedccef1d3dce2e407af4c9fda85234bec" Jul 15 14:06:55.979082 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:55.979054 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:06:55.979188 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:55.979138 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:06:55.979252 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:55.979188 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:06:56.985301 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:56.985257 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" event={"ID":"1773d449-445e-4d00-baa8-f753f28bf35f","Type":"ContainerStarted","Data":"3ab3339c8590b6ab49bfa1a23f4cc9819542b7c1552fab3bee12dd0a7012e8b9"} Jul 15 14:06:57.229992 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:57.229954 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:06:57.230276 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:57.230243 2558 patch_prober.go:28] interesting pod/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 15 14:06:57.230365 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:57.230325 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" podUID="1773d449-445e-4d00-baa8-f753f28bf35f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 15 14:06:58.228868 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:58.228821 2558 patch_prober.go:28] interesting pod/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 15 14:06:58.229389 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:58.228894 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" podUID="1773d449-445e-4d00-baa8-f753f28bf35f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 15 14:06:59.229051 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:59.229009 2558 patch_prober.go:28] interesting pod/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 15 14:06:59.229718 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:06:59.229680 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" podUID="1773d449-445e-4d00-baa8-f753f28bf35f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 15 14:07:00.229058 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:07:00.229016 2558 patch_prober.go:28] interesting pod/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 15 14:07:00.229691 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:07:00.229653 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" podUID="1773d449-445e-4d00-baa8-f753f28bf35f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 15 14:07:01.232202 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:07:01.232169 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:07:01.232647 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:07:01.232455 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:07:01.233177 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:07:01.233159 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:08:37.216934 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:37.216902 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p"] Jul 15 14:08:37.217459 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:37.217147 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" podUID="1773d449-445e-4d00-baa8-f753f28bf35f" containerName="istio-proxy" containerID="cri-o://3ab3339c8590b6ab49bfa1a23f4cc9819542b7c1552fab3bee12dd0a7012e8b9" gracePeriod=30 Jul 15 14:08:42.473972 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.473942 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:08:42.550832 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.550750 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1773d449-445e-4d00-baa8-f753f28bf35f-istio-podinfo\") pod \"1773d449-445e-4d00-baa8-f753f28bf35f\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " Jul 15 14:08:42.550832 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.550809 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1773d449-445e-4d00-baa8-f753f28bf35f-istiod-ca-cert\") pod \"1773d449-445e-4d00-baa8-f753f28bf35f\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " Jul 15 14:08:42.551064 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.550837 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-workload-socket\") pod \"1773d449-445e-4d00-baa8-f753f28bf35f\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " Jul 15 14:08:42.551064 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.550868 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-credential-socket\") pod \"1773d449-445e-4d00-baa8-f753f28bf35f\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " Jul 15 14:08:42.551064 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.550886 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-istio-data\") pod \"1773d449-445e-4d00-baa8-f753f28bf35f\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " Jul 15 14:08:42.551064 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.550924 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-workload-certs\") pod \"1773d449-445e-4d00-baa8-f753f28bf35f\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " Jul 15 14:08:42.551064 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.551016 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-istio-envoy\") pod \"1773d449-445e-4d00-baa8-f753f28bf35f\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " Jul 15 14:08:42.551064 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.551043 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5zf5\" (UniqueName: \"kubernetes.io/projected/1773d449-445e-4d00-baa8-f753f28bf35f-kube-api-access-l5zf5\") pod \"1773d449-445e-4d00-baa8-f753f28bf35f\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " Jul 15 14:08:42.551382 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.551072 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1773d449-445e-4d00-baa8-f753f28bf35f-istio-token\") pod \"1773d449-445e-4d00-baa8-f753f28bf35f\" (UID: \"1773d449-445e-4d00-baa8-f753f28bf35f\") " Jul 15 14:08:42.551382 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.551154 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1773d449-445e-4d00-baa8-f753f28bf35f" (UID: "1773d449-445e-4d00-baa8-f753f28bf35f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:08:42.551382 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.551192 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1773d449-445e-4d00-baa8-f753f28bf35f" (UID: "1773d449-445e-4d00-baa8-f753f28bf35f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:08:42.551382 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.551306 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1773d449-445e-4d00-baa8-f753f28bf35f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1773d449-445e-4d00-baa8-f753f28bf35f" (UID: "1773d449-445e-4d00-baa8-f753f28bf35f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:08:42.551588 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.551417 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1773d449-445e-4d00-baa8-f753f28bf35f-istiod-ca-cert\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:08:42.551588 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.551440 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-workload-socket\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:08:42.551588 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.551459 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-credential-socket\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:08:42.551588 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.551559 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1773d449-445e-4d00-baa8-f753f28bf35f" (UID: "1773d449-445e-4d00-baa8-f753f28bf35f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:08:42.551853 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.551785 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-istio-data" (OuterVolumeSpecName: "istio-data") pod "1773d449-445e-4d00-baa8-f753f28bf35f" (UID: "1773d449-445e-4d00-baa8-f753f28bf35f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:08:42.553123 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.553094 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1773d449-445e-4d00-baa8-f753f28bf35f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1773d449-445e-4d00-baa8-f753f28bf35f" (UID: "1773d449-445e-4d00-baa8-f753f28bf35f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 14:08:42.553283 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.553258 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1773d449-445e-4d00-baa8-f753f28bf35f" (UID: "1773d449-445e-4d00-baa8-f753f28bf35f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:08:42.553353 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.553314 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1773d449-445e-4d00-baa8-f753f28bf35f-istio-token" (OuterVolumeSpecName: "istio-token") pod "1773d449-445e-4d00-baa8-f753f28bf35f" (UID: "1773d449-445e-4d00-baa8-f753f28bf35f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 14:08:42.553353 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.553332 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1773d449-445e-4d00-baa8-f753f28bf35f-kube-api-access-l5zf5" (OuterVolumeSpecName: "kube-api-access-l5zf5") pod "1773d449-445e-4d00-baa8-f753f28bf35f" (UID: "1773d449-445e-4d00-baa8-f753f28bf35f"). InnerVolumeSpecName "kube-api-access-l5zf5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 14:08:42.560469 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.560446 2558 generic.go:356] "Generic (PLEG): container finished" podID="1773d449-445e-4d00-baa8-f753f28bf35f" containerID="3ab3339c8590b6ab49bfa1a23f4cc9819542b7c1552fab3bee12dd0a7012e8b9" exitCode=0 Jul 15 14:08:42.560580 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.560517 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" Jul 15 14:08:42.560580 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.560527 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" event={"ID":"1773d449-445e-4d00-baa8-f753f28bf35f","Type":"ContainerDied","Data":"3ab3339c8590b6ab49bfa1a23f4cc9819542b7c1552fab3bee12dd0a7012e8b9"} Jul 15 14:08:42.560715 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.560585 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p" event={"ID":"1773d449-445e-4d00-baa8-f753f28bf35f","Type":"ContainerDied","Data":"ecae5d18549e5a145fca27455d5b30dde1bfa90d7d7d73b5946e1e6b9697fc24"} Jul 15 14:08:42.560715 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.560629 2558 scope.go:117] "RemoveContainer" containerID="3ab3339c8590b6ab49bfa1a23f4cc9819542b7c1552fab3bee12dd0a7012e8b9" Jul 15 14:08:42.573795 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.573778 2558 scope.go:117] "RemoveContainer" containerID="39a411543c3f4555fe12454e2d209bdedccef1d3dce2e407af4c9fda85234bec" Jul 15 14:08:42.583327 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.583311 2558 scope.go:117] "RemoveContainer" containerID="3ab3339c8590b6ab49bfa1a23f4cc9819542b7c1552fab3bee12dd0a7012e8b9" Jul 15 14:08:42.583843 ip-10-0-129-45 kubenswrapper[2558]: E0715 14:08:42.583722 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ab3339c8590b6ab49bfa1a23f4cc9819542b7c1552fab3bee12dd0a7012e8b9\": container with ID starting with 3ab3339c8590b6ab49bfa1a23f4cc9819542b7c1552fab3bee12dd0a7012e8b9 not found: ID does not exist" containerID="3ab3339c8590b6ab49bfa1a23f4cc9819542b7c1552fab3bee12dd0a7012e8b9" Jul 15 14:08:42.583843 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.583763 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab3339c8590b6ab49bfa1a23f4cc9819542b7c1552fab3bee12dd0a7012e8b9"} err="failed to get container status \"3ab3339c8590b6ab49bfa1a23f4cc9819542b7c1552fab3bee12dd0a7012e8b9\": rpc error: code = NotFound desc = could not find container \"3ab3339c8590b6ab49bfa1a23f4cc9819542b7c1552fab3bee12dd0a7012e8b9\": container with ID starting with 3ab3339c8590b6ab49bfa1a23f4cc9819542b7c1552fab3bee12dd0a7012e8b9 not found: ID does not exist" Jul 15 14:08:42.583843 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.583790 2558 scope.go:117] "RemoveContainer" containerID="39a411543c3f4555fe12454e2d209bdedccef1d3dce2e407af4c9fda85234bec" Jul 15 14:08:42.584252 ip-10-0-129-45 kubenswrapper[2558]: E0715 14:08:42.584127 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39a411543c3f4555fe12454e2d209bdedccef1d3dce2e407af4c9fda85234bec\": container with ID starting with 39a411543c3f4555fe12454e2d209bdedccef1d3dce2e407af4c9fda85234bec not found: ID does not exist" containerID="39a411543c3f4555fe12454e2d209bdedccef1d3dce2e407af4c9fda85234bec" Jul 15 14:08:42.584252 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.584157 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39a411543c3f4555fe12454e2d209bdedccef1d3dce2e407af4c9fda85234bec"} err="failed to get container status \"39a411543c3f4555fe12454e2d209bdedccef1d3dce2e407af4c9fda85234bec\": rpc error: code = NotFound desc = could not find container \"39a411543c3f4555fe12454e2d209bdedccef1d3dce2e407af4c9fda85234bec\": container with ID starting with 39a411543c3f4555fe12454e2d209bdedccef1d3dce2e407af4c9fda85234bec not found: ID does not exist" Jul 15 14:08:42.586860 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.586841 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p"] Jul 15 14:08:42.590857 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.590834 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-59923e-openshift-default-665f8d5765-f264p"] Jul 15 14:08:42.652103 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.652077 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-workload-certs\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:08:42.652103 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.652101 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-istio-envoy\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:08:42.652255 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.652113 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5zf5\" (UniqueName: \"kubernetes.io/projected/1773d449-445e-4d00-baa8-f753f28bf35f-kube-api-access-l5zf5\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:08:42.652255 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.652125 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1773d449-445e-4d00-baa8-f753f28bf35f-istio-token\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:08:42.652255 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.652138 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1773d449-445e-4d00-baa8-f753f28bf35f-istio-podinfo\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:08:42.652255 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:42.652150 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1773d449-445e-4d00-baa8-f753f28bf35f-istio-data\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:08:44.478994 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:44.478956 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1773d449-445e-4d00-baa8-f753f28bf35f" path="/var/lib/kubelet/pods/1773d449-445e-4d00-baa8-f753f28bf35f/volumes" Jul 15 14:08:46.786859 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.786810 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7"] Jul 15 14:08:46.787375 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.787353 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1773d449-445e-4d00-baa8-f753f28bf35f" containerName="istio-proxy" Jul 15 14:08:46.787487 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.787378 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1773d449-445e-4d00-baa8-f753f28bf35f" containerName="istio-proxy" Jul 15 14:08:46.787533 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.787499 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1773d449-445e-4d00-baa8-f753f28bf35f" containerName="istio-proxy" Jul 15 14:08:46.787533 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.787509 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1773d449-445e-4d00-baa8-f753f28bf35f" containerName="istio-proxy" Jul 15 14:08:46.792240 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.792221 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.795287 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.795271 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-f79741-openshift-default-dockercfg-wm58z\"" Jul 15 14:08:46.809738 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.809713 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7"] Jul 15 14:08:46.887540 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.887511 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-credential-socket\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.887754 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.887577 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-istio-envoy\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.887754 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.887665 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b86cea18-5bf6-40e8-8010-b86144899467-istio-podinfo\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.887754 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.887719 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-workload-socket\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.887754 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.887749 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc68c\" (UniqueName: \"kubernetes.io/projected/b86cea18-5bf6-40e8-8010-b86144899467-kube-api-access-mc68c\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.887964 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.887789 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-workload-certs\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.887964 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.887870 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-istio-data\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.887964 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.887931 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b86cea18-5bf6-40e8-8010-b86144899467-istio-token\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.888089 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.887993 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b86cea18-5bf6-40e8-8010-b86144899467-istiod-ca-cert\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.988696 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.988659 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-workload-certs\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.988869 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.988722 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-istio-data\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.988869 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.988751 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b86cea18-5bf6-40e8-8010-b86144899467-istio-token\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.988869 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.988780 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b86cea18-5bf6-40e8-8010-b86144899467-istiod-ca-cert\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.989033 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.988939 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-credential-socket\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.989033 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.989020 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-istio-envoy\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.989138 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.989050 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b86cea18-5bf6-40e8-8010-b86144899467-istio-podinfo\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.989138 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.989099 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-workload-socket\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.989138 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.989112 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-workload-certs\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.989138 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.989130 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc68c\" (UniqueName: \"kubernetes.io/projected/b86cea18-5bf6-40e8-8010-b86144899467-kube-api-access-mc68c\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.989336 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.989276 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-istio-data\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.989336 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.989324 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-credential-socket\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.989510 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.989489 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-workload-socket\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.989585 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.989565 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b86cea18-5bf6-40e8-8010-b86144899467-istiod-ca-cert\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.991500 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.991477 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-istio-envoy\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.991591 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.991546 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b86cea18-5bf6-40e8-8010-b86144899467-istio-podinfo\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.997903 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.997882 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b86cea18-5bf6-40e8-8010-b86144899467-istio-token\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:46.998104 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:46.998081 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc68c\" (UniqueName: \"kubernetes.io/projected/b86cea18-5bf6-40e8-8010-b86144899467-kube-api-access-mc68c\") pod \"e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:47.103184 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:47.103105 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:47.258155 ip-10-0-129-45 kubenswrapper[2558]: W0715 14:08:47.258123 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb86cea18_5bf6_40e8_8010_b86144899467.slice/crio-e4c10a24b53696b60a11db7bd23242d63cd5f889226f0e7a5dff94d028ad633d WatchSource:0}: Error finding container e4c10a24b53696b60a11db7bd23242d63cd5f889226f0e7a5dff94d028ad633d: Status 404 returned error can't find the container with id e4c10a24b53696b60a11db7bd23242d63cd5f889226f0e7a5dff94d028ad633d Jul 15 14:08:47.258325 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:47.258219 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7"] Jul 15 14:08:47.260316 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:47.260287 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:08:47.260409 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:47.260346 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:08:47.260409 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:47.260377 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:08:47.597802 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:47.597770 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" event={"ID":"b86cea18-5bf6-40e8-8010-b86144899467","Type":"ContainerStarted","Data":"8fbfc71d9ab0ce1c7ea94bd7bf3d15a0a37492a89286961d8d8a1e805a948b37"} Jul 15 14:08:47.597984 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:47.597824 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" event={"ID":"b86cea18-5bf6-40e8-8010-b86144899467","Type":"ContainerStarted","Data":"e4c10a24b53696b60a11db7bd23242d63cd5f889226f0e7a5dff94d028ad633d"} Jul 15 14:08:47.620919 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:47.620867 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" podStartSLOduration=1.620846096 podStartE2EDuration="1.620846096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:08:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:08:47.620173113 +0000 UTC m=+2387.739735133" watchObservedRunningTime="2026-07-15 14:08:47.620846096 +0000 UTC m=+2387.740408117" Jul 15 14:08:48.104098 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:48.104064 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:48.109061 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:48.109039 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:48.603342 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:48.603313 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:08:48.604158 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:08:48.604138 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:09:00.614594 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:00.614569 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/1.log" Jul 15 14:09:00.632426 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:00.632377 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkf79_c92079f2-6ca8-4000-b0b8-128ba9dccd98/ovn-acl-logging/0.log" Jul 15 14:09:00.639561 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:00.639522 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/1.log" Jul 15 14:09:00.652847 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:00.652827 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkf79_c92079f2-6ca8-4000-b0b8-128ba9dccd98/ovn-acl-logging/0.log" Jul 15 14:09:07.709616 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:07.709565 2558 generic.go:356] "Generic (PLEG): container finished" podID="b86cea18-5bf6-40e8-8010-b86144899467" containerID="8fbfc71d9ab0ce1c7ea94bd7bf3d15a0a37492a89286961d8d8a1e805a948b37" exitCode=0 Jul 15 14:09:07.710096 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:07.709637 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" event={"ID":"b86cea18-5bf6-40e8-8010-b86144899467","Type":"ContainerDied","Data":"8fbfc71d9ab0ce1c7ea94bd7bf3d15a0a37492a89286961d8d8a1e805a948b37"} Jul 15 14:09:07.710096 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:07.710013 2558 scope.go:117] "RemoveContainer" containerID="8fbfc71d9ab0ce1c7ea94bd7bf3d15a0a37492a89286961d8d8a1e805a948b37" Jul 15 14:09:07.710978 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:07.710951 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:09:07.711086 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:07.711018 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:09:07.711086 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:07.711048 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:09:08.723324 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:08.723278 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" event={"ID":"b86cea18-5bf6-40e8-8010-b86144899467","Type":"ContainerStarted","Data":"ee7f1bb0d496f7764209658f4f897ef2d0d6a15c8c1572f90adc816ea232ac96"} Jul 15 14:09:09.103671 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:09.103562 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:09:09.103827 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:09.103792 2558 patch_prober.go:28] interesting pod/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 15 14:09:09.103870 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:09.103848 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" podUID="b86cea18-5bf6-40e8-8010-b86144899467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 15 14:09:10.104637 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:10.104571 2558 patch_prober.go:28] interesting pod/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 15 14:09:10.105156 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:10.104682 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" podUID="b86cea18-5bf6-40e8-8010-b86144899467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 15 14:09:11.104069 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:11.104033 2558 patch_prober.go:28] interesting pod/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 15 14:09:11.104253 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:11.104105 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" podUID="b86cea18-5bf6-40e8-8010-b86144899467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 15 14:09:12.103995 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:12.103957 2558 patch_prober.go:28] interesting pod/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 15 14:09:12.104399 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:12.104022 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" podUID="b86cea18-5bf6-40e8-8010-b86144899467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 15 14:09:13.104059 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:13.104018 2558 patch_prober.go:28] interesting pod/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 15 14:09:13.104581 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:13.104090 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" podUID="b86cea18-5bf6-40e8-8010-b86144899467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 15 14:09:14.104362 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:14.104318 2558 patch_prober.go:28] interesting pod/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 15 14:09:14.104807 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:14.104705 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" podUID="b86cea18-5bf6-40e8-8010-b86144899467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 15 14:09:15.108090 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:15.108054 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:09:15.108488 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:15.108360 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:09:15.109002 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:15.108982 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:09:54.745506 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:54.745431 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7"] Jul 15 14:09:54.745993 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:09:54.745665 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" podUID="b86cea18-5bf6-40e8-8010-b86144899467" containerName="istio-proxy" containerID="cri-o://ee7f1bb0d496f7764209658f4f897ef2d0d6a15c8c1572f90adc816ea232ac96" gracePeriod=30 Jul 15 14:10:00.005704 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.005640 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:10:00.006044 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.005721 2558 generic.go:356] "Generic (PLEG): container finished" podID="b86cea18-5bf6-40e8-8010-b86144899467" containerID="ee7f1bb0d496f7764209658f4f897ef2d0d6a15c8c1572f90adc816ea232ac96" exitCode=0 Jul 15 14:10:00.006044 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.005789 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" event={"ID":"b86cea18-5bf6-40e8-8010-b86144899467","Type":"ContainerDied","Data":"ee7f1bb0d496f7764209658f4f897ef2d0d6a15c8c1572f90adc816ea232ac96"} Jul 15 14:10:00.006044 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.005846 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" event={"ID":"b86cea18-5bf6-40e8-8010-b86144899467","Type":"ContainerDied","Data":"e4c10a24b53696b60a11db7bd23242d63cd5f889226f0e7a5dff94d028ad633d"} Jul 15 14:10:00.006044 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.005877 2558 scope.go:117] "RemoveContainer" containerID="ee7f1bb0d496f7764209658f4f897ef2d0d6a15c8c1572f90adc816ea232ac96" Jul 15 14:10:00.017022 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.016971 2558 scope.go:117] "RemoveContainer" containerID="8fbfc71d9ab0ce1c7ea94bd7bf3d15a0a37492a89286961d8d8a1e805a948b37" Jul 15 14:10:00.028995 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.028977 2558 scope.go:117] "RemoveContainer" containerID="ee7f1bb0d496f7764209658f4f897ef2d0d6a15c8c1572f90adc816ea232ac96" Jul 15 14:10:00.029253 ip-10-0-129-45 kubenswrapper[2558]: E0715 14:10:00.029228 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee7f1bb0d496f7764209658f4f897ef2d0d6a15c8c1572f90adc816ea232ac96\": container with ID starting with ee7f1bb0d496f7764209658f4f897ef2d0d6a15c8c1572f90adc816ea232ac96 not found: ID does not exist" containerID="ee7f1bb0d496f7764209658f4f897ef2d0d6a15c8c1572f90adc816ea232ac96" Jul 15 14:10:00.029338 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.029264 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee7f1bb0d496f7764209658f4f897ef2d0d6a15c8c1572f90adc816ea232ac96"} err="failed to get container status \"ee7f1bb0d496f7764209658f4f897ef2d0d6a15c8c1572f90adc816ea232ac96\": rpc error: code = NotFound desc = could not find container \"ee7f1bb0d496f7764209658f4f897ef2d0d6a15c8c1572f90adc816ea232ac96\": container with ID starting with ee7f1bb0d496f7764209658f4f897ef2d0d6a15c8c1572f90adc816ea232ac96 not found: ID does not exist" Jul 15 14:10:00.029338 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.029288 2558 scope.go:117] "RemoveContainer" containerID="8fbfc71d9ab0ce1c7ea94bd7bf3d15a0a37492a89286961d8d8a1e805a948b37" Jul 15 14:10:00.029963 ip-10-0-129-45 kubenswrapper[2558]: E0715 14:10:00.029939 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fbfc71d9ab0ce1c7ea94bd7bf3d15a0a37492a89286961d8d8a1e805a948b37\": container with ID starting with 8fbfc71d9ab0ce1c7ea94bd7bf3d15a0a37492a89286961d8d8a1e805a948b37 not found: ID does not exist" containerID="8fbfc71d9ab0ce1c7ea94bd7bf3d15a0a37492a89286961d8d8a1e805a948b37" Jul 15 14:10:00.030060 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.029973 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fbfc71d9ab0ce1c7ea94bd7bf3d15a0a37492a89286961d8d8a1e805a948b37"} err="failed to get container status \"8fbfc71d9ab0ce1c7ea94bd7bf3d15a0a37492a89286961d8d8a1e805a948b37\": rpc error: code = NotFound desc = could not find container \"8fbfc71d9ab0ce1c7ea94bd7bf3d15a0a37492a89286961d8d8a1e805a948b37\": container with ID starting with 8fbfc71d9ab0ce1c7ea94bd7bf3d15a0a37492a89286961d8d8a1e805a948b37 not found: ID does not exist" Jul 15 14:10:00.059617 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.049133 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-istio-data\") pod \"b86cea18-5bf6-40e8-8010-b86144899467\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " Jul 15 14:10:00.059617 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.049188 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-workload-socket\") pod \"b86cea18-5bf6-40e8-8010-b86144899467\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " Jul 15 14:10:00.059617 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.049236 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mc68c\" (UniqueName: \"kubernetes.io/projected/b86cea18-5bf6-40e8-8010-b86144899467-kube-api-access-mc68c\") pod \"b86cea18-5bf6-40e8-8010-b86144899467\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " Jul 15 14:10:00.059617 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.049264 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b86cea18-5bf6-40e8-8010-b86144899467-istio-podinfo\") pod \"b86cea18-5bf6-40e8-8010-b86144899467\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " Jul 15 14:10:00.059617 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.049292 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b86cea18-5bf6-40e8-8010-b86144899467-istio-token\") pod \"b86cea18-5bf6-40e8-8010-b86144899467\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " Jul 15 14:10:00.059617 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.049321 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b86cea18-5bf6-40e8-8010-b86144899467-istiod-ca-cert\") pod \"b86cea18-5bf6-40e8-8010-b86144899467\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " Jul 15 14:10:00.059617 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.049378 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-istio-envoy\") pod \"b86cea18-5bf6-40e8-8010-b86144899467\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " Jul 15 14:10:00.059617 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.049418 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-credential-socket\") pod \"b86cea18-5bf6-40e8-8010-b86144899467\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " Jul 15 14:10:00.059617 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.049440 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-workload-certs\") pod \"b86cea18-5bf6-40e8-8010-b86144899467\" (UID: \"b86cea18-5bf6-40e8-8010-b86144899467\") " Jul 15 14:10:00.059617 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.049876 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b86cea18-5bf6-40e8-8010-b86144899467" (UID: "b86cea18-5bf6-40e8-8010-b86144899467"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:10:00.059617 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.050672 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-istio-data" (OuterVolumeSpecName: "istio-data") pod "b86cea18-5bf6-40e8-8010-b86144899467" (UID: "b86cea18-5bf6-40e8-8010-b86144899467"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:10:00.059617 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.051161 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b86cea18-5bf6-40e8-8010-b86144899467" (UID: "b86cea18-5bf6-40e8-8010-b86144899467"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:10:00.059617 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.051439 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b86cea18-5bf6-40e8-8010-b86144899467-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b86cea18-5bf6-40e8-8010-b86144899467" (UID: "b86cea18-5bf6-40e8-8010-b86144899467"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:10:00.059617 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.051934 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b86cea18-5bf6-40e8-8010-b86144899467" (UID: "b86cea18-5bf6-40e8-8010-b86144899467"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:10:00.075677 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.073242 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b86cea18-5bf6-40e8-8010-b86144899467-istio-token" (OuterVolumeSpecName: "istio-token") pod "b86cea18-5bf6-40e8-8010-b86144899467" (UID: "b86cea18-5bf6-40e8-8010-b86144899467"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 14:10:00.075677 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.073556 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b86cea18-5bf6-40e8-8010-b86144899467" (UID: "b86cea18-5bf6-40e8-8010-b86144899467"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:10:00.075677 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.073634 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b86cea18-5bf6-40e8-8010-b86144899467-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b86cea18-5bf6-40e8-8010-b86144899467" (UID: "b86cea18-5bf6-40e8-8010-b86144899467"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 14:10:00.078871 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.078825 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b86cea18-5bf6-40e8-8010-b86144899467-kube-api-access-mc68c" (OuterVolumeSpecName: "kube-api-access-mc68c") pod "b86cea18-5bf6-40e8-8010-b86144899467" (UID: "b86cea18-5bf6-40e8-8010-b86144899467"). InnerVolumeSpecName "kube-api-access-mc68c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 14:10:00.151120 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.151082 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mc68c\" (UniqueName: \"kubernetes.io/projected/b86cea18-5bf6-40e8-8010-b86144899467-kube-api-access-mc68c\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:10:00.151120 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.151121 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b86cea18-5bf6-40e8-8010-b86144899467-istio-podinfo\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:10:00.151318 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.151137 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b86cea18-5bf6-40e8-8010-b86144899467-istio-token\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:10:00.151318 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.151151 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b86cea18-5bf6-40e8-8010-b86144899467-istiod-ca-cert\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:10:00.151318 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.151165 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-istio-envoy\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:10:00.151318 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.151178 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-credential-socket\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:10:00.151318 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.151193 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-workload-certs\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:10:00.151318 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.151207 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-istio-data\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:10:00.151318 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:00.151219 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b86cea18-5bf6-40e8-8010-b86144899467-workload-socket\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:10:01.011004 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:01.010972 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7" Jul 15 14:10:01.082082 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:01.082054 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7"] Jul 15 14:10:01.087458 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:01.087436 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-f79741-openshift-default-f948d4b8f-t8dx7"] Jul 15 14:10:02.480018 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:02.479985 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b86cea18-5bf6-40e8-8010-b86144899467" path="/var/lib/kubelet/pods/b86cea18-5bf6-40e8-8010-b86144899467/volumes" Jul 15 14:10:04.038650 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.038615 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25"] Jul 15 14:10:04.039162 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.039143 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1773d449-445e-4d00-baa8-f753f28bf35f" containerName="istio-proxy" Jul 15 14:10:04.039241 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.039165 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1773d449-445e-4d00-baa8-f753f28bf35f" containerName="istio-proxy" Jul 15 14:10:04.039241 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.039180 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b86cea18-5bf6-40e8-8010-b86144899467" containerName="istio-proxy" Jul 15 14:10:04.039241 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.039188 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b86cea18-5bf6-40e8-8010-b86144899467" containerName="istio-proxy" Jul 15 14:10:04.039241 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.039214 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b86cea18-5bf6-40e8-8010-b86144899467" containerName="istio-proxy" Jul 15 14:10:04.039241 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.039222 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b86cea18-5bf6-40e8-8010-b86144899467" containerName="istio-proxy" Jul 15 14:10:04.039480 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.039317 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b86cea18-5bf6-40e8-8010-b86144899467" containerName="istio-proxy" Jul 15 14:10:04.039480 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.039331 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b86cea18-5bf6-40e8-8010-b86144899467" containerName="istio-proxy" Jul 15 14:10:04.042712 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.042690 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.046170 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.046149 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-bfdd40-openshift-default-dockercfg-w2znv\"" Jul 15 14:10:04.060267 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.060243 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25"] Jul 15 14:10:04.088303 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.088277 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-istio-envoy\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.088398 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.088311 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a013330-8dc1-4210-b98f-1155c2e43b37-istio-podinfo\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.088398 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.088331 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a013330-8dc1-4210-b98f-1155c2e43b37-istiod-ca-cert\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.088398 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.088348 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-workload-certs\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.088506 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.088397 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-istio-data\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.088506 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.088450 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-credential-socket\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.088506 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.088494 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzljj\" (UniqueName: \"kubernetes.io/projected/6a013330-8dc1-4210-b98f-1155c2e43b37-kube-api-access-vzljj\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.088633 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.088521 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a013330-8dc1-4210-b98f-1155c2e43b37-istio-token\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.088633 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.088563 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-workload-socket\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.189724 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.189698 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzljj\" (UniqueName: \"kubernetes.io/projected/6a013330-8dc1-4210-b98f-1155c2e43b37-kube-api-access-vzljj\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.189848 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.189740 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a013330-8dc1-4210-b98f-1155c2e43b37-istio-token\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.189848 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.189778 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-workload-socket\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.189935 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.189844 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-istio-envoy\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.189935 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.189878 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a013330-8dc1-4210-b98f-1155c2e43b37-istio-podinfo\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.189935 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.189903 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a013330-8dc1-4210-b98f-1155c2e43b37-istiod-ca-cert\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.189935 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.189929 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-workload-certs\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.190082 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.189958 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-istio-data\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.190082 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.189992 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-credential-socket\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.190249 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.190222 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-workload-socket\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.190373 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.190345 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-workload-certs\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.190501 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.190400 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-credential-socket\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.190501 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.190483 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-istio-data\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.190665 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.190645 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a013330-8dc1-4210-b98f-1155c2e43b37-istiod-ca-cert\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.192169 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.192147 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-istio-envoy\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.192430 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.192409 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a013330-8dc1-4210-b98f-1155c2e43b37-istio-podinfo\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.198871 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.198845 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a013330-8dc1-4210-b98f-1155c2e43b37-istio-token\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.198964 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.198903 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzljj\" (UniqueName: \"kubernetes.io/projected/6a013330-8dc1-4210-b98f-1155c2e43b37-kube-api-access-vzljj\") pod \"e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.353630 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.353525 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:04.501331 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.501308 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25"] Jul 15 14:10:04.503215 ip-10-0-129-45 kubenswrapper[2558]: W0715 14:10:04.503191 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a013330_8dc1_4210_b98f_1155c2e43b37.slice/crio-71a639cb7fe53ce4f754ebb12a10e929397b6f2d0c88f790a8907064425f803f WatchSource:0}: Error finding container 71a639cb7fe53ce4f754ebb12a10e929397b6f2d0c88f790a8907064425f803f: Status 404 returned error can't find the container with id 71a639cb7fe53ce4f754ebb12a10e929397b6f2d0c88f790a8907064425f803f Jul 15 14:10:04.505508 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.505463 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:10:04.505584 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.505558 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:10:04.505663 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:04.505644 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:10:05.037353 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:05.037316 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" event={"ID":"6a013330-8dc1-4210-b98f-1155c2e43b37","Type":"ContainerStarted","Data":"cf713d3bfa2e70d7dd7f472b0f946c1631d9d85af1c08965e859926c79243828"} Jul 15 14:10:05.037510 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:05.037372 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" event={"ID":"6a013330-8dc1-4210-b98f-1155c2e43b37","Type":"ContainerStarted","Data":"71a639cb7fe53ce4f754ebb12a10e929397b6f2d0c88f790a8907064425f803f"} Jul 15 14:10:05.062911 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:05.062854 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" podStartSLOduration=1.062834933 podStartE2EDuration="1.062834933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:10:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:10:05.061251153 +0000 UTC m=+2465.180813173" watchObservedRunningTime="2026-07-15 14:10:05.062834933 +0000 UTC m=+2465.182396952" Jul 15 14:10:05.353950 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:05.353859 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:05.359946 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:05.359920 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:06.042315 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:06.042288 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:06.043284 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:06.043260 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:26.173335 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:26.173298 2558 generic.go:356] "Generic (PLEG): container finished" podID="6a013330-8dc1-4210-b98f-1155c2e43b37" containerID="cf713d3bfa2e70d7dd7f472b0f946c1631d9d85af1c08965e859926c79243828" exitCode=0 Jul 15 14:10:26.173846 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:26.173367 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" event={"ID":"6a013330-8dc1-4210-b98f-1155c2e43b37","Type":"ContainerDied","Data":"cf713d3bfa2e70d7dd7f472b0f946c1631d9d85af1c08965e859926c79243828"} Jul 15 14:10:26.173846 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:26.173776 2558 scope.go:117] "RemoveContainer" containerID="cf713d3bfa2e70d7dd7f472b0f946c1631d9d85af1c08965e859926c79243828" Jul 15 14:10:26.174834 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:26.174806 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:10:26.174905 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:26.174885 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:10:26.174942 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:26.174929 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 14:10:27.181100 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:27.181065 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" event={"ID":"6a013330-8dc1-4210-b98f-1155c2e43b37","Type":"ContainerStarted","Data":"bc71ff0f5b1ee337d8e3566810cbb836777974312c726ee38a4963475121bf29"} Jul 15 14:10:27.354042 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:27.353999 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:27.354289 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:27.354265 2558 patch_prober.go:28] interesting pod/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 15 14:10:27.354347 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:27.354327 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" podUID="6a013330-8dc1-4210-b98f-1155c2e43b37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 15 14:10:28.354177 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:28.354135 2558 patch_prober.go:28] interesting pod/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 15 14:10:28.354576 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:28.354194 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" podUID="6a013330-8dc1-4210-b98f-1155c2e43b37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 15 14:10:29.354482 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:29.354443 2558 patch_prober.go:28] interesting pod/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 15 14:10:29.354936 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:29.354501 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" podUID="6a013330-8dc1-4210-b98f-1155c2e43b37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 15 14:10:30.354965 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:30.354921 2558 patch_prober.go:28] interesting pod/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 15 14:10:30.355383 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:30.354976 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" podUID="6a013330-8dc1-4210-b98f-1155c2e43b37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 15 14:10:31.358456 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:31.358425 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:31.358882 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:31.358716 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:10:31.359354 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:10:31.359333 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:14:00.670871 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:14:00.670798 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/1.log" Jul 15 14:14:00.676853 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:14:00.676832 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkf79_c92079f2-6ca8-4000-b0b8-128ba9dccd98/ovn-acl-logging/0.log" Jul 15 14:14:00.685982 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:14:00.685962 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/1.log" Jul 15 14:14:00.691820 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:14:00.691802 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkf79_c92079f2-6ca8-4000-b0b8-128ba9dccd98/ovn-acl-logging/0.log" Jul 15 14:16:55.141028 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:16:55.140943 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7853-139915260858544"] Jul 15 14:16:55.144387 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:16:55.144367 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7853-139915260858544" Jul 15 14:16:55.148222 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:16:55.148204 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wljdh\"" Jul 15 14:16:55.165622 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:16:55.165584 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7853-139915260858544"] Jul 15 14:16:55.240797 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:16:55.240768 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szjr4\" (UniqueName: \"kubernetes.io/projected/0b5e5f24-c248-4f73-89e6-224d7acb92fa-kube-api-access-szjr4\") pod \"test-curl-7853-139915260858544\" (UID: \"0b5e5f24-c248-4f73-89e6-224d7acb92fa\") " pod="opendatahub/test-curl-7853-139915260858544" Jul 15 14:16:55.341992 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:16:55.341964 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szjr4\" (UniqueName: \"kubernetes.io/projected/0b5e5f24-c248-4f73-89e6-224d7acb92fa-kube-api-access-szjr4\") pod \"test-curl-7853-139915260858544\" (UID: \"0b5e5f24-c248-4f73-89e6-224d7acb92fa\") " pod="opendatahub/test-curl-7853-139915260858544" Jul 15 14:16:55.352525 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:16:55.352496 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szjr4\" (UniqueName: \"kubernetes.io/projected/0b5e5f24-c248-4f73-89e6-224d7acb92fa-kube-api-access-szjr4\") pod \"test-curl-7853-139915260858544\" (UID: \"0b5e5f24-c248-4f73-89e6-224d7acb92fa\") " pod="opendatahub/test-curl-7853-139915260858544" Jul 15 14:16:55.454016 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:16:55.453991 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7853-139915260858544" Jul 15 14:16:55.589736 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:16:55.589712 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7853-139915260858544"] Jul 15 14:16:55.592334 ip-10-0-129-45 kubenswrapper[2558]: W0715 14:16:55.592296 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b5e5f24_c248_4f73_89e6_224d7acb92fa.slice/crio-b8b08b379d11ed5e28b9b98e78ac32f174a3ec3bf67d9dc2616285b8f4aa15c1 WatchSource:0}: Error finding container b8b08b379d11ed5e28b9b98e78ac32f174a3ec3bf67d9dc2616285b8f4aa15c1: Status 404 returned error can't find the container with id b8b08b379d11ed5e28b9b98e78ac32f174a3ec3bf67d9dc2616285b8f4aa15c1 Jul 15 14:16:55.593724 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:16:55.593696 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 14:16:56.310475 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:16:56.310435 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7853-139915260858544" event={"ID":"0b5e5f24-c248-4f73-89e6-224d7acb92fa","Type":"ContainerStarted","Data":"b8b08b379d11ed5e28b9b98e78ac32f174a3ec3bf67d9dc2616285b8f4aa15c1"} Jul 15 14:16:57.317235 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:16:57.317197 2558 generic.go:356] "Generic (PLEG): container finished" podID="0b5e5f24-c248-4f73-89e6-224d7acb92fa" containerID="c06145737e92142bffb444b619919da8292fd4d108088a4713860b9bb93459bb" exitCode=0 Jul 15 14:16:57.317664 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:16:57.317267 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7853-139915260858544" event={"ID":"0b5e5f24-c248-4f73-89e6-224d7acb92fa","Type":"ContainerDied","Data":"c06145737e92142bffb444b619919da8292fd4d108088a4713860b9bb93459bb"} Jul 15 14:16:58.456746 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:16:58.456717 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7853-139915260858544" Jul 15 14:16:58.500476 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:16:58.500448 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7853-139915260858544_0b5e5f24-c248-4f73-89e6-224d7acb92fa/test-curl-7853-139915260858544/0.log" Jul 15 14:16:58.538363 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:16:58.538329 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7853-139915260858544"] Jul 15 14:16:58.546803 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:16:58.546773 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7853-139915260858544"] Jul 15 14:16:58.574516 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:16:58.574457 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szjr4\" (UniqueName: \"kubernetes.io/projected/0b5e5f24-c248-4f73-89e6-224d7acb92fa-kube-api-access-szjr4\") pod \"0b5e5f24-c248-4f73-89e6-224d7acb92fa\" (UID: \"0b5e5f24-c248-4f73-89e6-224d7acb92fa\") " Jul 15 14:16:58.576767 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:16:58.576739 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b5e5f24-c248-4f73-89e6-224d7acb92fa-kube-api-access-szjr4" (OuterVolumeSpecName: "kube-api-access-szjr4") pod "0b5e5f24-c248-4f73-89e6-224d7acb92fa" (UID: "0b5e5f24-c248-4f73-89e6-224d7acb92fa"). InnerVolumeSpecName "kube-api-access-szjr4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 14:16:58.675559 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:16:58.675519 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szjr4\" (UniqueName: \"kubernetes.io/projected/0b5e5f24-c248-4f73-89e6-224d7acb92fa-kube-api-access-szjr4\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:16:59.329464 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:16:59.329432 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7853-139915260858544" Jul 15 14:16:59.329661 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:16:59.329472 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b8b08b379d11ed5e28b9b98e78ac32f174a3ec3bf67d9dc2616285b8f4aa15c1" Jul 15 14:16:59.339736 ip-10-0-129-45 kubenswrapper[2558]: E0715 14:16:59.339702 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7853-139915260858544\" is forbidden: User \"system:node:ip-10-0-129-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-45.ec2.internal' and this object" podUID="0b5e5f24-c248-4f73-89e6-224d7acb92fa" pod="opendatahub/test-curl-7853-139915260858544" Jul 15 14:17:00.478284 ip-10-0-129-45 kubenswrapper[2558]: E0715 14:17:00.478245 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7853-139915260858544\" is forbidden: User \"system:node:ip-10-0-129-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-45.ec2.internal' and this object" podUID="0b5e5f24-c248-4f73-89e6-224d7acb92fa" pod="opendatahub/test-curl-7853-139915260858544" Jul 15 14:17:00.479627 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:00.479585 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b5e5f24-c248-4f73-89e6-224d7acb92fa" path="/var/lib/kubelet/pods/0b5e5f24-c248-4f73-89e6-224d7acb92fa/volumes" Jul 15 14:17:04.169911 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:04.169879 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7853-139915262174528"] Jul 15 14:17:04.170273 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:04.170234 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b5e5f24-c248-4f73-89e6-224d7acb92fa" containerName="test-curl-7853-139915260858544" Jul 15 14:17:04.170273 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:04.170246 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b5e5f24-c248-4f73-89e6-224d7acb92fa" containerName="test-curl-7853-139915260858544" Jul 15 14:17:04.170351 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:04.170320 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b5e5f24-c248-4f73-89e6-224d7acb92fa" containerName="test-curl-7853-139915260858544" Jul 15 14:17:04.173684 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:04.173666 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7853-139915262174528" Jul 15 14:17:04.176338 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:04.176312 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wljdh\"" Jul 15 14:17:04.178862 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:04.178838 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7853-139915262174528"] Jul 15 14:17:04.322862 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:04.322830 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zffs6\" (UniqueName: \"kubernetes.io/projected/7687f363-07e8-4343-a5a0-327e64e3a3bf-kube-api-access-zffs6\") pod \"test-curl-7853-139915262174528\" (UID: \"7687f363-07e8-4343-a5a0-327e64e3a3bf\") " pod="opendatahub/test-curl-7853-139915262174528" Jul 15 14:17:04.423905 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:04.423833 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zffs6\" (UniqueName: \"kubernetes.io/projected/7687f363-07e8-4343-a5a0-327e64e3a3bf-kube-api-access-zffs6\") pod \"test-curl-7853-139915262174528\" (UID: \"7687f363-07e8-4343-a5a0-327e64e3a3bf\") " pod="opendatahub/test-curl-7853-139915262174528" Jul 15 14:17:04.433450 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:04.433425 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zffs6\" (UniqueName: \"kubernetes.io/projected/7687f363-07e8-4343-a5a0-327e64e3a3bf-kube-api-access-zffs6\") pod \"test-curl-7853-139915262174528\" (UID: \"7687f363-07e8-4343-a5a0-327e64e3a3bf\") " pod="opendatahub/test-curl-7853-139915262174528" Jul 15 14:17:04.484861 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:04.484840 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7853-139915262174528" Jul 15 14:17:04.623090 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:04.623054 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7853-139915262174528"] Jul 15 14:17:04.625043 ip-10-0-129-45 kubenswrapper[2558]: W0715 14:17:04.625013 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7687f363_07e8_4343_a5a0_327e64e3a3bf.slice/crio-cc7b6c2e839730bed6ad710d439c7643a5d44c770e51e9ec722ef695786b6b89 WatchSource:0}: Error finding container cc7b6c2e839730bed6ad710d439c7643a5d44c770e51e9ec722ef695786b6b89: Status 404 returned error can't find the container with id cc7b6c2e839730bed6ad710d439c7643a5d44c770e51e9ec722ef695786b6b89 Jul 15 14:17:05.365667 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:05.365628 2558 generic.go:356] "Generic (PLEG): container finished" podID="7687f363-07e8-4343-a5a0-327e64e3a3bf" containerID="07706b2a046a203fbb917630f97b9e69f273361421fe8b569405ac596be98707" exitCode=0 Jul 15 14:17:05.366043 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:05.365752 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7853-139915262174528" event={"ID":"7687f363-07e8-4343-a5a0-327e64e3a3bf","Type":"ContainerDied","Data":"07706b2a046a203fbb917630f97b9e69f273361421fe8b569405ac596be98707"} Jul 15 14:17:05.366043 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:05.365780 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7853-139915262174528" event={"ID":"7687f363-07e8-4343-a5a0-327e64e3a3bf","Type":"ContainerStarted","Data":"cc7b6c2e839730bed6ad710d439c7643a5d44c770e51e9ec722ef695786b6b89"} Jul 15 14:17:06.508206 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:06.508183 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7853-139915262174528" Jul 15 14:17:06.531293 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:06.531255 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7853-139915262174528_7687f363-07e8-4343-a5a0-327e64e3a3bf/test-curl-7853-139915262174528/0.log" Jul 15 14:17:06.559820 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:06.559787 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7853-139915262174528"] Jul 15 14:17:06.564174 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:06.564140 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7853-139915262174528"] Jul 15 14:17:06.644936 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:06.644875 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zffs6\" (UniqueName: \"kubernetes.io/projected/7687f363-07e8-4343-a5a0-327e64e3a3bf-kube-api-access-zffs6\") pod \"7687f363-07e8-4343-a5a0-327e64e3a3bf\" (UID: \"7687f363-07e8-4343-a5a0-327e64e3a3bf\") " Jul 15 14:17:06.646973 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:06.646941 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7687f363-07e8-4343-a5a0-327e64e3a3bf-kube-api-access-zffs6" (OuterVolumeSpecName: "kube-api-access-zffs6") pod "7687f363-07e8-4343-a5a0-327e64e3a3bf" (UID: "7687f363-07e8-4343-a5a0-327e64e3a3bf"). InnerVolumeSpecName "kube-api-access-zffs6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 14:17:06.745788 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:06.745760 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zffs6\" (UniqueName: \"kubernetes.io/projected/7687f363-07e8-4343-a5a0-327e64e3a3bf-kube-api-access-zffs6\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:17:07.378324 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:07.378295 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc7b6c2e839730bed6ad710d439c7643a5d44c770e51e9ec722ef695786b6b89" Jul 15 14:17:07.378324 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:07.378296 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7853-139915262174528" Jul 15 14:17:07.388968 ip-10-0-129-45 kubenswrapper[2558]: E0715 14:17:07.388941 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7853-139915262174528\" is forbidden: User \"system:node:ip-10-0-129-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-45.ec2.internal' and this object" podUID="7687f363-07e8-4343-a5a0-327e64e3a3bf" pod="opendatahub/test-curl-7853-139915262174528" Jul 15 14:17:08.478593 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:17:08.478557 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7687f363-07e8-4343-a5a0-327e64e3a3bf" path="/var/lib/kubelet/pods/7687f363-07e8-4343-a5a0-327e64e3a3bf/volumes" Jul 15 14:18:01.343142 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:01.343113 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25"] Jul 15 14:18:01.343679 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:01.343309 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" podUID="6a013330-8dc1-4210-b98f-1155c2e43b37" containerName="istio-proxy" containerID="cri-o://bc71ff0f5b1ee337d8e3566810cbb836777974312c726ee38a4963475121bf29" gracePeriod=30 Jul 15 14:18:01.361036 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:01.361010 2558 patch_prober.go:28] interesting pod/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 14:18:01.361156 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:01.361059 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" podUID="6a013330-8dc1-4210-b98f-1155c2e43b37" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 14:18:02.059864 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:02.059833 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f5cc6f784-g7xsb_dd2e9142-f8ff-4635-bb0a-59f9e58400cb/authorino/0.log" Jul 15 14:18:06.601770 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.601714 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:18:06.699667 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.699634 2558 generic.go:356] "Generic (PLEG): container finished" podID="6a013330-8dc1-4210-b98f-1155c2e43b37" containerID="bc71ff0f5b1ee337d8e3566810cbb836777974312c726ee38a4963475121bf29" exitCode=0 Jul 15 14:18:06.699831 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.699755 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" Jul 15 14:18:06.699831 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.699765 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" event={"ID":"6a013330-8dc1-4210-b98f-1155c2e43b37","Type":"ContainerDied","Data":"bc71ff0f5b1ee337d8e3566810cbb836777974312c726ee38a4963475121bf29"} Jul 15 14:18:06.699831 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.699821 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25" event={"ID":"6a013330-8dc1-4210-b98f-1155c2e43b37","Type":"ContainerDied","Data":"71a639cb7fe53ce4f754ebb12a10e929397b6f2d0c88f790a8907064425f803f"} Jul 15 14:18:06.699941 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.699853 2558 scope.go:117] "RemoveContainer" containerID="bc71ff0f5b1ee337d8e3566810cbb836777974312c726ee38a4963475121bf29" Jul 15 14:18:06.709037 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.709002 2558 scope.go:117] "RemoveContainer" containerID="cf713d3bfa2e70d7dd7f472b0f946c1631d9d85af1c08965e859926c79243828" Jul 15 14:18:06.717286 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.717271 2558 scope.go:117] "RemoveContainer" containerID="bc71ff0f5b1ee337d8e3566810cbb836777974312c726ee38a4963475121bf29" Jul 15 14:18:06.717545 ip-10-0-129-45 kubenswrapper[2558]: E0715 14:18:06.717525 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc71ff0f5b1ee337d8e3566810cbb836777974312c726ee38a4963475121bf29\": container with ID starting with bc71ff0f5b1ee337d8e3566810cbb836777974312c726ee38a4963475121bf29 not found: ID does not exist" containerID="bc71ff0f5b1ee337d8e3566810cbb836777974312c726ee38a4963475121bf29" Jul 15 14:18:06.717587 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.717555 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc71ff0f5b1ee337d8e3566810cbb836777974312c726ee38a4963475121bf29"} err="failed to get container status \"bc71ff0f5b1ee337d8e3566810cbb836777974312c726ee38a4963475121bf29\": rpc error: code = NotFound desc = could not find container \"bc71ff0f5b1ee337d8e3566810cbb836777974312c726ee38a4963475121bf29\": container with ID starting with bc71ff0f5b1ee337d8e3566810cbb836777974312c726ee38a4963475121bf29 not found: ID does not exist" Jul 15 14:18:06.717587 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.717572 2558 scope.go:117] "RemoveContainer" containerID="cf713d3bfa2e70d7dd7f472b0f946c1631d9d85af1c08965e859926c79243828" Jul 15 14:18:06.717826 ip-10-0-129-45 kubenswrapper[2558]: E0715 14:18:06.717806 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf713d3bfa2e70d7dd7f472b0f946c1631d9d85af1c08965e859926c79243828\": container with ID starting with cf713d3bfa2e70d7dd7f472b0f946c1631d9d85af1c08965e859926c79243828 not found: ID does not exist" containerID="cf713d3bfa2e70d7dd7f472b0f946c1631d9d85af1c08965e859926c79243828" Jul 15 14:18:06.717867 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.717836 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf713d3bfa2e70d7dd7f472b0f946c1631d9d85af1c08965e859926c79243828"} err="failed to get container status \"cf713d3bfa2e70d7dd7f472b0f946c1631d9d85af1c08965e859926c79243828\": rpc error: code = NotFound desc = could not find container \"cf713d3bfa2e70d7dd7f472b0f946c1631d9d85af1c08965e859926c79243828\": container with ID starting with cf713d3bfa2e70d7dd7f472b0f946c1631d9d85af1c08965e859926c79243828 not found: ID does not exist" Jul 15 14:18:06.766279 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.766257 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-istio-envoy\") pod \"6a013330-8dc1-4210-b98f-1155c2e43b37\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " Jul 15 14:18:06.766371 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.766296 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a013330-8dc1-4210-b98f-1155c2e43b37-istiod-ca-cert\") pod \"6a013330-8dc1-4210-b98f-1155c2e43b37\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " Jul 15 14:18:06.766371 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.766346 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-istio-data\") pod \"6a013330-8dc1-4210-b98f-1155c2e43b37\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " Jul 15 14:18:06.766371 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.766368 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-credential-socket\") pod \"6a013330-8dc1-4210-b98f-1155c2e43b37\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " Jul 15 14:18:06.766529 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.766385 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a013330-8dc1-4210-b98f-1155c2e43b37-istio-token\") pod \"6a013330-8dc1-4210-b98f-1155c2e43b37\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " Jul 15 14:18:06.766529 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.766413 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-workload-certs\") pod \"6a013330-8dc1-4210-b98f-1155c2e43b37\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " Jul 15 14:18:06.766529 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.766451 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-workload-socket\") pod \"6a013330-8dc1-4210-b98f-1155c2e43b37\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " Jul 15 14:18:06.766529 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.766486 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzljj\" (UniqueName: \"kubernetes.io/projected/6a013330-8dc1-4210-b98f-1155c2e43b37-kube-api-access-vzljj\") pod \"6a013330-8dc1-4210-b98f-1155c2e43b37\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " Jul 15 14:18:06.766764 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.766534 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a013330-8dc1-4210-b98f-1155c2e43b37-istio-podinfo\") pod \"6a013330-8dc1-4210-b98f-1155c2e43b37\" (UID: \"6a013330-8dc1-4210-b98f-1155c2e43b37\") " Jul 15 14:18:06.766818 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.766747 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6a013330-8dc1-4210-b98f-1155c2e43b37" (UID: "6a013330-8dc1-4210-b98f-1155c2e43b37"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:18:06.766818 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.766790 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6a013330-8dc1-4210-b98f-1155c2e43b37" (UID: "6a013330-8dc1-4210-b98f-1155c2e43b37"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:18:06.766928 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.766909 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-credential-socket\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:18:06.766981 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.766932 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-workload-certs\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:18:06.767100 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.767060 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6a013330-8dc1-4210-b98f-1155c2e43b37" (UID: "6a013330-8dc1-4210-b98f-1155c2e43b37"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:18:06.767377 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.767255 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a013330-8dc1-4210-b98f-1155c2e43b37-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6a013330-8dc1-4210-b98f-1155c2e43b37" (UID: "6a013330-8dc1-4210-b98f-1155c2e43b37"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:18:06.767377 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.767316 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-istio-data" (OuterVolumeSpecName: "istio-data") pod "6a013330-8dc1-4210-b98f-1155c2e43b37" (UID: "6a013330-8dc1-4210-b98f-1155c2e43b37"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:18:06.768707 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.768683 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a013330-8dc1-4210-b98f-1155c2e43b37-istio-token" (OuterVolumeSpecName: "istio-token") pod "6a013330-8dc1-4210-b98f-1155c2e43b37" (UID: "6a013330-8dc1-4210-b98f-1155c2e43b37"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 14:18:06.768794 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.768730 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a013330-8dc1-4210-b98f-1155c2e43b37-kube-api-access-vzljj" (OuterVolumeSpecName: "kube-api-access-vzljj") pod "6a013330-8dc1-4210-b98f-1155c2e43b37" (UID: "6a013330-8dc1-4210-b98f-1155c2e43b37"). InnerVolumeSpecName "kube-api-access-vzljj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 14:18:06.768852 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.768835 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6a013330-8dc1-4210-b98f-1155c2e43b37" (UID: "6a013330-8dc1-4210-b98f-1155c2e43b37"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:18:06.769017 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.769000 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6a013330-8dc1-4210-b98f-1155c2e43b37-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6a013330-8dc1-4210-b98f-1155c2e43b37" (UID: "6a013330-8dc1-4210-b98f-1155c2e43b37"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 14:18:06.867651 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.867583 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-workload-socket\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:18:06.867651 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.867626 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzljj\" (UniqueName: \"kubernetes.io/projected/6a013330-8dc1-4210-b98f-1155c2e43b37-kube-api-access-vzljj\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:18:06.867651 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.867637 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a013330-8dc1-4210-b98f-1155c2e43b37-istio-podinfo\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:18:06.867651 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.867645 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-istio-envoy\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:18:06.867651 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.867653 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a013330-8dc1-4210-b98f-1155c2e43b37-istiod-ca-cert\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:18:06.867909 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.867660 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a013330-8dc1-4210-b98f-1155c2e43b37-istio-data\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:18:06.867909 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:06.867669 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a013330-8dc1-4210-b98f-1155c2e43b37-istio-token\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jul 15 14:18:07.025383 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:07.025354 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25"] Jul 15 14:18:07.030127 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:07.030106 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-bfdd40-openshift-default-59c6766bf5-sgh25"] Jul 15 14:18:08.344055 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:08.344029 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-97nx8_a31756f1-d65a-4227-845b-c8c71d27fcc3/manager/0.log" Jul 15 14:18:08.480246 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:08.480205 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a013330-8dc1-4210-b98f-1155c2e43b37" path="/var/lib/kubelet/pods/6a013330-8dc1-4210-b98f-1155c2e43b37/volumes" Jul 15 14:18:09.003201 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:09.003168 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84978f4d9d-92pvw_d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3/copy-manifests/0.log" Jul 15 14:18:09.016616 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:09.016553 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84978f4d9d-92pvw_d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3/manager/0.log" Jul 15 14:18:12.489161 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:12.489136 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm_5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e/util/0.log" Jul 15 14:18:12.498884 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:12.498861 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm_5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e/pull/0.log" Jul 15 14:18:12.505986 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:12.505963 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm_5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e/extract/0.log" Jul 15 14:18:12.629011 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:12.628987 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz_2e5d7159-0c90-477b-b211-096de53b6f3a/util/0.log" Jul 15 14:18:12.635955 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:12.635933 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz_2e5d7159-0c90-477b-b211-096de53b6f3a/pull/0.log" Jul 15 14:18:12.644568 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:12.644528 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz_2e5d7159-0c90-477b-b211-096de53b6f3a/extract/0.log" Jul 15 14:18:12.767026 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:12.766951 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d_db1aed43-29cc-4167-a979-5d8644e689b3/util/0.log" Jul 15 14:18:12.774594 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:12.774570 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d_db1aed43-29cc-4167-a979-5d8644e689b3/pull/0.log" Jul 15 14:18:12.781874 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:12.781858 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d_db1aed43-29cc-4167-a979-5d8644e689b3/extract/0.log" Jul 15 14:18:12.911554 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:12.911529 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j_f569c5f0-be5d-4479-88d5-f5f2e2645e20/pull/0.log" Jul 15 14:18:12.919967 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:12.919942 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j_f569c5f0-be5d-4479-88d5-f5f2e2645e20/extract/0.log" Jul 15 14:18:12.926290 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:12.926275 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j_f569c5f0-be5d-4479-88d5-f5f2e2645e20/util/0.log" Jul 15 14:18:13.056080 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:13.056012 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f5cc6f784-g7xsb_dd2e9142-f8ff-4635-bb0a-59f9e58400cb/authorino/0.log" Jul 15 14:18:13.208279 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:13.208258 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-dsqzv_80190304-1c1d-4dc0-9d08-9874d040a9a1/manager/0.log" Jul 15 14:18:13.450867 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:13.450841 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9j9cm_c650036b-d74e-4e7b-874b-4bf4d63f92a8/kuadrant-console-plugin/0.log" Jul 15 14:18:13.577677 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:13.577653 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-p9k8q_b6ef1293-4c65-40b4-b677-8b1afe31db33/registry-server/0.log" Jul 15 14:18:13.714887 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:13.714814 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-zswkz_f5587ffe-83ba-47c4-b8d9-5f87b66623b0/manager/0.log" Jul 15 14:18:14.368034 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:14.368006 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf495zfx_c3895ff6-6580-4cdc-b6d8-4de2fae59247/istio-proxy/0.log" Jul 15 14:18:15.324968 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:15.324933 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-746cbcdcd6-c9gwl_bc8b8f82-5a61-4607-b901-9bb811dfe8bd/router/0.log" Jul 15 14:18:15.734736 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:15.734710 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-pdf4l_5c1db85e-267a-47b0-9fb3-1e62781954e1/main/0.log" Jul 15 14:18:16.017435 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:16.017340 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-twq6p_4d66c46b-0d6e-4788-8ac8-23aff85f2122/main/0.log" Jul 15 14:18:25.709024 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:25.708950 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-d7hsr_d024b3a4-a62c-4c57-adee-38378835c1c8/global-pull-secret-syncer/0.log" Jul 15 14:18:25.882876 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:25.882845 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hg6dx_1da889f2-18e0-4f9d-b932-38d83ef3bd43/konnectivity-agent/0.log" Jul 15 14:18:25.940676 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:25.940653 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-45.ec2.internal_7f7ac29e3ebd41aa7e117b631fbe0b37/haproxy/0.log" Jul 15 14:18:30.940911 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:30.940882 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm_5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e/extract/0.log" Jul 15 14:18:30.966763 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:30.966735 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm_5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e/util/0.log" Jul 15 14:18:30.995893 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:30.995871 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597nrdm_5cbbf99b-7f66-49cf-a9e1-ed9091f30b7e/pull/0.log" Jul 15 14:18:31.038391 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:31.038365 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz_2e5d7159-0c90-477b-b211-096de53b6f3a/extract/0.log" Jul 15 14:18:31.071060 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:31.071038 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz_2e5d7159-0c90-477b-b211-096de53b6f3a/util/0.log" Jul 15 14:18:31.107149 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:31.107122 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cgghz_2e5d7159-0c90-477b-b211-096de53b6f3a/pull/0.log" Jul 15 14:18:31.152568 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:31.152538 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d_db1aed43-29cc-4167-a979-5d8644e689b3/extract/0.log" Jul 15 14:18:31.181784 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:31.181764 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d_db1aed43-29cc-4167-a979-5d8644e689b3/util/0.log" Jul 15 14:18:31.219482 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:31.219393 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pz92d_db1aed43-29cc-4167-a979-5d8644e689b3/pull/0.log" Jul 15 14:18:31.284442 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:31.284419 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j_f569c5f0-be5d-4479-88d5-f5f2e2645e20/extract/0.log" Jul 15 14:18:31.338664 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:31.338639 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j_f569c5f0-be5d-4479-88d5-f5f2e2645e20/util/0.log" Jul 15 14:18:31.380915 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:31.380892 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1srq2j_f569c5f0-be5d-4479-88d5-f5f2e2645e20/pull/0.log" Jul 15 14:18:31.715337 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:31.715303 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f5cc6f784-g7xsb_dd2e9142-f8ff-4635-bb0a-59f9e58400cb/authorino/0.log" Jul 15 14:18:31.760082 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:31.760053 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-dsqzv_80190304-1c1d-4dc0-9d08-9874d040a9a1/manager/0.log" Jul 15 14:18:31.833496 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:31.833465 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9j9cm_c650036b-d74e-4e7b-874b-4bf4d63f92a8/kuadrant-console-plugin/0.log" Jul 15 14:18:31.909672 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:31.909644 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-p9k8q_b6ef1293-4c65-40b4-b677-8b1afe31db33/registry-server/0.log" Jul 15 14:18:32.085111 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:32.085001 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-zswkz_f5587ffe-83ba-47c4-b8d9-5f87b66623b0/manager/0.log" Jul 15 14:18:34.174130 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:34.174102 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-ztgmx_255bd244-111e-4dd9-9074-ca2adf2b6a3d/cluster-monitoring-operator/0.log" Jul 15 14:18:34.618687 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:34.618592 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sgdq2_3c3e00f3-94c5-40d4-a621-bd3f1463e5f7/node-exporter/0.log" Jul 15 14:18:34.648431 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:34.648396 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sgdq2_3c3e00f3-94c5-40d4-a621-bd3f1463e5f7/kube-rbac-proxy/0.log" Jul 15 14:18:34.670778 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:34.670752 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sgdq2_3c3e00f3-94c5-40d4-a621-bd3f1463e5f7/init-textfile/0.log" Jul 15 14:18:35.775871 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:35.775835 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb"] Jul 15 14:18:35.776268 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:35.776253 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7687f363-07e8-4343-a5a0-327e64e3a3bf" containerName="test-curl-7853-139915262174528" Jul 15 14:18:35.776315 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:35.776269 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7687f363-07e8-4343-a5a0-327e64e3a3bf" containerName="test-curl-7853-139915262174528" Jul 15 14:18:35.776315 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:35.776280 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a013330-8dc1-4210-b98f-1155c2e43b37" containerName="istio-proxy" Jul 15 14:18:35.776315 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:35.776286 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a013330-8dc1-4210-b98f-1155c2e43b37" containerName="istio-proxy" Jul 15 14:18:35.776431 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:35.776378 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a013330-8dc1-4210-b98f-1155c2e43b37" containerName="istio-proxy" Jul 15 14:18:35.776431 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:35.776392 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7687f363-07e8-4343-a5a0-327e64e3a3bf" containerName="test-curl-7853-139915262174528" Jul 15 14:18:35.779993 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:35.779972 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb" Jul 15 14:18:35.783053 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:35.783032 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-858vm\"/\"openshift-service-ca.crt\"" Jul 15 14:18:35.783187 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:35.783058 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-858vm\"/\"kube-root-ca.crt\"" Jul 15 14:18:35.784260 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:35.784244 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-858vm\"/\"default-dockercfg-cx228\"" Jul 15 14:18:35.791068 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:35.791047 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb"] Jul 15 14:18:35.912213 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:35.912181 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e30555d2-4746-4e81-90a9-0fbddff53aca-sys\") pod \"perf-node-gather-daemonset-zdcxb\" (UID: \"e30555d2-4746-4e81-90a9-0fbddff53aca\") " pod="openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb" Jul 15 14:18:35.912408 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:35.912218 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9k8f\" (UniqueName: \"kubernetes.io/projected/e30555d2-4746-4e81-90a9-0fbddff53aca-kube-api-access-t9k8f\") pod \"perf-node-gather-daemonset-zdcxb\" (UID: \"e30555d2-4746-4e81-90a9-0fbddff53aca\") " pod="openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb" Jul 15 14:18:35.912408 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:35.912240 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e30555d2-4746-4e81-90a9-0fbddff53aca-lib-modules\") pod \"perf-node-gather-daemonset-zdcxb\" (UID: \"e30555d2-4746-4e81-90a9-0fbddff53aca\") " pod="openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb" Jul 15 14:18:35.912408 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:35.912368 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e30555d2-4746-4e81-90a9-0fbddff53aca-proc\") pod \"perf-node-gather-daemonset-zdcxb\" (UID: \"e30555d2-4746-4e81-90a9-0fbddff53aca\") " pod="openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb" Jul 15 14:18:35.912540 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:35.912414 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e30555d2-4746-4e81-90a9-0fbddff53aca-podres\") pod \"perf-node-gather-daemonset-zdcxb\" (UID: \"e30555d2-4746-4e81-90a9-0fbddff53aca\") " pod="openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb" Jul 15 14:18:36.013400 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:36.013366 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e30555d2-4746-4e81-90a9-0fbddff53aca-proc\") pod \"perf-node-gather-daemonset-zdcxb\" (UID: \"e30555d2-4746-4e81-90a9-0fbddff53aca\") " pod="openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb" Jul 15 14:18:36.013619 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:36.013412 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e30555d2-4746-4e81-90a9-0fbddff53aca-podres\") pod \"perf-node-gather-daemonset-zdcxb\" (UID: \"e30555d2-4746-4e81-90a9-0fbddff53aca\") " pod="openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb" Jul 15 14:18:36.013619 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:36.013490 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e30555d2-4746-4e81-90a9-0fbddff53aca-proc\") pod \"perf-node-gather-daemonset-zdcxb\" (UID: \"e30555d2-4746-4e81-90a9-0fbddff53aca\") " pod="openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb" Jul 15 14:18:36.013619 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:36.013530 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e30555d2-4746-4e81-90a9-0fbddff53aca-sys\") pod \"perf-node-gather-daemonset-zdcxb\" (UID: \"e30555d2-4746-4e81-90a9-0fbddff53aca\") " pod="openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb" Jul 15 14:18:36.013619 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:36.013568 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9k8f\" (UniqueName: \"kubernetes.io/projected/e30555d2-4746-4e81-90a9-0fbddff53aca-kube-api-access-t9k8f\") pod \"perf-node-gather-daemonset-zdcxb\" (UID: \"e30555d2-4746-4e81-90a9-0fbddff53aca\") " pod="openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb" Jul 15 14:18:36.013619 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:36.013614 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e30555d2-4746-4e81-90a9-0fbddff53aca-lib-modules\") pod \"perf-node-gather-daemonset-zdcxb\" (UID: \"e30555d2-4746-4e81-90a9-0fbddff53aca\") " pod="openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb" Jul 15 14:18:36.013886 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:36.013627 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e30555d2-4746-4e81-90a9-0fbddff53aca-sys\") pod \"perf-node-gather-daemonset-zdcxb\" (UID: \"e30555d2-4746-4e81-90a9-0fbddff53aca\") " pod="openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb" Jul 15 14:18:36.013886 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:36.013678 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e30555d2-4746-4e81-90a9-0fbddff53aca-podres\") pod \"perf-node-gather-daemonset-zdcxb\" (UID: \"e30555d2-4746-4e81-90a9-0fbddff53aca\") " pod="openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb" Jul 15 14:18:36.013886 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:36.013719 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e30555d2-4746-4e81-90a9-0fbddff53aca-lib-modules\") pod \"perf-node-gather-daemonset-zdcxb\" (UID: \"e30555d2-4746-4e81-90a9-0fbddff53aca\") " pod="openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb" Jul 15 14:18:36.023704 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:36.023669 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9k8f\" (UniqueName: \"kubernetes.io/projected/e30555d2-4746-4e81-90a9-0fbddff53aca-kube-api-access-t9k8f\") pod \"perf-node-gather-daemonset-zdcxb\" (UID: \"e30555d2-4746-4e81-90a9-0fbddff53aca\") " pod="openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb" Jul 15 14:18:36.091477 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:36.091391 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb" Jul 15 14:18:36.233230 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:36.233203 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb"] Jul 15 14:18:36.235347 ip-10-0-129-45 kubenswrapper[2558]: W0715 14:18:36.235307 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode30555d2_4746_4e81_90a9_0fbddff53aca.slice/crio-e8bb5d5084b8353c6d56e34486e47e8e7a9c8d5e5ee2744b73b15a93e116e1fb WatchSource:0}: Error finding container e8bb5d5084b8353c6d56e34486e47e8e7a9c8d5e5ee2744b73b15a93e116e1fb: Status 404 returned error can't find the container with id e8bb5d5084b8353c6d56e34486e47e8e7a9c8d5e5ee2744b73b15a93e116e1fb Jul 15 14:18:36.477643 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:36.477591 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-ctds2_126f7ccc-57f1-4742-85d8-bb39f2d19c51/networking-console-plugin/0.log" Jul 15 14:18:36.871260 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:36.871164 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb" event={"ID":"e30555d2-4746-4e81-90a9-0fbddff53aca","Type":"ContainerStarted","Data":"698ca750188b7a15a4d155fa114d83391fc377d6b28b18d9f227c1de66d3a79a"} Jul 15 14:18:36.871260 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:36.871230 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb" event={"ID":"e30555d2-4746-4e81-90a9-0fbddff53aca","Type":"ContainerStarted","Data":"e8bb5d5084b8353c6d56e34486e47e8e7a9c8d5e5ee2744b73b15a93e116e1fb"} Jul 15 14:18:36.871705 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:36.871391 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb" Jul 15 14:18:36.892979 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:36.892935 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb" podStartSLOduration=1.892920538 podStartE2EDuration="1.892920538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:18:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:18:36.890723772 +0000 UTC m=+2977.010285793" watchObservedRunningTime="2026-07-15 14:18:36.892920538 +0000 UTC m=+2977.012482557" Jul 15 14:18:37.012757 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:37.012731 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/1.log" Jul 15 14:18:37.018312 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:37.018294 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tm2dn_a8a4c1b5-3f78-42c3-bcf4-0add73923644/console-operator/2.log" Jul 15 14:18:37.586355 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:37.586326 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-98b95d89b-zkbxt_61764a61-b244-4d87-b8f7-60e3475d704f/console/0.log" Jul 15 14:18:38.356975 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:38.356948 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-zz2vs_2272f6cf-e762-45d7-8a03-4b3445b51139/volume-data-source-validator/0.log" Jul 15 14:18:39.599252 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:39.599222 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z74z6_801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e/dns/0.log" Jul 15 14:18:39.626404 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:39.626381 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z74z6_801ef2bc-1ced-4b4f-81b2-9f06c4a9ce4e/kube-rbac-proxy/0.log" Jul 15 14:18:39.653068 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:39.653045 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8nchk_96eceb11-871f-4522-a3c1-c2795c533360/dns-node-resolver/0.log" Jul 15 14:18:40.312062 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:40.312021 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6zd8z_42a1082a-1cc4-4ca5-9291-9b5c86fcebfa/node-ca/0.log" Jul 15 14:18:41.477340 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:41.477309 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf495zfx_c3895ff6-6580-4cdc-b6d8-4de2fae59247/istio-proxy/0.log" Jul 15 14:18:41.898108 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:41.898019 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-746cbcdcd6-c9gwl_bc8b8f82-5a61-4607-b901-9bb811dfe8bd/router/0.log" Jul 15 14:18:42.736855 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:42.736826 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r8c7f_7ced5bb3-bad2-4fe7-8760-c870eb3c5295/serve-healthcheck-canary/0.log" Jul 15 14:18:42.887001 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:42.886977 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-858vm/perf-node-gather-daemonset-zdcxb" Jul 15 14:18:43.262243 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:43.262214 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-8ngk4_7f487faf-49a3-4d67-b8a8-faa39c44c625/insights-operator/0.log" Jul 15 14:18:43.263169 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:43.263152 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-8ngk4_7f487faf-49a3-4d67-b8a8-faa39c44c625/insights-operator/1.log" Jul 15 14:18:43.375080 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:43.375049 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tvbmk_d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0/kube-rbac-proxy/0.log" Jul 15 14:18:43.397976 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:43.397945 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tvbmk_d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0/exporter/0.log" Jul 15 14:18:43.422771 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:43.422745 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tvbmk_d6daff2b-298b-4d7a-ba2d-a1a2ffb22ce0/extractor/0.log" Jul 15 14:18:46.233054 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:46.233015 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-97nx8_a31756f1-d65a-4227-845b-c8c71d27fcc3/manager/0.log" Jul 15 14:18:46.459866 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:46.459840 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf495zfx_c3895ff6-6580-4cdc-b6d8-4de2fae59247/istio-proxy/0.log" Jul 15 14:18:46.585473 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:46.585450 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84978f4d9d-92pvw_d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3/manager/0.log" Jul 15 14:18:46.606798 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:46.606769 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84978f4d9d-92pvw_d9f8b1b6-1a6b-45d1-8e4f-dca805d134b3/copy-manifests/0.log" Jul 15 14:18:46.729467 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:46.729390 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-746cbcdcd6-c9gwl_bc8b8f82-5a61-4607-b901-9bb811dfe8bd/router/0.log" Jul 15 14:18:48.031821 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:48.031789 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-74d75685f8-jv6pl_b6815a6f-6782-4b35-8c18-f9f2fb019fa0/manager/0.log" Jul 15 14:18:48.114907 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:48.114877 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-5pmdp_6de5ed7c-2327-4120-ae44-dc1d8a46ff5d/openshift-lws-operator/0.log" Jul 15 14:18:48.173894 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:48.173872 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf495zfx_c3895ff6-6580-4cdc-b6d8-4de2fae59247/istio-proxy/0.log" Jul 15 14:18:48.475814 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:48.475773 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-746cbcdcd6-c9gwl_bc8b8f82-5a61-4607-b901-9bb811dfe8bd/router/0.log" Jul 15 14:18:53.297899 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:53.297867 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-rgn8x_0ac1bef6-2398-4d82-879b-c438e5b04c3a/migrator/0.log" Jul 15 14:18:53.323477 ip-10-0-129-45 kubenswrapper[2558]: I0715 14:18:53.323451 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-rgn8x_0ac1bef6-2398-4d82-879b-c438e5b04c3a/graceful-termination/0.log"