Jul 12 16:22:14.573637 ip-10-0-130-204 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 12 16:22:14.573654 ip-10-0-130-204 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 12 16:22:14.573664 ip-10-0-130-204 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 12 16:22:14.573990 ip-10-0-130-204 systemd[1]: Failed to start Kubernetes Kubelet. Jul 12 16:22:23.910869 ip-10-0-130-204 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 12 16:22:23.910883 ip-10-0-130-204 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 5e9a3b68bc424369a1866e6db7f8bd1a -- Jul 12 16:23:53.418370 ip-10-0-130-204 systemd[1]: Starting Kubernetes Kubelet... Jul 12 16:23:53.877999 ip-10-0-130-204 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 12 16:23:53.877999 ip-10-0-130-204 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 12 16:23:53.877999 ip-10-0-130-204 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 12 16:23:53.877999 ip-10-0-130-204 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 12 16:23:53.877999 ip-10-0-130-204 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 12 16:23:53.879121 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.878969 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 12 16:23:53.886555 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886534 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 16:23:53.886555 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886553 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 16:23:53.886555 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886557 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 12 16:23:53.886555 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886560 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 16:23:53.886555 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886563 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 16:23:53.886758 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886566 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 16:23:53.886758 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886569 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 16:23:53.886758 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886572 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 16:23:53.886758 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886575 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 16:23:53.886758 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886577 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 16:23:53.886758 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886580 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 16:23:53.886758 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886582 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 16:23:53.886758 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886585 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 16:23:53.886758 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886589 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 16:23:53.886758 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886593 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 16:23:53.886758 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886597 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 16:23:53.886758 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886600 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 16:23:53.886758 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886603 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 16:23:53.886758 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886605 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 16:23:53.886758 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886608 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 16:23:53.886758 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886610 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 16:23:53.886758 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886613 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 16:23:53.886758 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886615 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 16:23:53.886758 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886618 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 16:23:53.886758 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886622 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 16:23:53.887318 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886625 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 16:23:53.887318 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886628 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 16:23:53.887318 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886631 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 16:23:53.887318 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886634 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 16:23:53.887318 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886636 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 16:23:53.887318 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886640 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 16:23:53.887318 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886643 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 16:23:53.887318 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886645 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 16:23:53.887318 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886648 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 16:23:53.887318 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886650 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 16:23:53.887318 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886652 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 16:23:53.887318 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886655 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 16:23:53.887318 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886658 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 16:23:53.887318 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886662 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 16:23:53.887318 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886665 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 16:23:53.887318 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886669 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 16:23:53.887318 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886673 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 16:23:53.887318 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886676 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 16:23:53.887318 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886678 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 16:23:53.887318 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886681 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 16:23:53.887912 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886683 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 16:23:53.887912 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886686 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 16:23:53.887912 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886689 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 16:23:53.887912 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886693 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 16:23:53.887912 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886696 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 16:23:53.887912 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886700 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 16:23:53.887912 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886703 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 16:23:53.887912 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886707 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 16:23:53.887912 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886710 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 16:23:53.887912 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886713 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 16:23:53.887912 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886715 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 16:23:53.887912 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886718 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 16:23:53.887912 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886721 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 16:23:53.887912 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886724 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 16:23:53.887912 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886727 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 16:23:53.887912 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886729 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 16:23:53.887912 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886732 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 16:23:53.887912 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886734 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 16:23:53.887912 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886737 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 16:23:53.888406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886739 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 16:23:53.888406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886742 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 16:23:53.888406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886744 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 16:23:53.888406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886746 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 16:23:53.888406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886750 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 16:23:53.888406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886755 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 16:23:53.888406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886758 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 16:23:53.888406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886760 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 16:23:53.888406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886763 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 16:23:53.888406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886766 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 16:23:53.888406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886769 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 16:23:53.888406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886772 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 16:23:53.888406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886774 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 16:23:53.888406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886777 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 16:23:53.888406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886779 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 16:23:53.888406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886781 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 16:23:53.888406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886784 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 16:23:53.888406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886787 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 16:23:53.888406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886789 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 16:23:53.888406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886792 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 16:23:53.888896 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886795 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 16:23:53.888896 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886797 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 16:23:53.888896 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886800 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 16:23:53.888896 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886802 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 16:23:53.888896 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886805 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 16:23:53.888896 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886808 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 16:23:53.888896 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886810 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 16:23:53.888896 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886813 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 16:23:53.888896 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886816 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 16:23:53.888896 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886818 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 16:23:53.888896 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886821 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 16:23:53.888896 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886824 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 16:23:53.888896 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886826 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 16:23:53.888896 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886829 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 16:23:53.888896 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.886832 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 16:23:53.888896 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887552 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 16:23:53.888896 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887558 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 16:23:53.888896 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887561 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 16:23:53.888896 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887564 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 16:23:53.888896 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887567 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 16:23:53.889402 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887570 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 16:23:53.889402 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887573 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 16:23:53.889402 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887577 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 16:23:53.889402 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887581 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 16:23:53.889402 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887584 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 16:23:53.889402 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887588 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 16:23:53.889402 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887590 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 16:23:53.889402 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887593 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 16:23:53.889402 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887596 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 16:23:53.889402 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887598 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 16:23:53.889402 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887600 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 16:23:53.889402 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887603 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 16:23:53.889402 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887606 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 16:23:53.889402 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887608 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 16:23:53.889402 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887611 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 16:23:53.889402 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887614 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 16:23:53.889402 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887617 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 16:23:53.889402 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887619 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 16:23:53.889402 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887622 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 16:23:53.889402 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887632 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 16:23:53.889897 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887634 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 16:23:53.889897 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887637 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 16:23:53.889897 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887640 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 16:23:53.889897 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887642 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 16:23:53.889897 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887645 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 16:23:53.889897 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887647 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 16:23:53.889897 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887650 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 16:23:53.889897 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887652 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 16:23:53.889897 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887655 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 16:23:53.889897 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887657 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 16:23:53.889897 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887660 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 16:23:53.889897 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887663 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 16:23:53.889897 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887665 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 16:23:53.889897 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887668 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 16:23:53.889897 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887670 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 16:23:53.889897 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887674 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 16:23:53.889897 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887676 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 16:23:53.889897 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887679 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 16:23:53.889897 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887682 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 16:23:53.889897 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887685 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 16:23:53.890410 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887687 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 16:23:53.890410 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887690 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 16:23:53.890410 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887693 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 16:23:53.890410 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887695 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 16:23:53.890410 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887697 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 16:23:53.890410 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887700 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 16:23:53.890410 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887702 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 16:23:53.890410 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887705 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 16:23:53.890410 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887707 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 16:23:53.890410 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887709 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 16:23:53.890410 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887712 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 16:23:53.890410 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887714 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 16:23:53.890410 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887716 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 16:23:53.890410 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887719 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 16:23:53.890410 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887721 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 16:23:53.890410 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887724 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 16:23:53.890410 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887726 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 16:23:53.890410 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887728 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 16:23:53.890410 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887731 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 16:23:53.890410 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887733 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 16:23:53.890904 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887735 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 16:23:53.890904 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887738 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 16:23:53.890904 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887743 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 16:23:53.890904 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887745 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 16:23:53.890904 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887748 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 16:23:53.890904 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887750 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 16:23:53.890904 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887753 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 16:23:53.890904 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887755 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 12 16:23:53.890904 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887767 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 16:23:53.890904 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887769 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 16:23:53.890904 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887774 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 16:23:53.890904 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887778 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 16:23:53.890904 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887781 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 16:23:53.890904 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887785 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 16:23:53.890904 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887788 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 16:23:53.890904 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887790 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 16:23:53.890904 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887794 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 16:23:53.890904 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887797 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 16:23:53.890904 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887800 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 16:23:53.891415 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887803 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 16:23:53.891415 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887805 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 16:23:53.891415 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887808 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 16:23:53.891415 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887811 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 16:23:53.891415 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887813 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 16:23:53.891415 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887816 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 16:23:53.891415 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887819 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 16:23:53.891415 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887821 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 16:23:53.891415 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887824 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 16:23:53.891415 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887826 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 16:23:53.891415 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887829 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 16:23:53.891415 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887831 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 16:23:53.891415 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887834 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 16:23:53.891415 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887836 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 16:23:53.891415 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.887838 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 16:23:53.891415 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888279 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 16:23:53.891415 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888285 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 16:23:53.891415 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888289 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 16:23:53.891415 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888292 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 16:23:53.891415 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888294 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 16:23:53.891907 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888297 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 16:23:53.891907 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888300 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 16:23:53.891907 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888302 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 16:23:53.891907 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888307 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 16:23:53.891907 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888310 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 16:23:53.891907 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888313 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 16:23:53.891907 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888315 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 16:23:53.891907 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888318 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 16:23:53.891907 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888321 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 16:23:53.891907 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888323 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 16:23:53.891907 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888326 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 16:23:53.891907 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888328 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 16:23:53.891907 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888331 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 16:23:53.891907 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888333 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 16:23:53.891907 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888336 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 16:23:53.891907 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888338 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 16:23:53.891907 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888342 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 16:23:53.891907 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888346 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 16:23:53.891907 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888351 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 16:23:53.892406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888354 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 16:23:53.892406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888357 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 16:23:53.892406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888360 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 16:23:53.892406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888362 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 16:23:53.892406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888365 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 16:23:53.892406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888367 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 16:23:53.892406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888369 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 16:23:53.892406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888372 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 16:23:53.892406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888376 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 16:23:53.892406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888379 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 16:23:53.892406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888381 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 16:23:53.892406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888383 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 16:23:53.892406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888386 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 16:23:53.892406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888389 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 16:23:53.892406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888391 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 12 16:23:53.892406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888393 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 16:23:53.892406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888397 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 16:23:53.892406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888399 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 16:23:53.892406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888402 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 16:23:53.892406 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888405 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 16:23:53.892930 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888407 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 16:23:53.892930 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888410 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 16:23:53.892930 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888412 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 16:23:53.892930 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888416 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 16:23:53.892930 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888418 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 16:23:53.892930 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888421 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 16:23:53.892930 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888423 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 16:23:53.892930 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888426 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 16:23:53.892930 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888428 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 16:23:53.892930 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888431 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 16:23:53.892930 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888433 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 16:23:53.892930 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888435 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 16:23:53.892930 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888438 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 16:23:53.892930 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888441 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 16:23:53.892930 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888443 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 16:23:53.892930 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888445 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 16:23:53.892930 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888448 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 16:23:53.892930 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888450 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 16:23:53.892930 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888453 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 16:23:53.892930 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888455 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 16:23:53.893441 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888458 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 16:23:53.893441 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888461 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 16:23:53.893441 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888463 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 16:23:53.893441 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888466 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 16:23:53.893441 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888468 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 16:23:53.893441 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888471 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 16:23:53.893441 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888473 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 16:23:53.893441 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888475 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 16:23:53.893441 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888479 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 16:23:53.893441 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888482 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 16:23:53.893441 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888484 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 16:23:53.893441 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888487 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 16:23:53.893441 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888489 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 16:23:53.893441 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888491 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 16:23:53.893441 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888494 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 16:23:53.893441 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888496 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 16:23:53.893441 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888498 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 16:23:53.893441 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888501 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 16:23:53.893441 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888503 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 16:23:53.893441 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888505 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 16:23:53.893961 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888508 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 16:23:53.893961 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888511 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 16:23:53.893961 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888514 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 16:23:53.893961 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888517 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 16:23:53.893961 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888519 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 16:23:53.893961 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888522 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 16:23:53.893961 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888525 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 16:23:53.893961 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888527 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 16:23:53.893961 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888529 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 16:23:53.893961 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888533 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 16:23:53.893961 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888537 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 16:23:53.893961 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888540 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 16:23:53.893961 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888543 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 16:23:53.893961 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888546 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 16:23:53.893961 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.888548 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 16:23:53.893961 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888619 2559 flags.go:64] FLAG: --address="0.0.0.0" Jul 12 16:23:53.893961 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888627 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 12 16:23:53.893961 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888633 2559 flags.go:64] FLAG: --anonymous-auth="true" Jul 12 16:23:53.893961 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888637 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 12 16:23:53.893961 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888641 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 12 16:23:53.894476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888646 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 12 16:23:53.894476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888650 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 12 16:23:53.894476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888655 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 12 16:23:53.894476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888658 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 12 16:23:53.894476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888661 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 12 16:23:53.894476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888665 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 12 16:23:53.894476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888668 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 12 16:23:53.894476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888671 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 12 16:23:53.894476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888674 2559 flags.go:64] FLAG: --cgroup-root="" Jul 12 16:23:53.894476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888676 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 12 16:23:53.894476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888679 2559 flags.go:64] FLAG: --client-ca-file="" Jul 12 16:23:53.894476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888682 2559 flags.go:64] FLAG: --cloud-provider="external" Jul 12 16:23:53.894476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888685 2559 flags.go:64] FLAG: --cluster-dns="[]" Jul 12 16:23:53.894476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888690 2559 flags.go:64] FLAG: --cluster-domain="" Jul 12 16:23:53.894476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888692 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 12 16:23:53.894476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888696 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 12 16:23:53.894476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888699 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 12 16:23:53.894476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888702 2559 flags.go:64] FLAG: --container-log-max-files="5" Jul 12 16:23:53.894476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888706 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 12 16:23:53.894476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888709 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 12 16:23:53.894476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888712 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 12 16:23:53.894476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888715 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 12 16:23:53.894476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888718 2559 flags.go:64] FLAG: --contention-profiling="false" Jul 12 16:23:53.894476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888721 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888725 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888728 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888731 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888735 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888738 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888740 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888743 2559 flags.go:64] FLAG: --enable-load-reader="false" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888746 2559 flags.go:64] FLAG: --enable-server="true" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888750 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888754 2559 flags.go:64] FLAG: --event-burst="100" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888757 2559 flags.go:64] FLAG: --event-qps="50" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888760 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888763 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888766 2559 flags.go:64] FLAG: --eviction-hard="" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888770 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888773 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888775 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888778 2559 flags.go:64] FLAG: --eviction-soft="" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888781 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888784 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888786 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888789 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888792 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888795 2559 flags.go:64] FLAG: --fail-swap-on="true" Jul 12 16:23:53.895069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888797 2559 flags.go:64] FLAG: --feature-gates="" Jul 12 16:23:53.895717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888801 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jul 12 16:23:53.895717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888803 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 12 16:23:53.895717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888807 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 12 16:23:53.895717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888810 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 12 16:23:53.895717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888813 2559 flags.go:64] FLAG: --healthz-port="10248" Jul 12 16:23:53.895717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888816 2559 flags.go:64] FLAG: --help="false" Jul 12 16:23:53.895717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888819 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-130-204.ec2.internal" Jul 12 16:23:53.895717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888822 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 12 16:23:53.895717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888825 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jul 12 16:23:53.895717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888828 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 12 16:23:53.895717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888831 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 12 16:23:53.895717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888834 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 12 16:23:53.895717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888836 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 12 16:23:53.895717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888839 2559 flags.go:64] FLAG: --image-service-endpoint="" Jul 12 16:23:53.895717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888842 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 12 16:23:53.895717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888846 2559 flags.go:64] FLAG: --kube-api-burst="100" Jul 12 16:23:53.895717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888849 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 12 16:23:53.895717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888852 2559 flags.go:64] FLAG: --kube-api-qps="50" Jul 12 16:23:53.895717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888854 2559 flags.go:64] FLAG: --kube-reserved="" Jul 12 16:23:53.895717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888857 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 12 16:23:53.895717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888860 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 12 16:23:53.895717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888863 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jul 12 16:23:53.895717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888865 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 12 16:23:53.895717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888868 2559 flags.go:64] FLAG: --lock-file="" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888871 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888874 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888877 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888882 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888884 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888887 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888890 2559 flags.go:64] FLAG: --logging-format="text" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888892 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888896 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888898 2559 flags.go:64] FLAG: --manifest-url="" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888901 2559 flags.go:64] FLAG: --manifest-url-header="" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888906 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888910 2559 flags.go:64] FLAG: --max-open-files="1000000" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888914 2559 flags.go:64] FLAG: --max-pods="110" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888916 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888921 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888923 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888926 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888930 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888933 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888935 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888943 2559 flags.go:64] FLAG: --node-status-max-images="50" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888946 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888950 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jul 12 16:23:53.896329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888953 2559 flags.go:64] FLAG: --pod-cidr="" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888955 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888961 2559 flags.go:64] FLAG: --pod-manifest-path="" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888963 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888966 2559 flags.go:64] FLAG: --pods-per-core="0" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888969 2559 flags.go:64] FLAG: --port="10250" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888972 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888975 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01c42fba496ffcb97" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888978 2559 flags.go:64] FLAG: --qos-reserved="" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888981 2559 flags.go:64] FLAG: --read-only-port="10255" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888984 2559 flags.go:64] FLAG: --register-node="true" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888986 2559 flags.go:64] FLAG: --register-with-taints="" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888990 2559 flags.go:64] FLAG: --registry-burst="10" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888992 2559 flags.go:64] FLAG: --registry-qps="5" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888995 2559 flags.go:64] FLAG: --reserved-cpus="" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.888997 2559 flags.go:64] FLAG: --reserved-memory="" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889002 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889005 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889008 2559 flags.go:64] FLAG: --rotate-certificates="false" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889011 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889014 2559 flags.go:64] FLAG: --runonce="false" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889017 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889020 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889023 2559 flags.go:64] FLAG: --seccomp-default="false" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889027 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 12 16:23:53.896976 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889030 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889033 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889036 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889038 2559 flags.go:64] FLAG: --storage-driver-password="root" Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889041 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889044 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889047 2559 flags.go:64] FLAG: --storage-driver-user="root" Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889050 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889053 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889056 2559 flags.go:64] FLAG: --system-cgroups="" Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889058 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889063 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889066 2559 flags.go:64] FLAG: --tls-cert-file="" Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889069 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889073 2559 flags.go:64] FLAG: --tls-min-version="" Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889076 2559 flags.go:64] FLAG: --tls-private-key-file="" Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889078 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889081 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889098 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889101 2559 flags.go:64] FLAG: --v="2" Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889105 2559 flags.go:64] FLAG: --version="false" Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889109 2559 flags.go:64] FLAG: --vmodule="" Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889113 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.889116 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889269 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 16:23:53.897654 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889273 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 16:23:53.898287 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889276 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 16:23:53.898287 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889279 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 16:23:53.898287 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889283 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 16:23:53.898287 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889286 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 16:23:53.898287 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889290 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 16:23:53.898287 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889294 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 16:23:53.898287 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889297 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 16:23:53.898287 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889300 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 16:23:53.898287 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889303 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 16:23:53.898287 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889306 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 16:23:53.898287 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889308 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 16:23:53.898287 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889311 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 12 16:23:53.898287 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889314 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 16:23:53.898287 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889316 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 16:23:53.898287 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889319 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 16:23:53.898287 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889321 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 16:23:53.898287 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889325 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 16:23:53.898287 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889329 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 16:23:53.898287 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889332 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 16:23:53.898287 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889334 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 16:23:53.898778 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889337 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 16:23:53.898778 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889340 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 16:23:53.898778 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889342 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 16:23:53.898778 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889344 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 16:23:53.898778 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889347 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 16:23:53.898778 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889349 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 16:23:53.898778 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889351 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 16:23:53.898778 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889354 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 16:23:53.898778 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889356 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 16:23:53.898778 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889359 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 16:23:53.898778 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889362 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 16:23:53.898778 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889364 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 16:23:53.898778 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889367 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 16:23:53.898778 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889369 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 16:23:53.898778 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889372 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 16:23:53.898778 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889375 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 16:23:53.898778 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889379 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 16:23:53.898778 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889383 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 16:23:53.898778 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889387 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 16:23:53.899268 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889389 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 16:23:53.899268 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889392 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 16:23:53.899268 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889395 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 16:23:53.899268 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889397 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 16:23:53.899268 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889400 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 16:23:53.899268 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889403 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 16:23:53.899268 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889406 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 16:23:53.899268 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889409 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 16:23:53.899268 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889412 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 16:23:53.899268 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889415 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 16:23:53.899268 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889418 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 16:23:53.899268 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889421 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 16:23:53.899268 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889423 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 16:23:53.899268 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889426 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 16:23:53.899268 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889428 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 16:23:53.899268 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889430 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 16:23:53.899268 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889432 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 16:23:53.899268 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889435 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 16:23:53.899268 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889437 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 16:23:53.899741 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889440 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 16:23:53.899741 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889442 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 16:23:53.899741 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889448 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 16:23:53.899741 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889451 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 16:23:53.899741 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889453 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 16:23:53.899741 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889455 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 16:23:53.899741 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889458 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 16:23:53.899741 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889460 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 16:23:53.899741 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889462 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 16:23:53.899741 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889465 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 16:23:53.899741 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889468 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 16:23:53.899741 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889472 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 16:23:53.899741 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889474 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 16:23:53.899741 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889477 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 16:23:53.899741 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889479 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 16:23:53.899741 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889482 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 16:23:53.899741 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889484 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 16:23:53.899741 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889486 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 16:23:53.899741 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889489 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 16:23:53.900239 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889491 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 16:23:53.900239 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889494 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 16:23:53.900239 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889496 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 16:23:53.900239 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889499 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 16:23:53.900239 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889501 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 16:23:53.900239 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889503 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 16:23:53.900239 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889506 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 16:23:53.900239 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889508 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 16:23:53.900239 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889510 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 16:23:53.900239 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889513 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 16:23:53.900239 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889515 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 16:23:53.900239 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889517 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 16:23:53.900239 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889520 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 16:23:53.900239 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889522 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 16:23:53.900239 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889525 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 16:23:53.900239 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889530 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 16:23:53.900239 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889533 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 16:23:53.900239 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889536 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 16:23:53.900239 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889538 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 16:23:53.900239 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.889541 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 16:23:53.900734 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.890208 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 12 16:23:53.900734 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.897838 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 12 16:23:53.900734 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.897856 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 12 16:23:53.900734 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.897874 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 12 16:23:53.900734 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.897886 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 12 16:23:53.900734 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.897942 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 16:23:53.900734 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.897948 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 16:23:53.900734 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.897951 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 16:23:53.900734 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.897954 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 16:23:53.900734 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.897957 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 16:23:53.900734 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.897959 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 16:23:53.900734 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.897963 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 16:23:53.900734 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.897966 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 16:23:53.900734 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.897969 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 16:23:53.900734 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.897971 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 16:23:53.901133 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.897974 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 16:23:53.901133 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.897977 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 16:23:53.901133 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.897980 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 16:23:53.901133 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.897983 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 16:23:53.901133 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.897986 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 16:23:53.901133 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.897989 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 16:23:53.901133 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.897991 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 16:23:53.901133 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.897994 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 16:23:53.901133 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.897996 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 16:23:53.901133 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.897999 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 16:23:53.901133 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898001 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 16:23:53.901133 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898004 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 16:23:53.901133 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898006 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 16:23:53.901133 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898009 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 16:23:53.901133 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898011 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 16:23:53.901133 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898014 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 16:23:53.901133 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898016 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 16:23:53.901133 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898019 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 16:23:53.901133 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898021 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 16:23:53.901133 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898025 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 16:23:53.901678 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898028 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 16:23:53.901678 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898030 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 16:23:53.901678 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898032 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 16:23:53.901678 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898035 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 16:23:53.901678 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898037 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 16:23:53.901678 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898042 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 16:23:53.901678 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898045 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 16:23:53.901678 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898048 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 16:23:53.901678 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898051 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 16:23:53.901678 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898054 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 16:23:53.901678 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898056 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 16:23:53.901678 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898059 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 16:23:53.901678 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898061 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 16:23:53.901678 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898064 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 16:23:53.901678 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898066 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 16:23:53.901678 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898069 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 16:23:53.901678 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898072 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 16:23:53.901678 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898074 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 16:23:53.901678 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898077 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 16:23:53.902265 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898079 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 16:23:53.902265 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898082 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 16:23:53.902265 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898103 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 16:23:53.902265 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898106 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 16:23:53.902265 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898110 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 16:23:53.902265 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898112 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 16:23:53.902265 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898115 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 16:23:53.902265 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898117 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 16:23:53.902265 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898120 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 16:23:53.902265 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898122 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 16:23:53.902265 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898125 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 16:23:53.902265 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898127 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 16:23:53.902265 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898131 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 16:23:53.902265 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898134 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 16:23:53.902265 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898137 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 16:23:53.902265 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898139 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 16:23:53.902265 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898142 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 16:23:53.902265 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898144 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 16:23:53.902265 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898147 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 16:23:53.902265 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898149 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 16:23:53.902783 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898152 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 16:23:53.902783 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898154 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 16:23:53.902783 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898156 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 16:23:53.902783 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898159 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 16:23:53.902783 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898161 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 16:23:53.902783 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898164 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 16:23:53.902783 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898166 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 16:23:53.902783 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898169 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 16:23:53.902783 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898171 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 16:23:53.902783 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898173 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 16:23:53.902783 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898176 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 16:23:53.902783 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898178 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 12 16:23:53.902783 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898181 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 16:23:53.902783 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898183 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 16:23:53.902783 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898185 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 16:23:53.902783 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898188 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 16:23:53.902783 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898190 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 16:23:53.902783 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898192 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 16:23:53.902783 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898195 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 16:23:53.902783 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898198 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 16:23:53.903281 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898200 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 16:23:53.903281 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898204 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 16:23:53.903281 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898208 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 16:23:53.903281 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898210 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 16:23:53.903281 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898213 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 16:23:53.903281 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898216 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 16:23:53.903281 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898221 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 16:23:53.903281 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898224 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 16:23:53.903281 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898226 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 16:23:53.903281 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898229 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 16:23:53.903281 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.898234 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 12 16:23:53.903281 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898359 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 16:23:53.903281 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898365 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 16:23:53.903599 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898368 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 16:23:53.903599 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898370 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 16:23:53.903599 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898373 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 16:23:53.903599 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898376 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 16:23:53.903599 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898379 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 16:23:53.903599 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898383 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 16:23:53.903599 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898386 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 16:23:53.903599 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898389 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 16:23:53.903599 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898392 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 12 16:23:53.903599 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898394 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 16:23:53.903599 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898397 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 16:23:53.903599 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898399 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 16:23:53.903599 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898401 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 16:23:53.903599 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898404 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 16:23:53.903599 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898406 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 16:23:53.903599 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898408 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 16:23:53.903599 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898411 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 16:23:53.903599 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898413 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 16:23:53.903599 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898416 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 16:23:53.904108 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898418 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 16:23:53.904108 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898421 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 16:23:53.904108 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898423 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 16:23:53.904108 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898426 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 16:23:53.904108 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898428 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 16:23:53.904108 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898431 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 16:23:53.904108 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898433 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 16:23:53.904108 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898436 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 16:23:53.904108 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898439 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 16:23:53.904108 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898442 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 16:23:53.904108 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898444 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 16:23:53.904108 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898447 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 16:23:53.904108 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898449 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 16:23:53.904108 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898451 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 16:23:53.904108 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898453 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 16:23:53.904108 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898456 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 16:23:53.904108 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898458 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 16:23:53.904108 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898461 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 16:23:53.904108 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898463 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 16:23:53.904108 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898465 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 16:23:53.904611 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898468 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 16:23:53.904611 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898470 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 16:23:53.904611 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898473 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 16:23:53.904611 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898475 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 16:23:53.904611 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898480 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 16:23:53.904611 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898483 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 16:23:53.904611 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898485 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 16:23:53.904611 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898488 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 16:23:53.904611 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898490 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 16:23:53.904611 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898493 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 16:23:53.904611 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898496 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 16:23:53.904611 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898498 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 16:23:53.904611 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898501 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 16:23:53.904611 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898503 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 16:23:53.904611 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898505 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 16:23:53.904611 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898508 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 16:23:53.904611 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898510 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 16:23:53.904611 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898513 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 16:23:53.904611 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898515 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 16:23:53.905067 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898519 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 16:23:53.905067 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898523 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 16:23:53.905067 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898526 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 16:23:53.905067 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898529 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 16:23:53.905067 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898532 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 16:23:53.905067 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898535 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 16:23:53.905067 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898538 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 16:23:53.905067 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898541 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 16:23:53.905067 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898544 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 16:23:53.905067 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898546 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 16:23:53.905067 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898549 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 16:23:53.905067 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898551 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 16:23:53.905067 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898553 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 16:23:53.905067 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898556 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 16:23:53.905067 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898558 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 16:23:53.905067 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898561 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 16:23:53.905067 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898563 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 16:23:53.905067 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898566 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 16:23:53.905067 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898569 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 16:23:53.905615 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898572 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 16:23:53.905615 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898574 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 16:23:53.905615 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898576 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 16:23:53.905615 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898579 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 16:23:53.905615 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898581 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 16:23:53.905615 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898584 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 16:23:53.905615 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898586 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 16:23:53.905615 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898589 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 16:23:53.905615 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898591 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 16:23:53.905615 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898593 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 16:23:53.905615 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898596 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 16:23:53.905615 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898599 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 16:23:53.905615 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898601 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 16:23:53.905615 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898604 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 16:23:53.905615 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898606 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 16:23:53.905615 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898609 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 16:23:53.905615 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898611 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 16:23:53.905615 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898613 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 16:23:53.905615 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898616 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 16:23:53.905615 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:53.898618 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 16:23:53.906119 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.898623 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 12 16:23:53.906119 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.898739 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jul 12 16:23:53.906119 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.901115 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 12 16:23:53.906119 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.902644 2559 server.go:1019] "Starting client certificate rotation" Jul 12 16:23:53.906119 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.902739 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 12 16:23:53.906119 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.902773 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 12 16:23:53.906119 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.905423 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 12 16:23:53.908599 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.908577 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 12 16:23:53.920280 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.920258 2559 log.go:25] "Validated CRI v1 runtime API" Jul 12 16:23:53.922552 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.922535 2559 log.go:25] "Validated CRI v1 image API" Jul 12 16:23:53.925581 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.925566 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 12 16:23:53.931341 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.931315 2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 888dc0ed-fcc6-459f-b252-6ff02ae3b192:/dev/nvme0n1p3 e10f11b6-90d9-484d-93f6-236ad9608f75:/dev/nvme0n1p4] Jul 12 16:23:53.931395 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.931341 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 12 16:23:53.938246 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.938135 2559 manager.go:216] Machine: {Timestamp:2026-07-12 16:23:53.936676483 +0000 UTC m=+0.390064460 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3082171 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec210d26ad554725d1bd5a0f413299f6 SystemUUID:ec210d26-ad55-4725-d1bd-5a0f413299f6 BootID:5e9a3b68-bc42-4369-a186-6e6db7f8bd1a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:37:8f:57:fc:9b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:37:8f:57:fc:9b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:8c:0f:13:c3:22 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 12 16:23:53.938246 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.938241 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 12 16:23:53.938355 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.938323 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 12 16:23:53.939025 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.939006 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 12 16:23:53.941837 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.941811 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 12 16:23:53.941980 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.941841 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-204.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 12 16:23:53.942784 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.942774 2559 topology_manager.go:138] "Creating topology manager with none policy" Jul 12 16:23:53.942819 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.942787 2559 container_manager_linux.go:309] "Creating device plugin manager" Jul 12 16:23:53.942819 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.942794 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 12 16:23:53.942819 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.942809 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 12 16:23:53.944741 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.944730 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 12 16:23:53.949409 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.949396 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 12 16:23:53.949536 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.949526 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 12 16:23:53.949578 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.949559 2559 kubelet.go:486] "Attempting to sync node with API server" Jul 12 16:23:53.949609 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.949577 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 12 16:23:53.949609 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.949592 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 12 16:23:53.949609 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.949602 2559 kubelet.go:398] "Adding apiserver pod source" Jul 12 16:23:53.949609 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.949610 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 12 16:23:53.950060 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.950036 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 12 16:23:53.950133 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.950053 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 12 16:23:53.952457 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.952414 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 12 16:23:53.954930 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.954916 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 12 16:23:53.954975 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.954947 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 12 16:23:53.955142 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.955131 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 12 16:23:53.955176 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.955147 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 12 16:23:53.955176 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.955154 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 12 16:23:53.955176 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.955159 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 12 16:23:53.955176 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.955166 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 12 16:23:53.955176 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.955171 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 12 16:23:53.955795 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.955781 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 12 16:23:53.955795 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.955792 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 12 16:23:53.955872 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.955801 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 12 16:23:53.955872 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.955806 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 12 16:23:53.955872 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.955815 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 12 16:23:53.955872 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.955823 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 12 16:23:53.956661 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.956650 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 12 16:23:53.956661 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.956660 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 12 16:23:53.959846 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.959827 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-204.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 12 16:23:53.960080 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:53.960060 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 12 16:23:53.960155 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:53.960113 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-204.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 12 16:23:53.960456 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.960439 2559 server.go:1268] "Started kubelet" Jul 12 16:23:53.960564 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.960529 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 12 16:23:53.960616 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.960529 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 12 16:23:53.960658 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.960631 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 12 16:23:53.965353 ip-10-0-130-204 systemd[1]: Started Kubernetes Kubelet. Jul 12 16:23:53.966434 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.966178 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 12 16:23:53.966649 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.966554 2559 server.go:310] "Adding debug handlers to kubelet server" Jul 12 16:23:53.972179 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:53.972161 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 12 16:23:53.972344 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:53.971189 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-204.ec2.internal.18c1976fd3777175 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-204.ec2.internal,UID:ip-10-0-130-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-204.ec2.internal,},FirstTimestamp:2026-07-12 16:23:53.960411509 +0000 UTC m=+0.413799486,LastTimestamp:2026-07-12 16:23:53.960411509 +0000 UTC m=+0.413799486,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-204.ec2.internal,}" Jul 12 16:23:53.976601 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.976578 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 12 16:23:53.976601 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.976597 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 12 16:23:53.976763 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:53.976669 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-204.ec2.internal\" not found" Jul 12 16:23:53.977341 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.977281 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 12 16:23:53.977341 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.977300 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 12 16:23:53.977473 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.977283 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 12 16:23:53.977473 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.977402 2559 factory.go:55] Registering systemd factory Jul 12 16:23:53.977473 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.977420 2559 factory.go:223] Registration of the systemd container factory successfully Jul 12 16:23:53.977608 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.977476 2559 reconstruct.go:97] "Volume reconstruction finished" Jul 12 16:23:53.977608 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.977498 2559 reconciler.go:29] "Reconciler: start to sync state" Jul 12 16:23:53.977811 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.977796 2559 factory.go:153] Registering CRI-O factory Jul 12 16:23:53.977857 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.977815 2559 factory.go:223] Registration of the crio container factory successfully Jul 12 16:23:53.977900 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.977862 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 12 16:23:53.977900 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.977888 2559 factory.go:103] Registering Raw factory Jul 12 16:23:53.977965 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.977905 2559 manager.go:1196] Started watching for new ooms in manager Jul 12 16:23:53.978403 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.978391 2559 manager.go:349] Starting recovery of all containers Jul 12 16:23:53.978751 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:53.978733 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 12 16:23:53.978840 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:53.978820 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-204.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 12 16:23:53.988703 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.988688 2559 manager.go:354] Recovery completed Jul 12 16:23:53.990352 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:53.990330 2559 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 12 16:23:53.992250 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.992231 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m62lp" Jul 12 16:23:53.993630 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.993619 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 16:23:53.996659 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.996643 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeHasSufficientMemory" Jul 12 16:23:53.996716 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.996680 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 16:23:53.996716 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.996695 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeHasSufficientPID" Jul 12 16:23:53.997352 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.997338 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 12 16:23:53.997352 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.997351 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 12 16:23:53.997464 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.997353 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 16:23:53.997464 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.997367 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 12 16:23:53.998927 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.998909 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeHasSufficientMemory" Jul 12 16:23:53.999005 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.998939 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 16:23:53.999005 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.998951 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeHasSufficientPID" Jul 12 16:23:53.999551 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.999536 2559 policy_none.go:49] "None policy: Start" Jul 12 16:23:53.999634 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.999557 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 12 16:23:53.999634 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.999571 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 12 16:23:53.999988 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:53.999974 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m62lp" Jul 12 16:23:54.001677 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.001662 2559 policy_none.go:47] "Start" Jul 12 16:23:54.003486 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:54.003391 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-204.ec2.internal.18c1976fd5a08f76 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-204.ec2.internal,UID:ip-10-0-130-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-204.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-204.ec2.internal,},FirstTimestamp:2026-07-12 16:23:53.996660598 +0000 UTC m=+0.450048582,LastTimestamp:2026-07-12 16:23:53.996660598 +0000 UTC m=+0.450048582,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-204.ec2.internal,}" Jul 12 16:23:54.060765 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.038245 2559 manager.go:337] "Starting Device Plugin manager" Jul 12 16:23:54.060765 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:54.038431 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 12 16:23:54.060765 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.038446 2559 server.go:87] "Starting device plugin registration server" Jul 12 16:23:54.060765 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.038689 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 12 16:23:54.060765 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.038702 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 12 16:23:54.060765 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.038808 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 12 16:23:54.060765 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.038905 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 12 16:23:54.060765 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.038915 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 12 16:23:54.060765 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:54.039464 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 12 16:23:54.060765 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:54.039510 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-204.ec2.internal\" not found" Jul 12 16:23:54.060765 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.051859 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 12 16:23:54.060765 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.053230 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 12 16:23:54.060765 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.053261 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 12 16:23:54.060765 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.053279 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jul 12 16:23:54.060765 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:54.053307 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 12 16:23:54.060765 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.055484 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 16:23:54.139896 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.139818 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 16:23:54.141012 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.140993 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeHasSufficientMemory" Jul 12 16:23:54.141127 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.141028 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 16:23:54.141127 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.141041 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeHasSufficientPID" Jul 12 16:23:54.141127 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.141074 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-204.ec2.internal" Jul 12 16:23:54.149883 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.149867 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-204.ec2.internal" Jul 12 16:23:54.149937 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:54.149891 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-204.ec2.internal\": node \"ip-10-0-130-204.ec2.internal\" not found" Jul 12 16:23:54.153686 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.153668 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-204.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-204.ec2.internal"] Jul 12 16:23:54.153776 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.153722 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 16:23:54.155207 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.155191 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeHasSufficientMemory" Jul 12 16:23:54.155270 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.155219 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 16:23:54.155270 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.155255 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeHasSufficientPID" Jul 12 16:23:54.157545 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.157533 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 16:23:54.157658 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.157643 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-204.ec2.internal" Jul 12 16:23:54.157694 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.157675 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 16:23:54.158332 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.158312 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeHasSufficientMemory" Jul 12 16:23:54.158332 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.158335 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 16:23:54.158504 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.158347 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeHasSufficientPID" Jul 12 16:23:54.158504 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.158400 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeHasSufficientMemory" Jul 12 16:23:54.158504 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.158431 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 16:23:54.158504 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.158446 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeHasSufficientPID" Jul 12 16:23:54.160650 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.160634 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-204.ec2.internal" Jul 12 16:23:54.160720 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.160659 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 16:23:54.161485 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.161468 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeHasSufficientMemory" Jul 12 16:23:54.161584 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.161501 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 16:23:54.161584 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.161513 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeHasSufficientPID" Jul 12 16:23:54.175130 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:54.175111 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-204.ec2.internal\" not found" Jul 12 16:23:54.189030 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:54.189005 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-204.ec2.internal\" not found" node="ip-10-0-130-204.ec2.internal" Jul 12 16:23:54.193367 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:54.193351 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-204.ec2.internal\" not found" node="ip-10-0-130-204.ec2.internal" Jul 12 16:23:54.275245 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:54.275214 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-204.ec2.internal\" not found" Jul 12 16:23:54.278508 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.278486 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/790d0909109a1922f8e1cf8bf63c1a22-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-204.ec2.internal\" (UID: \"790d0909109a1922f8e1cf8bf63c1a22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-204.ec2.internal" Jul 12 16:23:54.278649 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.278521 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec6b92b0a7a5ab3f89d1c8e01ecdb934-config\") pod \"kube-apiserver-proxy-ip-10-0-130-204.ec2.internal\" (UID: \"ec6b92b0a7a5ab3f89d1c8e01ecdb934\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-204.ec2.internal" Jul 12 16:23:54.278649 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.278547 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/790d0909109a1922f8e1cf8bf63c1a22-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-204.ec2.internal\" (UID: \"790d0909109a1922f8e1cf8bf63c1a22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-204.ec2.internal" Jul 12 16:23:54.375664 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:54.375627 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-204.ec2.internal\" not found" Jul 12 16:23:54.378934 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.378911 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/790d0909109a1922f8e1cf8bf63c1a22-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-204.ec2.internal\" (UID: \"790d0909109a1922f8e1cf8bf63c1a22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-204.ec2.internal" Jul 12 16:23:54.379017 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.378952 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/790d0909109a1922f8e1cf8bf63c1a22-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-204.ec2.internal\" (UID: \"790d0909109a1922f8e1cf8bf63c1a22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-204.ec2.internal" Jul 12 16:23:54.379017 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.378978 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec6b92b0a7a5ab3f89d1c8e01ecdb934-config\") pod \"kube-apiserver-proxy-ip-10-0-130-204.ec2.internal\" (UID: \"ec6b92b0a7a5ab3f89d1c8e01ecdb934\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-204.ec2.internal" Jul 12 16:23:54.379126 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.379022 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/790d0909109a1922f8e1cf8bf63c1a22-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-204.ec2.internal\" (UID: \"790d0909109a1922f8e1cf8bf63c1a22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-204.ec2.internal" Jul 12 16:23:54.379126 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.379025 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/790d0909109a1922f8e1cf8bf63c1a22-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-204.ec2.internal\" (UID: \"790d0909109a1922f8e1cf8bf63c1a22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-204.ec2.internal" Jul 12 16:23:54.379126 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.379026 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec6b92b0a7a5ab3f89d1c8e01ecdb934-config\") pod \"kube-apiserver-proxy-ip-10-0-130-204.ec2.internal\" (UID: \"ec6b92b0a7a5ab3f89d1c8e01ecdb934\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-204.ec2.internal" Jul 12 16:23:54.476391 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:54.476358 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-204.ec2.internal\" not found" Jul 12 16:23:54.491790 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.491763 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-204.ec2.internal" Jul 12 16:23:54.498177 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.498159 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-204.ec2.internal" Jul 12 16:23:54.576696 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:54.576655 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-204.ec2.internal\" not found" Jul 12 16:23:54.677123 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:54.677072 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-204.ec2.internal\" not found" Jul 12 16:23:54.777616 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:54.777539 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-204.ec2.internal\" not found" Jul 12 16:23:54.819490 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.819463 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 16:23:54.878679 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:54.878646 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-204.ec2.internal\" not found" Jul 12 16:23:54.901925 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.901893 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 12 16:23:54.902083 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.902062 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 12 16:23:54.902083 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:54.902072 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 12 16:23:54.978813 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:54.978777 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-204.ec2.internal\" not found" Jul 12 16:23:55.004817 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.004767 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-11 16:18:54 +0000 UTC" deadline="2027-12-28 18:08:53.795791364 +0000 UTC" Jul 12 16:23:55.004817 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.004810 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12817h44m58.79098504s" Jul 12 16:23:55.079206 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:55.079121 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-204.ec2.internal\" not found" Jul 12 16:23:55.130458 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.130429 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 16:23:55.131787 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.131765 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeHasSufficientMemory" Jul 12 16:23:55.131897 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.131804 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 16:23:55.131897 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.131819 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeHasSufficientPID" Jul 12 16:23:55.144228 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.144202 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 16:23:55.179443 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:55.179401 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-204.ec2.internal\" not found" Jul 12 16:23:55.227704 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:55.227666 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec6b92b0a7a5ab3f89d1c8e01ecdb934.slice/crio-d9c15ca474f28fb76b0cc2bf6b1aaa99c94f2fdd2e616d9c42fa47fc034a1896 WatchSource:0}: Error finding container d9c15ca474f28fb76b0cc2bf6b1aaa99c94f2fdd2e616d9c42fa47fc034a1896: Status 404 returned error can't find the container with id d9c15ca474f28fb76b0cc2bf6b1aaa99c94f2fdd2e616d9c42fa47fc034a1896 Jul 12 16:23:55.228187 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:55.228162 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod790d0909109a1922f8e1cf8bf63c1a22.slice/crio-ad6f6cc65d4d92cec9ccb8d12b76d38bc1487535040d152a0c308e129e056387 WatchSource:0}: Error finding container ad6f6cc65d4d92cec9ccb8d12b76d38bc1487535040d152a0c308e129e056387: Status 404 returned error can't find the container with id ad6f6cc65d4d92cec9ccb8d12b76d38bc1487535040d152a0c308e129e056387 Jul 12 16:23:55.233822 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.233798 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 16:23:55.234190 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.234172 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 16:23:55.277543 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.277490 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-204.ec2.internal" Jul 12 16:23:55.293580 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.293553 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 12 16:23:55.294773 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.294759 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-204.ec2.internal" Jul 12 16:23:55.304730 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.304708 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 12 16:23:55.950392 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.950362 2559 apiserver.go:52] "Watching apiserver" Jul 12 16:23:55.964285 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.964242 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 12 16:23:55.967393 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.967352 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-trttp","openshift-multus/multus-additional-cni-plugins-hztg9","openshift-multus/multus-sdjjz","kube-system/konnectivity-agent-4hxjr","openshift-cluster-node-tuning-operator/tuned-nf8zc","openshift-image-registry/node-ca-ng9tv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-204.ec2.internal","openshift-multus/network-metrics-daemon-vjfj4","openshift-network-diagnostics/network-check-target-8d275","openshift-network-operator/iptables-alerter-pfkrd","openshift-ovn-kubernetes/ovnkube-node-vg4zm","kube-system/global-pull-secret-syncer-8l4qq","kube-system/kube-apiserver-proxy-ip-10-0-130-204.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh"] Jul 12 16:23:55.970463 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.970434 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:23:55.970602 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:55.970543 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjfj4" podUID="ccd1221a-8ea7-4bba-ba15-999ca853321e" Jul 12 16:23:55.972970 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.972948 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:55.975183 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.975153 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sdjjz" Jul 12 16:23:55.977303 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.977270 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 12 16:23:55.978131 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.978111 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pfkrd" Jul 12 16:23:55.979634 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.979608 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 12 16:23:55.979747 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.979683 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 12 16:23:55.979959 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.979941 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 12 16:23:55.980109 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.980064 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 12 16:23:55.980109 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.980102 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tg4gn\"" Jul 12 16:23:55.980281 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.980151 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 12 16:23:55.980281 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.979951 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 12 16:23:55.980362 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.980326 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 12 16:23:55.980396 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.980381 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 12 16:23:55.980522 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.980508 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:23:55.980557 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.980549 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 12 16:23:55.980641 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:55.980622 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8d275" podUID="537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1" Jul 12 16:23:55.980731 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.980717 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 12 16:23:55.980810 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.980797 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-txsgv\"" Jul 12 16:23:55.980985 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.980974 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 12 16:23:55.981142 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.981127 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 12 16:23:55.981205 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.981137 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tb44s\"" Jul 12 16:23:55.981205 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.981187 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 12 16:23:55.982897 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.982876 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ng9tv" Jul 12 16:23:55.985250 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.985226 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4hxjr" Jul 12 16:23:55.985592 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.985573 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 12 16:23:55.985592 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.985587 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 12 16:23:55.985807 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.985771 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-ovnkube-script-lib\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:55.985872 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.985823 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-99t8v\"" Jul 12 16:23:55.986117 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.985822 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-host-run-k8s-cni-cncf-io\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:55.986250 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.986229 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-hostroot\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:55.986318 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.986274 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a37e5364-776d-472f-a8c1-952def714dc8-host-slash\") pod \"iptables-alerter-pfkrd\" (UID: \"a37e5364-776d-472f-a8c1-952def714dc8\") " pod="openshift-network-operator/iptables-alerter-pfkrd" Jul 12 16:23:55.986318 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.986301 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-multus-cni-dir\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:55.986461 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.986326 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s26mg\" (UniqueName: \"kubernetes.io/projected/ccd1221a-8ea7-4bba-ba15-999ca853321e-kube-api-access-s26mg\") pod \"network-metrics-daemon-vjfj4\" (UID: \"ccd1221a-8ea7-4bba-ba15-999ca853321e\") " pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:23:55.986461 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.986355 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 12 16:23:55.986461 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.986377 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-node-log\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:55.986461 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.986414 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-host-cni-bin\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:55.986689 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.986495 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-host-cni-netd\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:55.986689 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.986525 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-env-overrides\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:55.986689 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.986561 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-245p6\" (UniqueName: \"kubernetes.io/projected/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-kube-api-access-245p6\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:55.986689 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.986593 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-multus-conf-dir\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:55.986689 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.986633 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-host-kubelet\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:55.986689 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.986659 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-systemd-units\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:55.986689 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.986684 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-etc-openvswitch\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:55.987061 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.986710 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-ovnkube-config\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:55.987061 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.986736 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-multus-socket-dir-parent\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:55.987061 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.986763 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b81da15-6b81-47e2-9162-e897fd167e11-multus-daemon-config\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:55.987061 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.986794 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrq7b\" (UniqueName: \"kubernetes.io/projected/a37e5364-776d-472f-a8c1-952def714dc8-kube-api-access-hrq7b\") pod \"iptables-alerter-pfkrd\" (UID: \"a37e5364-776d-472f-a8c1-952def714dc8\") " pod="openshift-network-operator/iptables-alerter-pfkrd" Jul 12 16:23:55.987061 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.986869 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccd1221a-8ea7-4bba-ba15-999ca853321e-metrics-certs\") pod \"network-metrics-daemon-vjfj4\" (UID: \"ccd1221a-8ea7-4bba-ba15-999ca853321e\") " pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:23:55.987061 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.986920 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-var-lib-openvswitch\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:55.987061 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.986954 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-run-openvswitch\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:55.987061 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.987012 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbq2q\" (UniqueName: \"kubernetes.io/projected/537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1-kube-api-access-nbq2q\") pod \"network-check-target-8d275\" (UID: \"537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1\") " pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:23:55.987061 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.987041 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-run-systemd\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:55.987568 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.987077 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-log-socket\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:55.987568 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.987137 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:55.987568 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.987187 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-system-cni-dir\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:55.987568 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.987218 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-os-release\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:55.987568 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.987240 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b81da15-6b81-47e2-9162-e897fd167e11-cni-binary-copy\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:55.987568 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.987275 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-host-var-lib-kubelet\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:55.987568 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.987313 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5q65\" (UniqueName: \"kubernetes.io/projected/8b81da15-6b81-47e2-9162-e897fd167e11-kube-api-access-l5q65\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:55.987568 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.987339 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-host-slash\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:55.987568 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.987363 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-host-run-netns\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:55.987568 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.987387 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-host-run-multus-certs\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:55.987568 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.987412 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a37e5364-776d-472f-a8c1-952def714dc8-iptables-alerter-script\") pod \"iptables-alerter-pfkrd\" (UID: \"a37e5364-776d-472f-a8c1-952def714dc8\") " pod="openshift-network-operator/iptables-alerter-pfkrd" Jul 12 16:23:55.987568 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.987437 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-run-ovn\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:55.987568 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.987470 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-host-run-ovn-kubernetes\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:55.987568 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.987494 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-ovn-node-metrics-cert\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:55.987568 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.987528 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-cnibin\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:55.987568 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.987558 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-host-run-netns\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:55.988533 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.987584 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-host-var-lib-cni-bin\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:55.988533 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.987612 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-host-var-lib-cni-multus\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:55.988533 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.987636 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-etc-kubernetes\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:55.988533 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.987740 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 12 16:23:55.988533 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.987836 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:55.988533 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.988330 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9694q\"" Jul 12 16:23:55.988533 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.988522 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 12 16:23:55.989113 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.989069 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 12 16:23:55.990314 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.990296 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-trttp" Jul 12 16:23:55.991391 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.991369 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 12 16:23:55.991539 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.991514 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 12 16:23:55.992220 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:55.991996 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-l5gvc\"" Jul 12 16:23:56.002525 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.000352 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.002525 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.000794 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 12 16:23:56.002525 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.001046 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 12 16:23:56.002525 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.001372 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6wdqw\"" Jul 12 16:23:56.004174 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.004149 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 12 16:23:56.004280 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.004197 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q6nhp\"" Jul 12 16:23:56.004280 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.004221 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 12 16:23:56.006056 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.005546 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:23:56.006056 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:56.005694 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l4qq" podUID="9ef6eef5-8bcb-409b-92c8-8be3c0632ec9" Jul 12 16:23:56.009521 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.009499 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" Jul 12 16:23:56.014984 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.014962 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 12 16:23:56.015447 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.015195 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 12 16:23:56.015447 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.015201 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 12 16:23:56.015447 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.015274 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9bzxb\"" Jul 12 16:23:56.023971 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.023946 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 16:23:56.030004 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.029965 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-thkl9" Jul 12 16:23:56.045232 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.045209 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-thkl9" Jul 12 16:23:56.061554 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.061501 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-204.ec2.internal" event={"ID":"ec6b92b0a7a5ab3f89d1c8e01ecdb934","Type":"ContainerStarted","Data":"d9c15ca474f28fb76b0cc2bf6b1aaa99c94f2fdd2e616d9c42fa47fc034a1896"} Jul 12 16:23:56.062912 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.062880 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-204.ec2.internal" event={"ID":"790d0909109a1922f8e1cf8bf63c1a22","Type":"ContainerStarted","Data":"ad6f6cc65d4d92cec9ccb8d12b76d38bc1487535040d152a0c308e129e056387"} Jul 12 16:23:56.078404 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.078381 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 12 16:23:56.088914 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.088882 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-host-kubelet\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.089051 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.088932 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/56d25b5a-80b2-4960-94d2-f6aeab700e82-konnectivity-ca\") pod \"konnectivity-agent-4hxjr\" (UID: \"56d25b5a-80b2-4960-94d2-f6aeab700e82\") " pod="kube-system/konnectivity-agent-4hxjr" Jul 12 16:23:56.089051 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.088971 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-var-lib-openvswitch\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.089051 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089001 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-etc-kubernetes\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.089051 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089029 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-run\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.089301 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089057 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqvjj\" (UniqueName: \"kubernetes.io/projected/c3386231-0fc2-4b3b-89e5-6dc353769a9f-kube-api-access-hqvjj\") pod \"aws-ebs-csi-driver-node-dw8hh\" (UID: \"c3386231-0fc2-4b3b-89e5-6dc353769a9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" Jul 12 16:23:56.089301 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089075 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-var-lib-openvswitch\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.089301 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089085 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2698e055-6034-4dad-9f91-fa9dd870b375-host\") pod \"node-ca-ng9tv\" (UID: \"2698e055-6034-4dad-9f91-fa9dd870b375\") " pod="openshift-image-registry/node-ca-ng9tv" Jul 12 16:23:56.089301 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.088990 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-host-kubelet\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.089301 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089155 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jslpz\" (UniqueName: \"kubernetes.io/projected/08851e67-2ac0-483b-b958-00384bf7a112-kube-api-access-jslpz\") pod \"node-resolver-trttp\" (UID: \"08851e67-2ac0-483b-b958-00384bf7a112\") " pod="openshift-dns/node-resolver-trttp" Jul 12 16:23:56.089301 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089187 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-run-systemd\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.089301 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089229 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.089301 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089259 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5q65\" (UniqueName: \"kubernetes.io/projected/8b81da15-6b81-47e2-9162-e897fd167e11-kube-api-access-l5q65\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.089301 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089264 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-run-systemd\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.089301 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089287 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-etc-sysctl-d\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.089657 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089317 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-dbus\") pod \"global-pull-secret-syncer-8l4qq\" (UID: \"9ef6eef5-8bcb-409b-92c8-8be3c0632ec9\") " pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:23:56.089657 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089329 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.089657 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089344 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c3386231-0fc2-4b3b-89e5-6dc353769a9f-etc-selinux\") pod \"aws-ebs-csi-driver-node-dw8hh\" (UID: \"c3386231-0fc2-4b3b-89e5-6dc353769a9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" Jul 12 16:23:56.089657 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089382 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-host-slash\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.089657 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089441 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-host-slash\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.089657 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089574 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-host-run-multus-certs\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.089657 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089613 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a37e5364-776d-472f-a8c1-952def714dc8-iptables-alerter-script\") pod \"iptables-alerter-pfkrd\" (UID: \"a37e5364-776d-472f-a8c1-952def714dc8\") " pod="openshift-network-operator/iptables-alerter-pfkrd" Jul 12 16:23:56.089657 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089647 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-host-run-multus-certs\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.089899 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089649 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559-system-cni-dir\") pod \"multus-additional-cni-plugins-hztg9\" (UID: \"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559\") " pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.089899 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089713 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559-cnibin\") pod \"multus-additional-cni-plugins-hztg9\" (UID: \"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559\") " pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.089899 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089739 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559-os-release\") pod \"multus-additional-cni-plugins-hztg9\" (UID: \"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559\") " pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.089899 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089768 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-var-lib-kubelet\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.089899 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089792 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e2f7f72-cd5d-428b-b450-96b920b5744e-tmp\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.089899 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089822 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-run-ovn\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.089899 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089848 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-host-run-ovn-kubernetes\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.089899 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089876 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hztg9\" (UID: \"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559\") " pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.090140 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089902 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-kubelet-config\") pod \"global-pull-secret-syncer-8l4qq\" (UID: \"9ef6eef5-8bcb-409b-92c8-8be3c0632ec9\") " pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:23:56.090140 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089940 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c3386231-0fc2-4b3b-89e5-6dc353769a9f-socket-dir\") pod \"aws-ebs-csi-driver-node-dw8hh\" (UID: \"c3386231-0fc2-4b3b-89e5-6dc353769a9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" Jul 12 16:23:56.090140 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089968 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-etc-kubernetes\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.090140 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.089994 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559-cni-binary-copy\") pod \"multus-additional-cni-plugins-hztg9\" (UID: \"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559\") " pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.090140 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.090020 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hztg9\" (UID: \"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559\") " pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.090140 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.090045 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-etc-modprobe-d\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.090140 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.090069 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c3386231-0fc2-4b3b-89e5-6dc353769a9f-device-dir\") pod \"aws-ebs-csi-driver-node-dw8hh\" (UID: \"c3386231-0fc2-4b3b-89e5-6dc353769a9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" Jul 12 16:23:56.090140 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.090096 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-ovnkube-script-lib\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.090547 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.090142 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-hostroot\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.090547 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.090167 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a37e5364-776d-472f-a8c1-952def714dc8-host-slash\") pod \"iptables-alerter-pfkrd\" (UID: \"a37e5364-776d-472f-a8c1-952def714dc8\") " pod="openshift-network-operator/iptables-alerter-pfkrd" Jul 12 16:23:56.090547 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.090208 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzv82\" (UniqueName: \"kubernetes.io/projected/2698e055-6034-4dad-9f91-fa9dd870b375-kube-api-access-zzv82\") pod \"node-ca-ng9tv\" (UID: \"2698e055-6034-4dad-9f91-fa9dd870b375\") " pod="openshift-image-registry/node-ca-ng9tv" Jul 12 16:23:56.090547 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.090228 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s26mg\" (UniqueName: \"kubernetes.io/projected/ccd1221a-8ea7-4bba-ba15-999ca853321e-kube-api-access-s26mg\") pod \"network-metrics-daemon-vjfj4\" (UID: \"ccd1221a-8ea7-4bba-ba15-999ca853321e\") " pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:23:56.090547 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.090245 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-245p6\" (UniqueName: \"kubernetes.io/projected/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-kube-api-access-245p6\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.090547 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.090266 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8ttr\" (UniqueName: \"kubernetes.io/projected/cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559-kube-api-access-q8ttr\") pod \"multus-additional-cni-plugins-hztg9\" (UID: \"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559\") " pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.090547 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.090282 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-etc-sysctl-conf\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.090547 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.090297 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08851e67-2ac0-483b-b958-00384bf7a112-tmp-dir\") pod \"node-resolver-trttp\" (UID: \"08851e67-2ac0-483b-b958-00384bf7a112\") " pod="openshift-dns/node-resolver-trttp" Jul 12 16:23:56.090547 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.090299 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a37e5364-776d-472f-a8c1-952def714dc8-iptables-alerter-script\") pod \"iptables-alerter-pfkrd\" (UID: \"a37e5364-776d-472f-a8c1-952def714dc8\") " pod="openshift-network-operator/iptables-alerter-pfkrd" Jul 12 16:23:56.090547 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.090314 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-systemd-units\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.090547 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.090332 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-etc-openvswitch\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.090547 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.090349 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-ovnkube-config\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.090547 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.090371 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-multus-socket-dir-parent\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.090547 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.090416 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b81da15-6b81-47e2-9162-e897fd167e11-multus-daemon-config\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.090547 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.090499 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-etc-openvswitch\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.091203 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.090622 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-multus-socket-dir-parent\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.091203 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.090838 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-hostroot\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.091203 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.090898 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a37e5364-776d-472f-a8c1-952def714dc8-host-slash\") pod \"iptables-alerter-pfkrd\" (UID: \"a37e5364-776d-472f-a8c1-952def714dc8\") " pod="openshift-network-operator/iptables-alerter-pfkrd" Jul 12 16:23:56.091203 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.090943 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-original-pull-secret\") pod \"global-pull-secret-syncer-8l4qq\" (UID: \"9ef6eef5-8bcb-409b-92c8-8be3c0632ec9\") " pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:23:56.091203 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.090971 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2698e055-6034-4dad-9f91-fa9dd870b375-serviceca\") pod \"node-ca-ng9tv\" (UID: \"2698e055-6034-4dad-9f91-fa9dd870b375\") " pod="openshift-image-registry/node-ca-ng9tv" Jul 12 16:23:56.091203 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091018 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccd1221a-8ea7-4bba-ba15-999ca853321e-metrics-certs\") pod \"network-metrics-daemon-vjfj4\" (UID: \"ccd1221a-8ea7-4bba-ba15-999ca853321e\") " pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:23:56.091203 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091047 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-run-openvswitch\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.091203 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091041 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-ovnkube-config\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.091203 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091077 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbq2q\" (UniqueName: \"kubernetes.io/projected/537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1-kube-api-access-nbq2q\") pod \"network-check-target-8d275\" (UID: \"537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1\") " pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:23:56.091203 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091140 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-etc-systemd\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.091203 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091172 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c3386231-0fc2-4b3b-89e5-6dc353769a9f-sys-fs\") pod \"aws-ebs-csi-driver-node-dw8hh\" (UID: \"c3386231-0fc2-4b3b-89e5-6dc353769a9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" Jul 12 16:23:56.091203 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091184 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-systemd-units\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.091774 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091211 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-log-socket\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.091774 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091281 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-etc-kubernetes\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.091774 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:56.091300 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 16:23:56.091774 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091328 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-system-cni-dir\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.091774 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091346 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-log-socket\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.091774 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091360 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-os-release\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.091774 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091382 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b81da15-6b81-47e2-9162-e897fd167e11-cni-binary-copy\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.091774 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091382 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-run-openvswitch\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.091774 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091423 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-host-var-lib-kubelet\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.091774 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091468 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-lib-modules\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.091774 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091494 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-host\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.091774 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091523 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-host-run-netns\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.091774 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091551 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c3386231-0fc2-4b3b-89e5-6dc353769a9f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dw8hh\" (UID: \"c3386231-0fc2-4b3b-89e5-6dc353769a9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" Jul 12 16:23:56.091774 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091583 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c3386231-0fc2-4b3b-89e5-6dc353769a9f-registration-dir\") pod \"aws-ebs-csi-driver-node-dw8hh\" (UID: \"c3386231-0fc2-4b3b-89e5-6dc353769a9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" Jul 12 16:23:56.091774 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091615 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-ovn-node-metrics-cert\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.091774 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091641 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-cnibin\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.091774 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091668 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-host-run-netns\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.091774 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091695 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-host-var-lib-cni-bin\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.092762 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091803 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hztg9\" (UID: \"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559\") " pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.092762 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091831 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-sys\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.092762 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091856 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e2f7f72-cd5d-428b-b450-96b920b5744e-etc-tuned\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.092762 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091874 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b81da15-6b81-47e2-9162-e897fd167e11-cni-binary-copy\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.092762 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091885 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-host-var-lib-cni-multus\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.092762 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091940 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-host-var-lib-cni-bin\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.092762 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091951 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-system-cni-dir\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.092762 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.091986 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-host-var-lib-cni-multus\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.092762 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092046 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-os-release\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.092762 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092068 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-etc-sysconfig\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.092762 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092086 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/08851e67-2ac0-483b-b958-00384bf7a112-hosts-file\") pod \"node-resolver-trttp\" (UID: \"08851e67-2ac0-483b-b958-00384bf7a112\") " pod="openshift-dns/node-resolver-trttp" Jul 12 16:23:56.092762 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092099 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b81da15-6b81-47e2-9162-e897fd167e11-multus-daemon-config\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.092762 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092130 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-host-run-k8s-cni-cncf-io\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.092762 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092151 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/56d25b5a-80b2-4960-94d2-f6aeab700e82-agent-certs\") pod \"konnectivity-agent-4hxjr\" (UID: \"56d25b5a-80b2-4960-94d2-f6aeab700e82\") " pod="kube-system/konnectivity-agent-4hxjr" Jul 12 16:23:56.092762 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092201 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-multus-cni-dir\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.092762 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092224 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-host-run-k8s-cni-cncf-io\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.092762 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092248 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-host-run-ovn-kubernetes\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.093621 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092297 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-node-log\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.093621 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092317 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-run-ovn\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.093621 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092337 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-node-log\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.093621 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092364 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-host-run-netns\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.093621 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092414 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-cnibin\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.093621 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092449 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-host-run-netns\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.093621 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:56.092323 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd1221a-8ea7-4bba-ba15-999ca853321e-metrics-certs podName:ccd1221a-8ea7-4bba-ba15-999ca853321e nodeName:}" failed. No retries permitted until 2026-07-12 16:23:56.592301069 +0000 UTC m=+3.045689059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccd1221a-8ea7-4bba-ba15-999ca853321e-metrics-certs") pod "network-metrics-daemon-vjfj4" (UID: "ccd1221a-8ea7-4bba-ba15-999ca853321e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 16:23:56.093621 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092501 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-host-cni-bin\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.093621 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092493 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-multus-cni-dir\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.093621 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092558 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-host-cni-netd\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.093621 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092561 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-host-var-lib-kubelet\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.093621 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092594 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-host-cni-bin\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.093621 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092654 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-env-overrides\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.093621 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092671 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-host-cni-netd\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.093621 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092682 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 12 16:23:56.093621 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092770 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-multus-conf-dir\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.093621 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092707 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b81da15-6b81-47e2-9162-e897fd167e11-multus-conf-dir\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.094574 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092828 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrq7b\" (UniqueName: \"kubernetes.io/projected/a37e5364-776d-472f-a8c1-952def714dc8-kube-api-access-hrq7b\") pod \"iptables-alerter-pfkrd\" (UID: \"a37e5364-776d-472f-a8c1-952def714dc8\") " pod="openshift-network-operator/iptables-alerter-pfkrd" Jul 12 16:23:56.094574 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092871 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktm27\" (UniqueName: \"kubernetes.io/projected/5e2f7f72-cd5d-428b-b450-96b920b5744e-kube-api-access-ktm27\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.094574 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.092938 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-ovnkube-script-lib\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.094574 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.093069 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-env-overrides\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.099420 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.099354 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-ovn-node-metrics-cert\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.102397 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:56.101451 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 16:23:56.102397 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:56.101483 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 16:23:56.102397 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:56.101528 2559 projected.go:196] Error preparing data for projected volume kube-api-access-nbq2q for pod openshift-network-diagnostics/network-check-target-8d275: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 16:23:56.102397 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:56.101614 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1-kube-api-access-nbq2q podName:537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1 nodeName:}" failed. No retries permitted until 2026-07-12 16:23:56.601593446 +0000 UTC m=+3.054981413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nbq2q" (UniqueName: "kubernetes.io/projected/537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1-kube-api-access-nbq2q") pod "network-check-target-8d275" (UID: "537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 16:23:56.103403 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.103227 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5q65\" (UniqueName: \"kubernetes.io/projected/8b81da15-6b81-47e2-9162-e897fd167e11-kube-api-access-l5q65\") pod \"multus-sdjjz\" (UID: \"8b81da15-6b81-47e2-9162-e897fd167e11\") " pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.105381 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.105125 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s26mg\" (UniqueName: \"kubernetes.io/projected/ccd1221a-8ea7-4bba-ba15-999ca853321e-kube-api-access-s26mg\") pod \"network-metrics-daemon-vjfj4\" (UID: \"ccd1221a-8ea7-4bba-ba15-999ca853321e\") " pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:23:56.108723 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.108691 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-245p6\" (UniqueName: \"kubernetes.io/projected/b89054d2-a85b-40ac-aa21-69eefa2ed9e8-kube-api-access-245p6\") pod \"ovnkube-node-vg4zm\" (UID: \"b89054d2-a85b-40ac-aa21-69eefa2ed9e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.110074 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.110052 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrq7b\" (UniqueName: \"kubernetes.io/projected/a37e5364-776d-472f-a8c1-952def714dc8-kube-api-access-hrq7b\") pod \"iptables-alerter-pfkrd\" (UID: \"a37e5364-776d-472f-a8c1-952def714dc8\") " pod="openshift-network-operator/iptables-alerter-pfkrd" Jul 12 16:23:56.193569 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.193525 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hztg9\" (UID: \"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559\") " pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.193569 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.193574 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-sys\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.193815 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.193600 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e2f7f72-cd5d-428b-b450-96b920b5744e-etc-tuned\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.193815 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.193625 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-etc-sysconfig\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.193815 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.193650 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/08851e67-2ac0-483b-b958-00384bf7a112-hosts-file\") pod \"node-resolver-trttp\" (UID: \"08851e67-2ac0-483b-b958-00384bf7a112\") " pod="openshift-dns/node-resolver-trttp" Jul 12 16:23:56.193815 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.193676 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/56d25b5a-80b2-4960-94d2-f6aeab700e82-agent-certs\") pod \"konnectivity-agent-4hxjr\" (UID: \"56d25b5a-80b2-4960-94d2-f6aeab700e82\") " pod="kube-system/konnectivity-agent-4hxjr" Jul 12 16:23:56.193815 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.193703 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktm27\" (UniqueName: \"kubernetes.io/projected/5e2f7f72-cd5d-428b-b450-96b920b5744e-kube-api-access-ktm27\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.193815 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.193726 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/56d25b5a-80b2-4960-94d2-f6aeab700e82-konnectivity-ca\") pod \"konnectivity-agent-4hxjr\" (UID: \"56d25b5a-80b2-4960-94d2-f6aeab700e82\") " pod="kube-system/konnectivity-agent-4hxjr" Jul 12 16:23:56.193815 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.193743 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-etc-kubernetes\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.193815 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.193759 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-run\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.193815 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.193774 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqvjj\" (UniqueName: \"kubernetes.io/projected/c3386231-0fc2-4b3b-89e5-6dc353769a9f-kube-api-access-hqvjj\") pod \"aws-ebs-csi-driver-node-dw8hh\" (UID: \"c3386231-0fc2-4b3b-89e5-6dc353769a9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" Jul 12 16:23:56.193815 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.193797 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2698e055-6034-4dad-9f91-fa9dd870b375-host\") pod \"node-ca-ng9tv\" (UID: \"2698e055-6034-4dad-9f91-fa9dd870b375\") " pod="openshift-image-registry/node-ca-ng9tv" Jul 12 16:23:56.194286 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.193822 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jslpz\" (UniqueName: \"kubernetes.io/projected/08851e67-2ac0-483b-b958-00384bf7a112-kube-api-access-jslpz\") pod \"node-resolver-trttp\" (UID: \"08851e67-2ac0-483b-b958-00384bf7a112\") " pod="openshift-dns/node-resolver-trttp" Jul 12 16:23:56.194286 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.193849 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-etc-sysctl-d\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.194286 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.193873 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-dbus\") pod \"global-pull-secret-syncer-8l4qq\" (UID: \"9ef6eef5-8bcb-409b-92c8-8be3c0632ec9\") " pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:23:56.194286 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.193896 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c3386231-0fc2-4b3b-89e5-6dc353769a9f-etc-selinux\") pod \"aws-ebs-csi-driver-node-dw8hh\" (UID: \"c3386231-0fc2-4b3b-89e5-6dc353769a9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" Jul 12 16:23:56.194286 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.193923 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559-system-cni-dir\") pod \"multus-additional-cni-plugins-hztg9\" (UID: \"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559\") " pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.194286 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.193947 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559-cnibin\") pod \"multus-additional-cni-plugins-hztg9\" (UID: \"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559\") " pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.194286 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.193971 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559-os-release\") pod \"multus-additional-cni-plugins-hztg9\" (UID: \"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559\") " pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.194286 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.193995 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-var-lib-kubelet\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.194286 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.194016 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e2f7f72-cd5d-428b-b450-96b920b5744e-tmp\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.194286 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.194044 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hztg9\" (UID: \"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559\") " pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.194286 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.194072 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-kubelet-config\") pod \"global-pull-secret-syncer-8l4qq\" (UID: \"9ef6eef5-8bcb-409b-92c8-8be3c0632ec9\") " pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:23:56.194286 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.194093 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c3386231-0fc2-4b3b-89e5-6dc353769a9f-socket-dir\") pod \"aws-ebs-csi-driver-node-dw8hh\" (UID: \"c3386231-0fc2-4b3b-89e5-6dc353769a9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" Jul 12 16:23:56.194286 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.194112 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559-cni-binary-copy\") pod \"multus-additional-cni-plugins-hztg9\" (UID: \"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559\") " pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.194286 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.194132 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hztg9\" (UID: \"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559\") " pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.194286 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.194177 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-etc-modprobe-d\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.194286 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.194203 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c3386231-0fc2-4b3b-89e5-6dc353769a9f-device-dir\") pod \"aws-ebs-csi-driver-node-dw8hh\" (UID: \"c3386231-0fc2-4b3b-89e5-6dc353769a9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" Jul 12 16:23:56.194286 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.194232 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzv82\" (UniqueName: \"kubernetes.io/projected/2698e055-6034-4dad-9f91-fa9dd870b375-kube-api-access-zzv82\") pod \"node-ca-ng9tv\" (UID: \"2698e055-6034-4dad-9f91-fa9dd870b375\") " pod="openshift-image-registry/node-ca-ng9tv" Jul 12 16:23:56.195107 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.194261 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8ttr\" (UniqueName: \"kubernetes.io/projected/cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559-kube-api-access-q8ttr\") pod \"multus-additional-cni-plugins-hztg9\" (UID: \"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559\") " pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.195107 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.194286 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-etc-sysctl-conf\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.195107 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.194311 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08851e67-2ac0-483b-b958-00384bf7a112-tmp-dir\") pod \"node-resolver-trttp\" (UID: \"08851e67-2ac0-483b-b958-00384bf7a112\") " pod="openshift-dns/node-resolver-trttp" Jul 12 16:23:56.195107 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.194355 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-original-pull-secret\") pod \"global-pull-secret-syncer-8l4qq\" (UID: \"9ef6eef5-8bcb-409b-92c8-8be3c0632ec9\") " pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:23:56.195107 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.194371 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2698e055-6034-4dad-9f91-fa9dd870b375-serviceca\") pod \"node-ca-ng9tv\" (UID: \"2698e055-6034-4dad-9f91-fa9dd870b375\") " pod="openshift-image-registry/node-ca-ng9tv" Jul 12 16:23:56.195107 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.194413 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-etc-systemd\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.195107 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.194430 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c3386231-0fc2-4b3b-89e5-6dc353769a9f-sys-fs\") pod \"aws-ebs-csi-driver-node-dw8hh\" (UID: \"c3386231-0fc2-4b3b-89e5-6dc353769a9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" Jul 12 16:23:56.195107 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.194450 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-lib-modules\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.195107 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.194464 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-host\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.195107 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.194486 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c3386231-0fc2-4b3b-89e5-6dc353769a9f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dw8hh\" (UID: \"c3386231-0fc2-4b3b-89e5-6dc353769a9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" Jul 12 16:23:56.195107 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.194507 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c3386231-0fc2-4b3b-89e5-6dc353769a9f-registration-dir\") pod \"aws-ebs-csi-driver-node-dw8hh\" (UID: \"c3386231-0fc2-4b3b-89e5-6dc353769a9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" Jul 12 16:23:56.195107 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.194605 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c3386231-0fc2-4b3b-89e5-6dc353769a9f-registration-dir\") pod \"aws-ebs-csi-driver-node-dw8hh\" (UID: \"c3386231-0fc2-4b3b-89e5-6dc353769a9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" Jul 12 16:23:56.195107 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.195085 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hztg9\" (UID: \"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559\") " pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.195776 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.195150 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-sys\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.195842 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.195793 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2698e055-6034-4dad-9f91-fa9dd870b375-host\") pod \"node-ca-ng9tv\" (UID: \"2698e055-6034-4dad-9f91-fa9dd870b375\") " pod="openshift-image-registry/node-ca-ng9tv" Jul 12 16:23:56.195890 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.195865 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-etc-sysconfig\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.195946 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.195918 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/08851e67-2ac0-483b-b958-00384bf7a112-hosts-file\") pod \"node-resolver-trttp\" (UID: \"08851e67-2ac0-483b-b958-00384bf7a112\") " pod="openshift-dns/node-resolver-trttp" Jul 12 16:23:56.197485 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.196383 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c3386231-0fc2-4b3b-89e5-6dc353769a9f-etc-selinux\") pod \"aws-ebs-csi-driver-node-dw8hh\" (UID: \"c3386231-0fc2-4b3b-89e5-6dc353769a9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" Jul 12 16:23:56.197485 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.196448 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559-system-cni-dir\") pod \"multus-additional-cni-plugins-hztg9\" (UID: \"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559\") " pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.197485 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.196535 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559-cnibin\") pod \"multus-additional-cni-plugins-hztg9\" (UID: \"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559\") " pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.197485 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.196617 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559-os-release\") pod \"multus-additional-cni-plugins-hztg9\" (UID: \"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559\") " pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.197485 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.196672 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-var-lib-kubelet\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.197485 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.196725 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-etc-kubernetes\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.197485 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.196744 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-etc-sysctl-d\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.197485 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.196820 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-dbus\") pod \"global-pull-secret-syncer-8l4qq\" (UID: \"9ef6eef5-8bcb-409b-92c8-8be3c0632ec9\") " pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:23:56.197485 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.196869 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-run\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.197485 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.197251 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hztg9\" (UID: \"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559\") " pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.197485 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.197317 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-kubelet-config\") pod \"global-pull-secret-syncer-8l4qq\" (UID: \"9ef6eef5-8bcb-409b-92c8-8be3c0632ec9\") " pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:23:56.197485 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.197413 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c3386231-0fc2-4b3b-89e5-6dc353769a9f-socket-dir\") pod \"aws-ebs-csi-driver-node-dw8hh\" (UID: \"c3386231-0fc2-4b3b-89e5-6dc353769a9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" Jul 12 16:23:56.198276 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.197884 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559-cni-binary-copy\") pod \"multus-additional-cni-plugins-hztg9\" (UID: \"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559\") " pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.198363 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.198334 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hztg9\" (UID: \"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559\") " pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.198512 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.198386 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/56d25b5a-80b2-4960-94d2-f6aeab700e82-konnectivity-ca\") pod \"konnectivity-agent-4hxjr\" (UID: \"56d25b5a-80b2-4960-94d2-f6aeab700e82\") " pod="kube-system/konnectivity-agent-4hxjr" Jul 12 16:23:56.198512 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.198453 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-etc-modprobe-d\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.198512 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.198463 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-etc-systemd\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.198512 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.198505 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c3386231-0fc2-4b3b-89e5-6dc353769a9f-device-dir\") pod \"aws-ebs-csi-driver-node-dw8hh\" (UID: \"c3386231-0fc2-4b3b-89e5-6dc353769a9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" Jul 12 16:23:56.198725 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.198538 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-lib-modules\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.198725 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.198598 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c3386231-0fc2-4b3b-89e5-6dc353769a9f-sys-fs\") pod \"aws-ebs-csi-driver-node-dw8hh\" (UID: \"c3386231-0fc2-4b3b-89e5-6dc353769a9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" Jul 12 16:23:56.198725 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.198632 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-etc-sysctl-conf\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.198869 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.198804 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e2f7f72-cd5d-428b-b450-96b920b5744e-host\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.198934 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.198866 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c3386231-0fc2-4b3b-89e5-6dc353769a9f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dw8hh\" (UID: \"c3386231-0fc2-4b3b-89e5-6dc353769a9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" Jul 12 16:23:56.198934 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:56.198884 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 16:23:56.199034 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:56.198943 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-original-pull-secret podName:9ef6eef5-8bcb-409b-92c8-8be3c0632ec9 nodeName:}" failed. No retries permitted until 2026-07-12 16:23:56.698924845 +0000 UTC m=+3.152312813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-original-pull-secret") pod "global-pull-secret-syncer-8l4qq" (UID: "9ef6eef5-8bcb-409b-92c8-8be3c0632ec9") : object "kube-system"/"original-pull-secret" not registered Jul 12 16:23:56.199034 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.198955 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08851e67-2ac0-483b-b958-00384bf7a112-tmp-dir\") pod \"node-resolver-trttp\" (UID: \"08851e67-2ac0-483b-b958-00384bf7a112\") " pod="openshift-dns/node-resolver-trttp" Jul 12 16:23:56.199342 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.199321 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2698e055-6034-4dad-9f91-fa9dd870b375-serviceca\") pod \"node-ca-ng9tv\" (UID: \"2698e055-6034-4dad-9f91-fa9dd870b375\") " pod="openshift-image-registry/node-ca-ng9tv" Jul 12 16:23:56.202671 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.202596 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e2f7f72-cd5d-428b-b450-96b920b5744e-tmp\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.203029 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.203007 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e2f7f72-cd5d-428b-b450-96b920b5744e-etc-tuned\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.205077 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.205050 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/56d25b5a-80b2-4960-94d2-f6aeab700e82-agent-certs\") pod \"konnectivity-agent-4hxjr\" (UID: \"56d25b5a-80b2-4960-94d2-f6aeab700e82\") " pod="kube-system/konnectivity-agent-4hxjr" Jul 12 16:23:56.207531 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.207510 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jslpz\" (UniqueName: \"kubernetes.io/projected/08851e67-2ac0-483b-b958-00384bf7a112-kube-api-access-jslpz\") pod \"node-resolver-trttp\" (UID: \"08851e67-2ac0-483b-b958-00384bf7a112\") " pod="openshift-dns/node-resolver-trttp" Jul 12 16:23:56.207894 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.207875 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8ttr\" (UniqueName: \"kubernetes.io/projected/cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559-kube-api-access-q8ttr\") pod \"multus-additional-cni-plugins-hztg9\" (UID: \"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559\") " pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.208749 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.208716 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqvjj\" (UniqueName: \"kubernetes.io/projected/c3386231-0fc2-4b3b-89e5-6dc353769a9f-kube-api-access-hqvjj\") pod \"aws-ebs-csi-driver-node-dw8hh\" (UID: \"c3386231-0fc2-4b3b-89e5-6dc353769a9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" Jul 12 16:23:56.209882 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.209858 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktm27\" (UniqueName: \"kubernetes.io/projected/5e2f7f72-cd5d-428b-b450-96b920b5744e-kube-api-access-ktm27\") pod \"tuned-nf8zc\" (UID: \"5e2f7f72-cd5d-428b-b450-96b920b5744e\") " pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.210717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.210683 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzv82\" (UniqueName: \"kubernetes.io/projected/2698e055-6034-4dad-9f91-fa9dd870b375-kube-api-access-zzv82\") pod \"node-ca-ng9tv\" (UID: \"2698e055-6034-4dad-9f91-fa9dd870b375\") " pod="openshift-image-registry/node-ca-ng9tv" Jul 12 16:23:56.291201 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.291151 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:23:56.305491 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.305455 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sdjjz" Jul 12 16:23:56.315070 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.315040 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pfkrd" Jul 12 16:23:56.315614 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:56.315584 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b81da15_6b81_47e2_9162_e897fd167e11.slice/crio-9f1f6a15f8566176b30cd73f92debca1e3e6dc5c09cf909ecb7a221c1dbba893 WatchSource:0}: Error finding container 9f1f6a15f8566176b30cd73f92debca1e3e6dc5c09cf909ecb7a221c1dbba893: Status 404 returned error can't find the container with id 9f1f6a15f8566176b30cd73f92debca1e3e6dc5c09cf909ecb7a221c1dbba893 Jul 12 16:23:56.322621 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.322595 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ng9tv" Jul 12 16:23:56.326540 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:56.326449 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda37e5364_776d_472f_a8c1_952def714dc8.slice/crio-2832b253549983a26b36b117cf9ab6b7c4979145a3e07a5768efeba392263eef WatchSource:0}: Error finding container 2832b253549983a26b36b117cf9ab6b7c4979145a3e07a5768efeba392263eef: Status 404 returned error can't find the container with id 2832b253549983a26b36b117cf9ab6b7c4979145a3e07a5768efeba392263eef Jul 12 16:23:56.331874 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.331850 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4hxjr" Jul 12 16:23:56.333879 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:56.333854 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2698e055_6034_4dad_9f91_fa9dd870b375.slice/crio-858a62b46da3500423896db6913e2c5c5ed2b4da2b562b217b3e49b0b68a4185 WatchSource:0}: Error finding container 858a62b46da3500423896db6913e2c5c5ed2b4da2b562b217b3e49b0b68a4185: Status 404 returned error can't find the container with id 858a62b46da3500423896db6913e2c5c5ed2b4da2b562b217b3e49b0b68a4185 Jul 12 16:23:56.339954 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.339927 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" Jul 12 16:23:56.348909 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:56.348883 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e2f7f72_cd5d_428b_b450_96b920b5744e.slice/crio-4b5d263c94bdf3c7e368ec865815b8171c7a22e12c307fe4d99f8387b3404c3a WatchSource:0}: Error finding container 4b5d263c94bdf3c7e368ec865815b8171c7a22e12c307fe4d99f8387b3404c3a: Status 404 returned error can't find the container with id 4b5d263c94bdf3c7e368ec865815b8171c7a22e12c307fe4d99f8387b3404c3a Jul 12 16:23:56.349829 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.349795 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-trttp" Jul 12 16:23:56.358913 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.358892 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hztg9" Jul 12 16:23:56.360119 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:56.360092 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08851e67_2ac0_483b_b958_00384bf7a112.slice/crio-0eb95c6418dbe16e5931193ceb64b2e42067f6cda4988c32ab25e5a833fb9745 WatchSource:0}: Error finding container 0eb95c6418dbe16e5931193ceb64b2e42067f6cda4988c32ab25e5a833fb9745: Status 404 returned error can't find the container with id 0eb95c6418dbe16e5931193ceb64b2e42067f6cda4988c32ab25e5a833fb9745 Jul 12 16:23:56.370868 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:56.370844 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc9e1aea_ae32_4e4c_801e_dc0ce2c6d559.slice/crio-404776a0b7493af7c38a57358d2569dbf0886a9dc69cfe0b5b0554cc0c8e22f9 WatchSource:0}: Error finding container 404776a0b7493af7c38a57358d2569dbf0886a9dc69cfe0b5b0554cc0c8e22f9: Status 404 returned error can't find the container with id 404776a0b7493af7c38a57358d2569dbf0886a9dc69cfe0b5b0554cc0c8e22f9 Jul 12 16:23:56.374221 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.374192 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" Jul 12 16:23:56.384124 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:23:56.384101 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3386231_0fc2_4b3b_89e5_6dc353769a9f.slice/crio-235f26ee2dab9d30baad8ced1271a5a81031e5cbd13c2cca7d5954426fbaf81f WatchSource:0}: Error finding container 235f26ee2dab9d30baad8ced1271a5a81031e5cbd13c2cca7d5954426fbaf81f: Status 404 returned error can't find the container with id 235f26ee2dab9d30baad8ced1271a5a81031e5cbd13c2cca7d5954426fbaf81f Jul 12 16:23:56.598111 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.598009 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccd1221a-8ea7-4bba-ba15-999ca853321e-metrics-certs\") pod \"network-metrics-daemon-vjfj4\" (UID: \"ccd1221a-8ea7-4bba-ba15-999ca853321e\") " pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:23:56.598261 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:56.598166 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 16:23:56.598261 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:56.598244 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd1221a-8ea7-4bba-ba15-999ca853321e-metrics-certs podName:ccd1221a-8ea7-4bba-ba15-999ca853321e nodeName:}" failed. No retries permitted until 2026-07-12 16:23:57.598217795 +0000 UTC m=+4.051605761 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccd1221a-8ea7-4bba-ba15-999ca853321e-metrics-certs") pod "network-metrics-daemon-vjfj4" (UID: "ccd1221a-8ea7-4bba-ba15-999ca853321e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 16:23:56.699294 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.699258 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-original-pull-secret\") pod \"global-pull-secret-syncer-8l4qq\" (UID: \"9ef6eef5-8bcb-409b-92c8-8be3c0632ec9\") " pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:23:56.699476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:56.699309 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbq2q\" (UniqueName: \"kubernetes.io/projected/537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1-kube-api-access-nbq2q\") pod \"network-check-target-8d275\" (UID: \"537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1\") " pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:23:56.699476 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:56.699436 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 16:23:56.699476 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:56.699435 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 16:23:56.699476 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:56.699456 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 16:23:56.699476 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:56.699471 2559 projected.go:196] Error preparing data for projected volume kube-api-access-nbq2q for pod openshift-network-diagnostics/network-check-target-8d275: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 16:23:56.699687 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:56.699539 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-original-pull-secret podName:9ef6eef5-8bcb-409b-92c8-8be3c0632ec9 nodeName:}" failed. No retries permitted until 2026-07-12 16:23:57.699504593 +0000 UTC m=+4.152892564 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-original-pull-secret") pod "global-pull-secret-syncer-8l4qq" (UID: "9ef6eef5-8bcb-409b-92c8-8be3c0632ec9") : object "kube-system"/"original-pull-secret" not registered Jul 12 16:23:56.699687 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:56.699563 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1-kube-api-access-nbq2q podName:537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1 nodeName:}" failed. No retries permitted until 2026-07-12 16:23:57.699551965 +0000 UTC m=+4.152939935 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nbq2q" (UniqueName: "kubernetes.io/projected/537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1-kube-api-access-nbq2q") pod "network-check-target-8d275" (UID: "537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 16:23:57.049965 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:57.049855 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 16:18:56 +0000 UTC" deadline="2028-04-04 01:03:36.331304794 +0000 UTC" Jul 12 16:23:57.049965 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:57.049903 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15152h39m39.281406783s" Jul 12 16:23:57.084210 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:57.074565 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hztg9" event={"ID":"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559","Type":"ContainerStarted","Data":"404776a0b7493af7c38a57358d2569dbf0886a9dc69cfe0b5b0554cc0c8e22f9"} Jul 12 16:23:57.084210 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:57.080681 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-trttp" event={"ID":"08851e67-2ac0-483b-b958-00384bf7a112","Type":"ContainerStarted","Data":"0eb95c6418dbe16e5931193ceb64b2e42067f6cda4988c32ab25e5a833fb9745"} Jul 12 16:23:57.101894 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:57.101792 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" event={"ID":"5e2f7f72-cd5d-428b-b450-96b920b5744e","Type":"ContainerStarted","Data":"4b5d263c94bdf3c7e368ec865815b8171c7a22e12c307fe4d99f8387b3404c3a"} Jul 12 16:23:57.107458 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:57.107354 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4hxjr" event={"ID":"56d25b5a-80b2-4960-94d2-f6aeab700e82","Type":"ContainerStarted","Data":"8383f0fcc2d5255c6b56276c3e433b0ede1a530b19749e2e4de6e45556a46e0d"} Jul 12 16:23:57.110429 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:57.110349 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ng9tv" event={"ID":"2698e055-6034-4dad-9f91-fa9dd870b375","Type":"ContainerStarted","Data":"858a62b46da3500423896db6913e2c5c5ed2b4da2b562b217b3e49b0b68a4185"} Jul 12 16:23:57.114305 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:57.114278 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sdjjz" event={"ID":"8b81da15-6b81-47e2-9162-e897fd167e11","Type":"ContainerStarted","Data":"9f1f6a15f8566176b30cd73f92debca1e3e6dc5c09cf909ecb7a221c1dbba893"} Jul 12 16:23:57.116534 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:57.116506 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" event={"ID":"c3386231-0fc2-4b3b-89e5-6dc353769a9f","Type":"ContainerStarted","Data":"235f26ee2dab9d30baad8ced1271a5a81031e5cbd13c2cca7d5954426fbaf81f"} Jul 12 16:23:57.118224 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:57.118142 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pfkrd" event={"ID":"a37e5364-776d-472f-a8c1-952def714dc8","Type":"ContainerStarted","Data":"2832b253549983a26b36b117cf9ab6b7c4979145a3e07a5768efeba392263eef"} Jul 12 16:23:57.120422 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:57.120323 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" event={"ID":"b89054d2-a85b-40ac-aa21-69eefa2ed9e8","Type":"ContainerStarted","Data":"aa6cfbbd25adadef9837b35ca273b9a72d6e34df32ccb99746864f7544ec4cbb"} Jul 12 16:23:57.608280 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:57.607581 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccd1221a-8ea7-4bba-ba15-999ca853321e-metrics-certs\") pod \"network-metrics-daemon-vjfj4\" (UID: \"ccd1221a-8ea7-4bba-ba15-999ca853321e\") " pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:23:57.608280 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:57.607776 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 16:23:57.608280 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:57.607849 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd1221a-8ea7-4bba-ba15-999ca853321e-metrics-certs podName:ccd1221a-8ea7-4bba-ba15-999ca853321e nodeName:}" failed. No retries permitted until 2026-07-12 16:23:59.607826727 +0000 UTC m=+6.061214699 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccd1221a-8ea7-4bba-ba15-999ca853321e-metrics-certs") pod "network-metrics-daemon-vjfj4" (UID: "ccd1221a-8ea7-4bba-ba15-999ca853321e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 16:23:57.653273 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:57.653006 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 16:23:57.709840 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:57.708918 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-original-pull-secret\") pod \"global-pull-secret-syncer-8l4qq\" (UID: \"9ef6eef5-8bcb-409b-92c8-8be3c0632ec9\") " pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:23:57.709840 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:57.708995 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbq2q\" (UniqueName: \"kubernetes.io/projected/537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1-kube-api-access-nbq2q\") pod \"network-check-target-8d275\" (UID: \"537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1\") " pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:23:57.709840 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:57.709204 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 16:23:57.709840 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:57.709225 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 16:23:57.709840 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:57.709239 2559 projected.go:196] Error preparing data for projected volume kube-api-access-nbq2q for pod openshift-network-diagnostics/network-check-target-8d275: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 16:23:57.709840 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:57.709301 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1-kube-api-access-nbq2q podName:537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1 nodeName:}" failed. No retries permitted until 2026-07-12 16:23:59.709281932 +0000 UTC m=+6.162669904 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nbq2q" (UniqueName: "kubernetes.io/projected/537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1-kube-api-access-nbq2q") pod "network-check-target-8d275" (UID: "537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 16:23:57.709840 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:57.709743 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 16:23:57.709840 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:57.709797 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-original-pull-secret podName:9ef6eef5-8bcb-409b-92c8-8be3c0632ec9 nodeName:}" failed. No retries permitted until 2026-07-12 16:23:59.709781285 +0000 UTC m=+6.163169255 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-original-pull-secret") pod "global-pull-secret-syncer-8l4qq" (UID: "9ef6eef5-8bcb-409b-92c8-8be3c0632ec9") : object "kube-system"/"original-pull-secret" not registered Jul 12 16:23:58.051179 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:58.051107 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 16:18:56 +0000 UTC" deadline="2028-03-27 01:04:57.014276698 +0000 UTC" Jul 12 16:23:58.051179 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:58.051176 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14960h40m58.963105348s" Jul 12 16:23:58.055320 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:58.055295 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:23:58.055503 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:58.055473 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjfj4" podUID="ccd1221a-8ea7-4bba-ba15-999ca853321e" Jul 12 16:23:58.056474 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:58.056110 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:23:58.056474 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:58.056232 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8d275" podUID="537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1" Jul 12 16:23:58.056474 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:58.056316 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:23:58.056474 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:58.056397 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l4qq" podUID="9ef6eef5-8bcb-409b-92c8-8be3c0632ec9" Jul 12 16:23:59.626754 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:59.626396 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccd1221a-8ea7-4bba-ba15-999ca853321e-metrics-certs\") pod \"network-metrics-daemon-vjfj4\" (UID: \"ccd1221a-8ea7-4bba-ba15-999ca853321e\") " pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:23:59.627252 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:59.626556 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 16:23:59.627252 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:59.626904 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd1221a-8ea7-4bba-ba15-999ca853321e-metrics-certs podName:ccd1221a-8ea7-4bba-ba15-999ca853321e nodeName:}" failed. No retries permitted until 2026-07-12 16:24:03.626881844 +0000 UTC m=+10.080269812 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccd1221a-8ea7-4bba-ba15-999ca853321e-metrics-certs") pod "network-metrics-daemon-vjfj4" (UID: "ccd1221a-8ea7-4bba-ba15-999ca853321e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 16:23:59.727635 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:59.727556 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-original-pull-secret\") pod \"global-pull-secret-syncer-8l4qq\" (UID: \"9ef6eef5-8bcb-409b-92c8-8be3c0632ec9\") " pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:23:59.727635 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:23:59.727623 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbq2q\" (UniqueName: \"kubernetes.io/projected/537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1-kube-api-access-nbq2q\") pod \"network-check-target-8d275\" (UID: \"537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1\") " pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:23:59.727892 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:59.727806 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 16:23:59.727892 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:59.727825 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 16:23:59.727892 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:59.727838 2559 projected.go:196] Error preparing data for projected volume kube-api-access-nbq2q for pod openshift-network-diagnostics/network-check-target-8d275: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 16:23:59.728055 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:59.727896 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1-kube-api-access-nbq2q podName:537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1 nodeName:}" failed. No retries permitted until 2026-07-12 16:24:03.727877276 +0000 UTC m=+10.181265245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nbq2q" (UniqueName: "kubernetes.io/projected/537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1-kube-api-access-nbq2q") pod "network-check-target-8d275" (UID: "537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 16:23:59.728337 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:59.728315 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 16:23:59.728435 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:23:59.728404 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-original-pull-secret podName:9ef6eef5-8bcb-409b-92c8-8be3c0632ec9 nodeName:}" failed. No retries permitted until 2026-07-12 16:24:03.728386622 +0000 UTC m=+10.181774594 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-original-pull-secret") pod "global-pull-secret-syncer-8l4qq" (UID: "9ef6eef5-8bcb-409b-92c8-8be3c0632ec9") : object "kube-system"/"original-pull-secret" not registered Jul 12 16:24:00.055566 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:00.055533 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:24:00.055730 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:00.055543 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:24:00.055730 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:00.055670 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8d275" podUID="537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1" Jul 12 16:24:00.055730 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:00.055692 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:24:00.055903 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:00.055766 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l4qq" podUID="9ef6eef5-8bcb-409b-92c8-8be3c0632ec9" Jul 12 16:24:00.055903 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:00.055823 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjfj4" podUID="ccd1221a-8ea7-4bba-ba15-999ca853321e" Jul 12 16:24:00.133870 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:00.133821 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-204.ec2.internal" event={"ID":"790d0909109a1922f8e1cf8bf63c1a22","Type":"ContainerStarted","Data":"561d124cdaaa069346bd68cf1189a86f62dfa389191d701e99c3b27daa55d73b"} Jul 12 16:24:02.054241 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:02.054201 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:24:02.054746 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:02.054356 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8d275" podUID="537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1" Jul 12 16:24:02.054846 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:02.054818 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:24:02.054951 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:02.054925 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l4qq" podUID="9ef6eef5-8bcb-409b-92c8-8be3c0632ec9" Jul 12 16:24:02.055017 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:02.054994 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:24:02.055127 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:02.055107 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjfj4" podUID="ccd1221a-8ea7-4bba-ba15-999ca853321e" Jul 12 16:24:03.143465 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:03.143425 2559 generic.go:356] "Generic (PLEG): container finished" podID="790d0909109a1922f8e1cf8bf63c1a22" containerID="561d124cdaaa069346bd68cf1189a86f62dfa389191d701e99c3b27daa55d73b" exitCode=0 Jul 12 16:24:03.143852 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:03.143489 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-204.ec2.internal" event={"ID":"790d0909109a1922f8e1cf8bf63c1a22","Type":"ContainerDied","Data":"561d124cdaaa069346bd68cf1189a86f62dfa389191d701e99c3b27daa55d73b"} Jul 12 16:24:03.665785 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:03.665747 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccd1221a-8ea7-4bba-ba15-999ca853321e-metrics-certs\") pod \"network-metrics-daemon-vjfj4\" (UID: \"ccd1221a-8ea7-4bba-ba15-999ca853321e\") " pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:24:03.665974 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:03.665877 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 16:24:03.665974 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:03.665941 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd1221a-8ea7-4bba-ba15-999ca853321e-metrics-certs podName:ccd1221a-8ea7-4bba-ba15-999ca853321e nodeName:}" failed. No retries permitted until 2026-07-12 16:24:11.665923067 +0000 UTC m=+18.119311032 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccd1221a-8ea7-4bba-ba15-999ca853321e-metrics-certs") pod "network-metrics-daemon-vjfj4" (UID: "ccd1221a-8ea7-4bba-ba15-999ca853321e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 16:24:03.767010 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:03.766972 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-original-pull-secret\") pod \"global-pull-secret-syncer-8l4qq\" (UID: \"9ef6eef5-8bcb-409b-92c8-8be3c0632ec9\") " pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:24:03.767207 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:03.767036 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbq2q\" (UniqueName: \"kubernetes.io/projected/537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1-kube-api-access-nbq2q\") pod \"network-check-target-8d275\" (UID: \"537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1\") " pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:24:03.767207 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:03.767151 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 16:24:03.767207 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:03.767186 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 16:24:03.767207 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:03.767205 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 16:24:03.767351 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:03.767212 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-original-pull-secret podName:9ef6eef5-8bcb-409b-92c8-8be3c0632ec9 nodeName:}" failed. No retries permitted until 2026-07-12 16:24:11.767191991 +0000 UTC m=+18.220579955 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-original-pull-secret") pod "global-pull-secret-syncer-8l4qq" (UID: "9ef6eef5-8bcb-409b-92c8-8be3c0632ec9") : object "kube-system"/"original-pull-secret" not registered Jul 12 16:24:03.767351 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:03.767214 2559 projected.go:196] Error preparing data for projected volume kube-api-access-nbq2q for pod openshift-network-diagnostics/network-check-target-8d275: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 16:24:03.767351 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:03.767258 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1-kube-api-access-nbq2q podName:537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1 nodeName:}" failed. No retries permitted until 2026-07-12 16:24:11.76724662 +0000 UTC m=+18.220634588 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nbq2q" (UniqueName: "kubernetes.io/projected/537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1-kube-api-access-nbq2q") pod "network-check-target-8d275" (UID: "537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 16:24:04.058766 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:04.058698 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:24:04.058905 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:04.058786 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8d275" podUID="537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1" Jul 12 16:24:04.059100 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:04.059072 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:24:04.059313 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:04.059290 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l4qq" podUID="9ef6eef5-8bcb-409b-92c8-8be3c0632ec9" Jul 12 16:24:04.059416 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:04.059365 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:24:04.059666 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:04.059646 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjfj4" podUID="ccd1221a-8ea7-4bba-ba15-999ca853321e" Jul 12 16:24:06.055004 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:06.054483 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:24:06.055004 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:06.054528 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:24:06.055004 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:06.054495 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:24:06.055004 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:06.054645 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjfj4" podUID="ccd1221a-8ea7-4bba-ba15-999ca853321e" Jul 12 16:24:06.055004 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:06.054763 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8d275" podUID="537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1" Jul 12 16:24:06.055004 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:06.054858 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l4qq" podUID="9ef6eef5-8bcb-409b-92c8-8be3c0632ec9" Jul 12 16:24:08.056971 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:08.056940 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:24:08.057489 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:08.057000 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:24:08.057489 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:08.057010 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:24:08.057489 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:08.057083 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjfj4" podUID="ccd1221a-8ea7-4bba-ba15-999ca853321e" Jul 12 16:24:08.057489 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:08.057193 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8d275" podUID="537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1" Jul 12 16:24:08.057489 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:08.057263 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l4qq" podUID="9ef6eef5-8bcb-409b-92c8-8be3c0632ec9" Jul 12 16:24:08.154424 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:08.154394 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-204.ec2.internal" event={"ID":"ec6b92b0a7a5ab3f89d1c8e01ecdb934","Type":"ContainerStarted","Data":"3addcaf9b7abdaea8295b436ea04dad00eda8190d67721293a86174c99fe2fd4"} Jul 12 16:24:08.156631 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:08.156605 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-204.ec2.internal" event={"ID":"790d0909109a1922f8e1cf8bf63c1a22","Type":"ContainerStarted","Data":"9f0fcbd222e37d1288d7beffe899bb4a98869250db8cb309a0c7145440e9d33f"} Jul 12 16:24:08.158270 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:08.158238 2559 generic.go:356] "Generic (PLEG): container finished" podID="cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559" containerID="c5a31b9b25932275db6cd26cfdae97e615ea2705cdf3b97cbf173d491657487c" exitCode=0 Jul 12 16:24:08.158361 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:08.158284 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hztg9" event={"ID":"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559","Type":"ContainerDied","Data":"c5a31b9b25932275db6cd26cfdae97e615ea2705cdf3b97cbf173d491657487c"} Jul 12 16:24:08.163745 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:08.163715 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-trttp" event={"ID":"08851e67-2ac0-483b-b958-00384bf7a112","Type":"ContainerStarted","Data":"5958037256c362275bea7d950f928155ed45cfe4bf301da2d67a0adb52d8f1b2"} Jul 12 16:24:08.165587 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:08.165561 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" event={"ID":"5e2f7f72-cd5d-428b-b450-96b920b5744e","Type":"ContainerStarted","Data":"1b6d10ddc5ff8c358af6a38bb3b11642493416c1a6aff8e72b7c736cbdd65442"} Jul 12 16:24:08.167217 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:08.167189 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4hxjr" event={"ID":"56d25b5a-80b2-4960-94d2-f6aeab700e82","Type":"ContainerStarted","Data":"aec4f276ceb626749f3a9ff27f50a071dcb70fa9d7796887412140f8f6e62f03"} Jul 12 16:24:08.168602 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:08.168526 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-204.ec2.internal" podStartSLOduration=13.168508322 podStartE2EDuration="13.168508322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:23:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:24:08.167912141 +0000 UTC m=+14.621300129" watchObservedRunningTime="2026-07-12 16:24:08.168508322 +0000 UTC m=+14.621896310" Jul 12 16:24:08.168739 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:08.168720 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ng9tv" event={"ID":"2698e055-6034-4dad-9f91-fa9dd870b375","Type":"ContainerStarted","Data":"e9f42d1e0f8d545aebcbc3b6230fe74af58bb13f801d004258755e18f5852fbc"} Jul 12 16:24:08.170611 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:08.170589 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" event={"ID":"c3386231-0fc2-4b3b-89e5-6dc353769a9f","Type":"ContainerStarted","Data":"6dce1ce96a210c36327171d608b610adc67968c6decd2d88c79658a825615370"} Jul 12 16:24:08.201644 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:08.201596 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nf8zc" podStartSLOduration=1.814776861 podStartE2EDuration="13.201579969s" totalImagesPullingTime="11.386803108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:24:08.201024423 +0000 UTC m=+14.654412409" watchObservedRunningTime="2026-07-12 16:24:08.201579969 +0000 UTC m=+14.654967975" Jul 12 16:24:08.215351 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:08.215307 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-204.ec2.internal" podStartSLOduration=13.215293131 podStartE2EDuration="13.215293131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:23:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:24:08.215160454 +0000 UTC m=+14.668548440" watchObservedRunningTime="2026-07-12 16:24:08.215293131 +0000 UTC m=+14.668681117" Jul 12 16:24:08.235222 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:08.235167 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4hxjr" podStartSLOduration=1.922450261 podStartE2EDuration="13.235147521s" totalImagesPullingTime="11.31269726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:24:08.235125988 +0000 UTC m=+14.688513975" watchObservedRunningTime="2026-07-12 16:24:08.235147521 +0000 UTC m=+14.688535510" Jul 12 16:24:08.254244 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:08.254186 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-trttp" podStartSLOduration=1.9446046799999999 podStartE2EDuration="13.254167479s" totalImagesPullingTime="11.309562799s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:24:08.25413585 +0000 UTC m=+14.707523837" watchObservedRunningTime="2026-07-12 16:24:08.254167479 +0000 UTC m=+14.707555466" Jul 12 16:24:08.271168 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:08.271125 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ng9tv" podStartSLOduration=2.9421219990000003 podStartE2EDuration="14.2711051s" totalImagesPullingTime="11.328983101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:24:08.270782338 +0000 UTC m=+14.724170339" watchObservedRunningTime="2026-07-12 16:24:08.2711051 +0000 UTC m=+14.724493086" Jul 12 16:24:10.054026 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:10.053822 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:24:10.054479 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:10.053822 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:24:10.054479 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:10.053822 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:24:10.054479 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:10.054159 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l4qq" podUID="9ef6eef5-8bcb-409b-92c8-8be3c0632ec9" Jul 12 16:24:10.054479 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:10.054200 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8d275" podUID="537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1" Jul 12 16:24:10.054479 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:10.054230 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjfj4" podUID="ccd1221a-8ea7-4bba-ba15-999ca853321e" Jul 12 16:24:10.176103 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:10.176049 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pfkrd" event={"ID":"a37e5364-776d-472f-a8c1-952def714dc8","Type":"ContainerStarted","Data":"5b35b64802cd54d6876e876350cea1c0b8871064ccc9a238c00d5d8703852e89"} Jul 12 16:24:10.190196 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:10.190146 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pfkrd" podStartSLOduration=4.8628258859999995 podStartE2EDuration="16.190128242s" totalImagesPullingTime="11.327302356s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:24:10.189682587 +0000 UTC m=+16.643070574" watchObservedRunningTime="2026-07-12 16:24:10.190128242 +0000 UTC m=+16.643516226" Jul 12 16:24:11.723151 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:11.723108 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccd1221a-8ea7-4bba-ba15-999ca853321e-metrics-certs\") pod \"network-metrics-daemon-vjfj4\" (UID: \"ccd1221a-8ea7-4bba-ba15-999ca853321e\") " pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:24:11.723719 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:11.723275 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 16:24:11.723719 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:11.723358 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd1221a-8ea7-4bba-ba15-999ca853321e-metrics-certs podName:ccd1221a-8ea7-4bba-ba15-999ca853321e nodeName:}" failed. No retries permitted until 2026-07-12 16:24:27.723337714 +0000 UTC m=+34.176725678 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccd1221a-8ea7-4bba-ba15-999ca853321e-metrics-certs") pod "network-metrics-daemon-vjfj4" (UID: "ccd1221a-8ea7-4bba-ba15-999ca853321e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 16:24:11.824312 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:11.824272 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-original-pull-secret\") pod \"global-pull-secret-syncer-8l4qq\" (UID: \"9ef6eef5-8bcb-409b-92c8-8be3c0632ec9\") " pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:24:11.824312 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:11.824319 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbq2q\" (UniqueName: \"kubernetes.io/projected/537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1-kube-api-access-nbq2q\") pod \"network-check-target-8d275\" (UID: \"537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1\") " pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:24:11.824523 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:11.824428 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 16:24:11.824523 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:11.824502 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-original-pull-secret podName:9ef6eef5-8bcb-409b-92c8-8be3c0632ec9 nodeName:}" failed. No retries permitted until 2026-07-12 16:24:27.824482046 +0000 UTC m=+34.277870035 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-original-pull-secret") pod "global-pull-secret-syncer-8l4qq" (UID: "9ef6eef5-8bcb-409b-92c8-8be3c0632ec9") : object "kube-system"/"original-pull-secret" not registered Jul 12 16:24:11.824523 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:11.824434 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 16:24:11.824707 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:11.824529 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 16:24:11.824707 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:11.824538 2559 projected.go:196] Error preparing data for projected volume kube-api-access-nbq2q for pod openshift-network-diagnostics/network-check-target-8d275: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 16:24:11.824707 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:11.824586 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1-kube-api-access-nbq2q podName:537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1 nodeName:}" failed. No retries permitted until 2026-07-12 16:24:27.824575099 +0000 UTC m=+34.277963062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nbq2q" (UniqueName: "kubernetes.io/projected/537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1-kube-api-access-nbq2q") pod "network-check-target-8d275" (UID: "537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 16:24:11.867475 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:11.867443 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4hxjr" Jul 12 16:24:11.868061 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:11.868037 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4hxjr" Jul 12 16:24:12.054204 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:12.054120 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:24:12.054204 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:12.054155 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:24:12.054390 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:12.054120 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:24:12.054390 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:12.054255 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l4qq" podUID="9ef6eef5-8bcb-409b-92c8-8be3c0632ec9" Jul 12 16:24:12.054390 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:12.054307 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8d275" podUID="537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1" Jul 12 16:24:12.054520 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:12.054397 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjfj4" podUID="ccd1221a-8ea7-4bba-ba15-999ca853321e" Jul 12 16:24:12.183861 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:12.183827 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4hxjr" Jul 12 16:24:12.184432 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:12.184411 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4hxjr" Jul 12 16:24:14.055386 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:14.055328 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:24:14.056056 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:14.055729 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjfj4" podUID="ccd1221a-8ea7-4bba-ba15-999ca853321e" Jul 12 16:24:14.056579 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:14.056560 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:24:14.056723 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:14.056703 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8d275" podUID="537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1" Jul 12 16:24:14.056879 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:14.056868 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:24:14.057077 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:14.057052 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l4qq" podUID="9ef6eef5-8bcb-409b-92c8-8be3c0632ec9" Jul 12 16:24:16.053573 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:16.053534 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:24:16.054186 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:16.053533 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:24:16.054186 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:16.053674 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjfj4" podUID="ccd1221a-8ea7-4bba-ba15-999ca853321e" Jul 12 16:24:16.054186 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:16.053717 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:24:16.054186 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:16.053799 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l4qq" podUID="9ef6eef5-8bcb-409b-92c8-8be3c0632ec9" Jul 12 16:24:16.054186 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:16.053891 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8d275" podUID="537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1" Jul 12 16:24:17.019152 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:17.018942 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 12 16:24:17.052164 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:17.052006 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-12T16:24:17.019124369Z","UUID":"d476c487-26b7-4dff-9fe3-1de12d2141f3","Handler":null,"Name":"","Endpoint":""} Jul 12 16:24:17.053559 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:17.053541 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 12 16:24:17.053664 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:17.053580 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 12 16:24:17.197013 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:17.196983 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4zm_b89054d2-a85b-40ac-aa21-69eefa2ed9e8/ovn-acl-logging/0.log" Jul 12 16:24:17.197416 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:17.197390 2559 generic.go:356] "Generic (PLEG): container finished" podID="b89054d2-a85b-40ac-aa21-69eefa2ed9e8" containerID="062eedf9cc857b2044604a790553dae81dc474393c923a8cd79c4ee555abd016" exitCode=1 Jul 12 16:24:17.197534 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:17.197454 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" event={"ID":"b89054d2-a85b-40ac-aa21-69eefa2ed9e8","Type":"ContainerStarted","Data":"1e26a8afbd926ce752cb89950aec21b283c41469ebfd31455ef754ef418d4cdd"} Jul 12 16:24:17.197588 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:17.197573 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" event={"ID":"b89054d2-a85b-40ac-aa21-69eefa2ed9e8","Type":"ContainerStarted","Data":"30ee807dcf7f5695f4e2fe0e139d23b0f31729ed5ec77736f8f861c6dab20b7d"} Jul 12 16:24:17.197641 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:17.197624 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" event={"ID":"b89054d2-a85b-40ac-aa21-69eefa2ed9e8","Type":"ContainerDied","Data":"062eedf9cc857b2044604a790553dae81dc474393c923a8cd79c4ee555abd016"} Jul 12 16:24:17.197690 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:17.197675 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" event={"ID":"b89054d2-a85b-40ac-aa21-69eefa2ed9e8","Type":"ContainerStarted","Data":"3efccea4f8119ec481f6a445f4f01ccfb66643561a7d9ed15973148b0c30ee71"} Jul 12 16:24:17.199137 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:17.199115 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sdjjz" event={"ID":"8b81da15-6b81-47e2-9162-e897fd167e11","Type":"ContainerStarted","Data":"b13d994e8035d6d63770dd30046ae29c15dbdbff1966773a1133f29ca0184f5a"} Jul 12 16:24:17.200740 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:17.200716 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" event={"ID":"c3386231-0fc2-4b3b-89e5-6dc353769a9f","Type":"ContainerStarted","Data":"87048d02ae93b49727969bae6e134285fdeb0c862efb777ef98e75f6363714b9"} Jul 12 16:24:17.215202 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:17.215147 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sdjjz" podStartSLOduration=2.953514426 podStartE2EDuration="23.215131542s" totalImagesPullingTime="20.261617116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:24:17.214803881 +0000 UTC m=+23.668191866" watchObservedRunningTime="2026-07-12 16:24:17.215131542 +0000 UTC m=+23.668519528" Jul 12 16:24:18.054615 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:18.054402 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:24:18.055062 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:18.054411 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:24:18.055062 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:18.054708 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l4qq" podUID="9ef6eef5-8bcb-409b-92c8-8be3c0632ec9" Jul 12 16:24:18.055062 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:18.054813 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjfj4" podUID="ccd1221a-8ea7-4bba-ba15-999ca853321e" Jul 12 16:24:18.055062 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:18.054474 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:24:18.055062 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:18.054907 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8d275" podUID="537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1" Jul 12 16:24:18.205825 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:18.205798 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4zm_b89054d2-a85b-40ac-aa21-69eefa2ed9e8/ovn-acl-logging/0.log" Jul 12 16:24:18.206364 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:18.206199 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" event={"ID":"b89054d2-a85b-40ac-aa21-69eefa2ed9e8","Type":"ContainerStarted","Data":"4993b60022d2f2137d90b69701d2a4a085acaa7cac5f012529c25b092888995f"} Jul 12 16:24:18.206364 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:18.206306 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" event={"ID":"b89054d2-a85b-40ac-aa21-69eefa2ed9e8","Type":"ContainerStarted","Data":"2a83f214efd2167be6840e69dd510459f092d066743b8ce383654bbec9fc4a17"} Jul 12 16:24:19.210605 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:19.210570 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" event={"ID":"c3386231-0fc2-4b3b-89e5-6dc353769a9f","Type":"ContainerStarted","Data":"87a3ba8d64d80e72e83383997dc06b8d4643e20a6ea619a29abb417e15667d10"} Jul 12 16:24:19.227427 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:19.227388 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw8hh" podStartSLOduration=2.565626987 podStartE2EDuration="24.227374789s" totalImagesPullingTime="21.661747802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:23:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:24:19.226019065 +0000 UTC m=+25.679407050" watchObservedRunningTime="2026-07-12 16:24:19.227374789 +0000 UTC m=+25.680762774" Jul 12 16:24:20.057711 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:20.057680 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:24:20.057711 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:20.057708 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:24:20.057961 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:20.057805 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjfj4" podUID="ccd1221a-8ea7-4bba-ba15-999ca853321e" Jul 12 16:24:20.057961 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:20.057838 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:24:20.057961 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:20.057904 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8d275" podUID="537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1" Jul 12 16:24:20.057961 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:20.057960 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l4qq" podUID="9ef6eef5-8bcb-409b-92c8-8be3c0632ec9" Jul 12 16:24:20.217129 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:20.217081 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4zm_b89054d2-a85b-40ac-aa21-69eefa2ed9e8/ovn-acl-logging/0.log" Jul 12 16:24:20.217754 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:20.217729 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" event={"ID":"b89054d2-a85b-40ac-aa21-69eefa2ed9e8","Type":"ContainerStarted","Data":"02c789aaa3635eb74eeb6b553dbe5b2bf504f383bf74271ea801d81b48eaddb2"} Jul 12 16:24:22.053985 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:22.053749 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:24:22.054738 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:22.053755 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:24:22.054738 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:22.054008 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l4qq" podUID="9ef6eef5-8bcb-409b-92c8-8be3c0632ec9" Jul 12 16:24:22.054738 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:22.053804 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:24:22.054738 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:22.054153 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjfj4" podUID="ccd1221a-8ea7-4bba-ba15-999ca853321e" Jul 12 16:24:22.054738 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:22.054211 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8d275" podUID="537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1" Jul 12 16:24:22.223790 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:22.223756 2559 generic.go:356] "Generic (PLEG): container finished" podID="cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559" containerID="5cee88c2d84afba3b39ae9bda96ed76861ad31fae7e5ecd6775215df07f61e8d" exitCode=0 Jul 12 16:24:22.223944 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:22.223815 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hztg9" event={"ID":"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559","Type":"ContainerDied","Data":"5cee88c2d84afba3b39ae9bda96ed76861ad31fae7e5ecd6775215df07f61e8d"} Jul 12 16:24:22.227526 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:22.227510 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4zm_b89054d2-a85b-40ac-aa21-69eefa2ed9e8/ovn-acl-logging/0.log" Jul 12 16:24:22.227892 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:22.227870 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" event={"ID":"b89054d2-a85b-40ac-aa21-69eefa2ed9e8","Type":"ContainerStarted","Data":"58c0a47b13a5a9c48cc605bd6526a448f12106da5f1b36721fd6f09051b0f200"} Jul 12 16:24:22.228144 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:22.228120 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:24:22.228255 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:22.228201 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:24:22.228325 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:22.228307 2559 scope.go:117] "RemoveContainer" containerID="062eedf9cc857b2044604a790553dae81dc474393c923a8cd79c4ee555abd016" Jul 12 16:24:22.246008 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:22.245988 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:24:23.236656 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:23.236629 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4zm_b89054d2-a85b-40ac-aa21-69eefa2ed9e8/ovn-acl-logging/0.log" Jul 12 16:24:23.237201 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:23.237045 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" event={"ID":"b89054d2-a85b-40ac-aa21-69eefa2ed9e8","Type":"ContainerStarted","Data":"e1a021d6a40404a2b909af7701740b423f95ab02e166e4f480147fbe07e1f6b4"} Jul 12 16:24:23.237564 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:23.237475 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:24:23.260995 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:23.260926 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:24:23.263561 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:23.263516 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" podStartSLOduration=8.990012497 podStartE2EDuration="29.263502206s" totalImagesPullingTime="20.273489709s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:24:23.262243842 +0000 UTC m=+29.715631828" watchObservedRunningTime="2026-07-12 16:24:23.263502206 +0000 UTC m=+29.716890192" Jul 12 16:24:23.618364 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:23.618272 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8l4qq"] Jul 12 16:24:23.618490 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:23.618416 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:24:23.618538 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:23.618508 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l4qq" podUID="9ef6eef5-8bcb-409b-92c8-8be3c0632ec9" Jul 12 16:24:23.619029 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:23.619010 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vjfj4"] Jul 12 16:24:23.619129 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:23.619116 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:24:23.619223 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:23.619204 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjfj4" podUID="ccd1221a-8ea7-4bba-ba15-999ca853321e" Jul 12 16:24:23.619772 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:23.619735 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8d275"] Jul 12 16:24:23.619864 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:23.619844 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:24:23.619953 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:23.619934 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8d275" podUID="537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1" Jul 12 16:24:24.241199 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:24.241167 2559 generic.go:356] "Generic (PLEG): container finished" podID="cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559" containerID="82f0ad2b0445ba517e9c4036fae8fec68667076fa23dff5104be4b52f2f716c0" exitCode=0 Jul 12 16:24:24.241594 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:24.241247 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hztg9" event={"ID":"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559","Type":"ContainerDied","Data":"82f0ad2b0445ba517e9c4036fae8fec68667076fa23dff5104be4b52f2f716c0"} Jul 12 16:24:25.054375 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:25.054351 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:24:25.054475 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:25.054458 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8d275" podUID="537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1" Jul 12 16:24:25.054529 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:25.054505 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:24:25.054617 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:25.054601 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l4qq" podUID="9ef6eef5-8bcb-409b-92c8-8be3c0632ec9" Jul 12 16:24:25.246409 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:25.246375 2559 generic.go:356] "Generic (PLEG): container finished" podID="cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559" containerID="6497781a142153f8b74998db7b04518c96fc59f2e905a0b4b58e471b424b2c81" exitCode=0 Jul 12 16:24:25.246756 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:25.246441 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hztg9" event={"ID":"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559","Type":"ContainerDied","Data":"6497781a142153f8b74998db7b04518c96fc59f2e905a0b4b58e471b424b2c81"} Jul 12 16:24:26.053988 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:26.053777 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:24:26.054201 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:26.054173 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjfj4" podUID="ccd1221a-8ea7-4bba-ba15-999ca853321e" Jul 12 16:24:27.054137 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:27.054101 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:24:27.054635 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:27.054108 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:24:27.054635 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:27.054249 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l4qq" podUID="9ef6eef5-8bcb-409b-92c8-8be3c0632ec9" Jul 12 16:24:27.054635 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:27.054312 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8d275" podUID="537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1" Jul 12 16:24:27.742806 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:27.742774 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccd1221a-8ea7-4bba-ba15-999ca853321e-metrics-certs\") pod \"network-metrics-daemon-vjfj4\" (UID: \"ccd1221a-8ea7-4bba-ba15-999ca853321e\") " pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:24:27.742987 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:27.742927 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 16:24:27.743035 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:27.742992 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd1221a-8ea7-4bba-ba15-999ca853321e-metrics-certs podName:ccd1221a-8ea7-4bba-ba15-999ca853321e nodeName:}" failed. No retries permitted until 2026-07-12 16:24:59.742976155 +0000 UTC m=+66.196364120 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccd1221a-8ea7-4bba-ba15-999ca853321e-metrics-certs") pod "network-metrics-daemon-vjfj4" (UID: "ccd1221a-8ea7-4bba-ba15-999ca853321e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 16:24:27.843912 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:27.843883 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-original-pull-secret\") pod \"global-pull-secret-syncer-8l4qq\" (UID: \"9ef6eef5-8bcb-409b-92c8-8be3c0632ec9\") " pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:24:27.844112 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:27.843927 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbq2q\" (UniqueName: \"kubernetes.io/projected/537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1-kube-api-access-nbq2q\") pod \"network-check-target-8d275\" (UID: \"537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1\") " pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:24:27.844112 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:27.844046 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 16:24:27.844112 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:27.844063 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 16:24:27.844112 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:27.844081 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 16:24:27.844112 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:27.844113 2559 projected.go:196] Error preparing data for projected volume kube-api-access-nbq2q for pod openshift-network-diagnostics/network-check-target-8d275: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 16:24:27.844309 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:27.844140 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-original-pull-secret podName:9ef6eef5-8bcb-409b-92c8-8be3c0632ec9 nodeName:}" failed. No retries permitted until 2026-07-12 16:24:59.844119265 +0000 UTC m=+66.297507235 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-original-pull-secret") pod "global-pull-secret-syncer-8l4qq" (UID: "9ef6eef5-8bcb-409b-92c8-8be3c0632ec9") : object "kube-system"/"original-pull-secret" not registered Jul 12 16:24:27.844309 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:27.844160 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1-kube-api-access-nbq2q podName:537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1 nodeName:}" failed. No retries permitted until 2026-07-12 16:24:59.844148773 +0000 UTC m=+66.297536770 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nbq2q" (UniqueName: "kubernetes.io/projected/537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1-kube-api-access-nbq2q") pod "network-check-target-8d275" (UID: "537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 16:24:28.054255 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:28.054172 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:24:28.054626 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:28.054337 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjfj4" podUID="ccd1221a-8ea7-4bba-ba15-999ca853321e" Jul 12 16:24:29.054305 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:29.054262 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:24:29.055024 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:29.054383 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8d275" podUID="537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1" Jul 12 16:24:29.055024 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:29.054445 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:24:29.055024 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:29.054557 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l4qq" podUID="9ef6eef5-8bcb-409b-92c8-8be3c0632ec9" Jul 12 16:24:30.053906 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.053873 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:24:30.054061 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:30.054015 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjfj4" podUID="ccd1221a-8ea7-4bba-ba15-999ca853321e" Jul 12 16:24:30.360460 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.360390 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-204.ec2.internal" event="NodeReady" Jul 12 16:24:30.360797 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.360521 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 12 16:24:30.401138 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.401111 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5985f48fd5-s5dqd"] Jul 12 16:24:30.415473 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.415441 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-gl9gj"] Jul 12 16:24:30.415642 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.415516 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:30.418034 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.418011 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 12 16:24:30.418178 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.418127 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 12 16:24:30.418178 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.418128 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vtt9v\"" Jul 12 16:24:30.418273 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.418198 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 12 16:24:30.425300 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.425276 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 12 16:24:30.440080 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.440039 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bvl9s"] Jul 12 16:24:30.440295 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.440193 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-gl9gj" Jul 12 16:24:30.444349 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.444323 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 12 16:24:30.444763 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.444463 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-qppp9\"" Jul 12 16:24:30.444908 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.444750 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 12 16:24:30.447048 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.444800 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 12 16:24:30.447048 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.444851 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 12 16:24:30.462179 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.462153 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-msnlw"] Jul 12 16:24:30.462295 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.462275 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bvl9s" Jul 12 16:24:30.465973 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.465952 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 12 16:24:30.466057 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.466037 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 12 16:24:30.466393 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.466378 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 12 16:24:30.466493 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.466475 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-c4zcd\"" Jul 12 16:24:30.466639 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.466624 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 12 16:24:30.478654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.478628 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-rqghp"] Jul 12 16:24:30.478778 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.478761 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-msnlw" Jul 12 16:24:30.481506 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.481487 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tm8hr\"" Jul 12 16:24:30.481615 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.481487 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 12 16:24:30.481615 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.481507 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 12 16:24:30.492652 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.492631 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-tkdsp"] Jul 12 16:24:30.492782 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.492764 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-rqghp" Jul 12 16:24:30.495573 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.495556 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 12 16:24:30.495687 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.495671 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 12 16:24:30.495782 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.495767 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-c5xdv\"" Jul 12 16:24:30.495910 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.495893 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 12 16:24:30.496000 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.495987 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 12 16:24:30.500844 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.500825 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 12 16:24:30.509277 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.509255 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcrbc"] Jul 12 16:24:30.509355 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.509341 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-tkdsp" Jul 12 16:24:30.511902 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.511880 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 12 16:24:30.512004 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.511938 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 12 16:24:30.512064 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.512023 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-lpt4q\"" Jul 12 16:24:30.525444 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.525427 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-gl9gj"] Jul 12 16:24:30.525513 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.525457 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcrbc"] Jul 12 16:24:30.525513 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.525474 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cmxw4"] Jul 12 16:24:30.525582 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.525538 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcrbc" Jul 12 16:24:30.528466 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.528446 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 12 16:24:30.528839 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.528824 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 12 16:24:30.528924 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.528895 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-49fd5\"" Jul 12 16:24:30.529412 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.529397 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 12 16:24:30.561406 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.561376 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5985f48fd5-s5dqd"] Jul 12 16:24:30.561406 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.561413 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-rqghp"] Jul 12 16:24:30.561604 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.561426 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bvl9s"] Jul 12 16:24:30.561604 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.561440 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-msnlw"] Jul 12 16:24:30.561604 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.561454 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cmxw4"] Jul 12 16:24:30.561604 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.561475 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-tkdsp"] Jul 12 16:24:30.561604 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.561495 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cmxw4" Jul 12 16:24:30.561829 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.561500 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bfd2h"] Jul 12 16:24:30.561829 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.561450 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/742214ce-0dc3-454c-9b09-d44dc878e3cd-installation-pull-secrets\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:30.561829 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.561672 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aaab24fb-7114-4a9f-a622-de960b401c40-serving-cert\") pod \"service-ca-operator-7695fc6c8c-gl9gj\" (UID: \"aaab24fb-7114-4a9f-a622-de960b401c40\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-gl9gj" Jul 12 16:24:30.561829 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.561699 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0710e54e-dec4-4fd6-be9f-a923266bf153-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-bvl9s\" (UID: \"0710e54e-dec4-4fd6-be9f-a923266bf153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bvl9s" Jul 12 16:24:30.561829 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.561728 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0710e54e-dec4-4fd6-be9f-a923266bf153-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-bvl9s\" (UID: \"0710e54e-dec4-4fd6-be9f-a923266bf153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bvl9s" Jul 12 16:24:30.561829 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.561751 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-certificates\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:30.561829 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.561767 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jsj7\" (UniqueName: \"kubernetes.io/projected/24ec1189-1069-45cb-b2de-11141419b010-kube-api-access-9jsj7\") pod \"volume-data-source-validator-78495597f6-msnlw\" (UID: \"24ec1189-1069-45cb-b2de-11141419b010\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-msnlw" Jul 12 16:24:30.561829 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.561810 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-bound-sa-token\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:30.562164 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.561872 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjlbt\" (UniqueName: \"kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-kube-api-access-vjlbt\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:30.562164 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.561903 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7wcg\" (UniqueName: \"kubernetes.io/projected/0710e54e-dec4-4fd6-be9f-a923266bf153-kube-api-access-d7wcg\") pod \"kube-storage-version-migrator-operator-799cb7f958-bvl9s\" (UID: \"0710e54e-dec4-4fd6-be9f-a923266bf153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bvl9s" Jul 12 16:24:30.562164 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.561942 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/742214ce-0dc3-454c-9b09-d44dc878e3cd-image-registry-private-configuration\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:30.562164 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.561959 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/742214ce-0dc3-454c-9b09-d44dc878e3cd-ca-trust-extracted\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:30.562164 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.562026 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-tls\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:30.562164 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.562070 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/742214ce-0dc3-454c-9b09-d44dc878e3cd-trusted-ca\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:30.562164 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.562114 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aaab24fb-7114-4a9f-a622-de960b401c40-config\") pod \"service-ca-operator-7695fc6c8c-gl9gj\" (UID: \"aaab24fb-7114-4a9f-a622-de960b401c40\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-gl9gj" Jul 12 16:24:30.562164 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.562132 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k9x4\" (UniqueName: \"kubernetes.io/projected/aaab24fb-7114-4a9f-a622-de960b401c40-kube-api-access-7k9x4\") pod \"service-ca-operator-7695fc6c8c-gl9gj\" (UID: \"aaab24fb-7114-4a9f-a622-de960b401c40\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-gl9gj" Jul 12 16:24:30.564502 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.564483 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j2h6m\"" Jul 12 16:24:30.564562 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.564551 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 12 16:24:30.564785 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.564772 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 12 16:24:30.585679 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.585654 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bfd2h"] Jul 12 16:24:30.585803 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.585750 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bfd2h" Jul 12 16:24:30.588517 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.588497 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-m4x7c\"" Jul 12 16:24:30.588642 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.588552 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 12 16:24:30.588642 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.588567 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 12 16:24:30.588819 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.588806 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 12 16:24:30.662504 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.662471 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7wcg\" (UniqueName: \"kubernetes.io/projected/0710e54e-dec4-4fd6-be9f-a923266bf153-kube-api-access-d7wcg\") pod \"kube-storage-version-migrator-operator-799cb7f958-bvl9s\" (UID: \"0710e54e-dec4-4fd6-be9f-a923266bf153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bvl9s" Jul 12 16:24:30.662638 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.662536 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/742214ce-0dc3-454c-9b09-d44dc878e3cd-image-registry-private-configuration\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:30.662638 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.662573 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0deee09d-6830-46ab-b752-083e182d70ed-config\") pod \"console-operator-7866497494-rqghp\" (UID: \"0deee09d-6830-46ab-b752-083e182d70ed\") " pod="openshift-console-operator/console-operator-7866497494-rqghp" Jul 12 16:24:30.662638 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.662601 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-668m9\" (UniqueName: \"kubernetes.io/projected/915fc3cf-e62f-4444-8024-c5b71d88fd3c-kube-api-access-668m9\") pod \"network-check-source-869dcfcdcd-tkdsp\" (UID: \"915fc3cf-e62f-4444-8024-c5b71d88fd3c\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-tkdsp" Jul 12 16:24:30.662799 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.662647 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/858081cc-8c94-4852-a450-c2e699e9b42d-config-volume\") pod \"dns-default-cmxw4\" (UID: \"858081cc-8c94-4852-a450-c2e699e9b42d\") " pod="openshift-dns/dns-default-cmxw4" Jul 12 16:24:30.662799 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.662706 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-tls\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:30.662799 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.662745 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39d81524-c036-4b18-a3ec-74f2e318fd2e-cert\") pod \"ingress-canary-bfd2h\" (UID: \"39d81524-c036-4b18-a3ec-74f2e318fd2e\") " pod="openshift-ingress-canary/ingress-canary-bfd2h" Jul 12 16:24:30.662799 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.662777 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0deee09d-6830-46ab-b752-083e182d70ed-trusted-ca\") pod \"console-operator-7866497494-rqghp\" (UID: \"0deee09d-6830-46ab-b752-083e182d70ed\") " pod="openshift-console-operator/console-operator-7866497494-rqghp" Jul 12 16:24:30.662986 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.662812 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aaab24fb-7114-4a9f-a622-de960b401c40-config\") pod \"service-ca-operator-7695fc6c8c-gl9gj\" (UID: \"aaab24fb-7114-4a9f-a622-de960b401c40\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-gl9gj" Jul 12 16:24:30.662986 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:30.662820 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 12 16:24:30.662986 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:30.662840 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5985f48fd5-s5dqd: secret "image-registry-tls" not found Jul 12 16:24:30.662986 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.662852 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/18f6ae2d-f089-45ff-88bc-87fde221a451-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mcrbc\" (UID: \"18f6ae2d-f089-45ff-88bc-87fde221a451\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcrbc" Jul 12 16:24:30.662986 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:30.662897 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-tls podName:742214ce-0dc3-454c-9b09-d44dc878e3cd nodeName:}" failed. No retries permitted until 2026-07-12 16:24:31.16287564 +0000 UTC m=+37.616263620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-tls") pod "image-registry-5985f48fd5-s5dqd" (UID: "742214ce-0dc3-454c-9b09-d44dc878e3cd") : secret "image-registry-tls" not found Jul 12 16:24:30.662986 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.662917 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/742214ce-0dc3-454c-9b09-d44dc878e3cd-installation-pull-secrets\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:30.665746 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.665715 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aaab24fb-7114-4a9f-a622-de960b401c40-config\") pod \"service-ca-operator-7695fc6c8c-gl9gj\" (UID: \"aaab24fb-7114-4a9f-a622-de960b401c40\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-gl9gj" Jul 12 16:24:30.665854 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.662950 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aaab24fb-7114-4a9f-a622-de960b401c40-serving-cert\") pod \"service-ca-operator-7695fc6c8c-gl9gj\" (UID: \"aaab24fb-7114-4a9f-a622-de960b401c40\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-gl9gj" Jul 12 16:24:30.665854 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.665825 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0710e54e-dec4-4fd6-be9f-a923266bf153-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-bvl9s\" (UID: \"0710e54e-dec4-4fd6-be9f-a923266bf153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bvl9s" Jul 12 16:24:30.665969 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.665863 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8d5q\" (UniqueName: \"kubernetes.io/projected/858081cc-8c94-4852-a450-c2e699e9b42d-kube-api-access-v8d5q\") pod \"dns-default-cmxw4\" (UID: \"858081cc-8c94-4852-a450-c2e699e9b42d\") " pod="openshift-dns/dns-default-cmxw4" Jul 12 16:24:30.665969 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.665911 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-bound-sa-token\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:30.665969 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.665954 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/742214ce-0dc3-454c-9b09-d44dc878e3cd-ca-trust-extracted\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:30.666134 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.665993 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7d9k\" (UniqueName: \"kubernetes.io/projected/39d81524-c036-4b18-a3ec-74f2e318fd2e-kube-api-access-p7d9k\") pod \"ingress-canary-bfd2h\" (UID: \"39d81524-c036-4b18-a3ec-74f2e318fd2e\") " pod="openshift-ingress-canary/ingress-canary-bfd2h" Jul 12 16:24:30.666134 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.666023 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/742214ce-0dc3-454c-9b09-d44dc878e3cd-trusted-ca\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:30.666134 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.666056 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k9x4\" (UniqueName: \"kubernetes.io/projected/aaab24fb-7114-4a9f-a622-de960b401c40-kube-api-access-7k9x4\") pod \"service-ca-operator-7695fc6c8c-gl9gj\" (UID: \"aaab24fb-7114-4a9f-a622-de960b401c40\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-gl9gj" Jul 12 16:24:30.666134 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.666124 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0710e54e-dec4-4fd6-be9f-a923266bf153-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-bvl9s\" (UID: \"0710e54e-dec4-4fd6-be9f-a923266bf153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bvl9s" Jul 12 16:24:30.666317 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.666157 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0deee09d-6830-46ab-b752-083e182d70ed-serving-cert\") pod \"console-operator-7866497494-rqghp\" (UID: \"0deee09d-6830-46ab-b752-083e182d70ed\") " pod="openshift-console-operator/console-operator-7866497494-rqghp" Jul 12 16:24:30.666317 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.666192 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/858081cc-8c94-4852-a450-c2e699e9b42d-metrics-tls\") pod \"dns-default-cmxw4\" (UID: \"858081cc-8c94-4852-a450-c2e699e9b42d\") " pod="openshift-dns/dns-default-cmxw4" Jul 12 16:24:30.666317 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.666225 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgsxn\" (UniqueName: \"kubernetes.io/projected/0deee09d-6830-46ab-b752-083e182d70ed-kube-api-access-mgsxn\") pod \"console-operator-7866497494-rqghp\" (UID: \"0deee09d-6830-46ab-b752-083e182d70ed\") " pod="openshift-console-operator/console-operator-7866497494-rqghp" Jul 12 16:24:30.666317 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.666260 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-certificates\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:30.666317 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.666291 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jsj7\" (UniqueName: \"kubernetes.io/projected/24ec1189-1069-45cb-b2de-11141419b010-kube-api-access-9jsj7\") pod \"volume-data-source-validator-78495597f6-msnlw\" (UID: \"24ec1189-1069-45cb-b2de-11141419b010\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-msnlw" Jul 12 16:24:30.666530 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.666324 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjlbt\" (UniqueName: \"kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-kube-api-access-vjlbt\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:30.666530 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.666348 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s76vc\" (UniqueName: \"kubernetes.io/projected/18f6ae2d-f089-45ff-88bc-87fde221a451-kube-api-access-s76vc\") pod \"cluster-samples-operator-65db858894-mcrbc\" (UID: \"18f6ae2d-f089-45ff-88bc-87fde221a451\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcrbc" Jul 12 16:24:30.666530 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.666386 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/858081cc-8c94-4852-a450-c2e699e9b42d-tmp-dir\") pod \"dns-default-cmxw4\" (UID: \"858081cc-8c94-4852-a450-c2e699e9b42d\") " pod="openshift-dns/dns-default-cmxw4" Jul 12 16:24:30.666995 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.666967 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0710e54e-dec4-4fd6-be9f-a923266bf153-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-bvl9s\" (UID: \"0710e54e-dec4-4fd6-be9f-a923266bf153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bvl9s" Jul 12 16:24:30.667846 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.667818 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/742214ce-0dc3-454c-9b09-d44dc878e3cd-ca-trust-extracted\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:30.669324 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.669299 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-certificates\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:30.676772 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.676221 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/742214ce-0dc3-454c-9b09-d44dc878e3cd-image-registry-private-configuration\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:30.676992 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.676780 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/742214ce-0dc3-454c-9b09-d44dc878e3cd-trusted-ca\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:30.679504 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.679457 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0710e54e-dec4-4fd6-be9f-a923266bf153-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-bvl9s\" (UID: \"0710e54e-dec4-4fd6-be9f-a923266bf153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bvl9s" Jul 12 16:24:30.679605 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.679509 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aaab24fb-7114-4a9f-a622-de960b401c40-serving-cert\") pod \"service-ca-operator-7695fc6c8c-gl9gj\" (UID: \"aaab24fb-7114-4a9f-a622-de960b401c40\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-gl9gj" Jul 12 16:24:30.679665 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.679644 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jsj7\" (UniqueName: \"kubernetes.io/projected/24ec1189-1069-45cb-b2de-11141419b010-kube-api-access-9jsj7\") pod \"volume-data-source-validator-78495597f6-msnlw\" (UID: \"24ec1189-1069-45cb-b2de-11141419b010\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-msnlw" Jul 12 16:24:30.679732 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.679657 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjlbt\" (UniqueName: \"kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-kube-api-access-vjlbt\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:30.679794 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.679733 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-bound-sa-token\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:30.679876 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.679855 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/742214ce-0dc3-454c-9b09-d44dc878e3cd-installation-pull-secrets\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:30.680223 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.680206 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7wcg\" (UniqueName: \"kubernetes.io/projected/0710e54e-dec4-4fd6-be9f-a923266bf153-kube-api-access-d7wcg\") pod \"kube-storage-version-migrator-operator-799cb7f958-bvl9s\" (UID: \"0710e54e-dec4-4fd6-be9f-a923266bf153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bvl9s" Jul 12 16:24:30.681062 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.681042 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k9x4\" (UniqueName: \"kubernetes.io/projected/aaab24fb-7114-4a9f-a622-de960b401c40-kube-api-access-7k9x4\") pod \"service-ca-operator-7695fc6c8c-gl9gj\" (UID: \"aaab24fb-7114-4a9f-a622-de960b401c40\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-gl9gj" Jul 12 16:24:30.752893 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.752861 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-gl9gj" Jul 12 16:24:30.767787 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.767764 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7d9k\" (UniqueName: \"kubernetes.io/projected/39d81524-c036-4b18-a3ec-74f2e318fd2e-kube-api-access-p7d9k\") pod \"ingress-canary-bfd2h\" (UID: \"39d81524-c036-4b18-a3ec-74f2e318fd2e\") " pod="openshift-ingress-canary/ingress-canary-bfd2h" Jul 12 16:24:30.767873 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.767810 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0deee09d-6830-46ab-b752-083e182d70ed-serving-cert\") pod \"console-operator-7866497494-rqghp\" (UID: \"0deee09d-6830-46ab-b752-083e182d70ed\") " pod="openshift-console-operator/console-operator-7866497494-rqghp" Jul 12 16:24:30.767873 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.767850 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/858081cc-8c94-4852-a450-c2e699e9b42d-metrics-tls\") pod \"dns-default-cmxw4\" (UID: \"858081cc-8c94-4852-a450-c2e699e9b42d\") " pod="openshift-dns/dns-default-cmxw4" Jul 12 16:24:30.767975 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.767880 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgsxn\" (UniqueName: \"kubernetes.io/projected/0deee09d-6830-46ab-b752-083e182d70ed-kube-api-access-mgsxn\") pod \"console-operator-7866497494-rqghp\" (UID: \"0deee09d-6830-46ab-b752-083e182d70ed\") " pod="openshift-console-operator/console-operator-7866497494-rqghp" Jul 12 16:24:30.767975 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.767919 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s76vc\" (UniqueName: \"kubernetes.io/projected/18f6ae2d-f089-45ff-88bc-87fde221a451-kube-api-access-s76vc\") pod \"cluster-samples-operator-65db858894-mcrbc\" (UID: \"18f6ae2d-f089-45ff-88bc-87fde221a451\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcrbc" Jul 12 16:24:30.767975 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.767942 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/858081cc-8c94-4852-a450-c2e699e9b42d-tmp-dir\") pod \"dns-default-cmxw4\" (UID: \"858081cc-8c94-4852-a450-c2e699e9b42d\") " pod="openshift-dns/dns-default-cmxw4" Jul 12 16:24:30.768147 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:30.767985 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 16:24:30.768147 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.768032 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0deee09d-6830-46ab-b752-083e182d70ed-config\") pod \"console-operator-7866497494-rqghp\" (UID: \"0deee09d-6830-46ab-b752-083e182d70ed\") " pod="openshift-console-operator/console-operator-7866497494-rqghp" Jul 12 16:24:30.768147 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:30.768052 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/858081cc-8c94-4852-a450-c2e699e9b42d-metrics-tls podName:858081cc-8c94-4852-a450-c2e699e9b42d nodeName:}" failed. No retries permitted until 2026-07-12 16:24:31.268031415 +0000 UTC m=+37.721419386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/858081cc-8c94-4852-a450-c2e699e9b42d-metrics-tls") pod "dns-default-cmxw4" (UID: "858081cc-8c94-4852-a450-c2e699e9b42d") : secret "dns-default-metrics-tls" not found Jul 12 16:24:30.768147 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.768106 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-668m9\" (UniqueName: \"kubernetes.io/projected/915fc3cf-e62f-4444-8024-c5b71d88fd3c-kube-api-access-668m9\") pod \"network-check-source-869dcfcdcd-tkdsp\" (UID: \"915fc3cf-e62f-4444-8024-c5b71d88fd3c\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-tkdsp" Jul 12 16:24:30.768147 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.768135 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/858081cc-8c94-4852-a450-c2e699e9b42d-config-volume\") pod \"dns-default-cmxw4\" (UID: \"858081cc-8c94-4852-a450-c2e699e9b42d\") " pod="openshift-dns/dns-default-cmxw4" Jul 12 16:24:30.768392 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.768174 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39d81524-c036-4b18-a3ec-74f2e318fd2e-cert\") pod \"ingress-canary-bfd2h\" (UID: \"39d81524-c036-4b18-a3ec-74f2e318fd2e\") " pod="openshift-ingress-canary/ingress-canary-bfd2h" Jul 12 16:24:30.768392 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.768201 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0deee09d-6830-46ab-b752-083e182d70ed-trusted-ca\") pod \"console-operator-7866497494-rqghp\" (UID: \"0deee09d-6830-46ab-b752-083e182d70ed\") " pod="openshift-console-operator/console-operator-7866497494-rqghp" Jul 12 16:24:30.768392 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.768235 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/18f6ae2d-f089-45ff-88bc-87fde221a451-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mcrbc\" (UID: \"18f6ae2d-f089-45ff-88bc-87fde221a451\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcrbc" Jul 12 16:24:30.768392 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.768268 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8d5q\" (UniqueName: \"kubernetes.io/projected/858081cc-8c94-4852-a450-c2e699e9b42d-kube-api-access-v8d5q\") pod \"dns-default-cmxw4\" (UID: \"858081cc-8c94-4852-a450-c2e699e9b42d\") " pod="openshift-dns/dns-default-cmxw4" Jul 12 16:24:30.768392 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.768313 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/858081cc-8c94-4852-a450-c2e699e9b42d-tmp-dir\") pod \"dns-default-cmxw4\" (UID: \"858081cc-8c94-4852-a450-c2e699e9b42d\") " pod="openshift-dns/dns-default-cmxw4" Jul 12 16:24:30.768650 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:30.768418 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 12 16:24:30.768650 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:30.768466 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f6ae2d-f089-45ff-88bc-87fde221a451-samples-operator-tls podName:18f6ae2d-f089-45ff-88bc-87fde221a451 nodeName:}" failed. No retries permitted until 2026-07-12 16:24:31.268451324 +0000 UTC m=+37.721839290 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/18f6ae2d-f089-45ff-88bc-87fde221a451-samples-operator-tls") pod "cluster-samples-operator-65db858894-mcrbc" (UID: "18f6ae2d-f089-45ff-88bc-87fde221a451") : secret "samples-operator-tls" not found Jul 12 16:24:30.768855 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.768828 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0deee09d-6830-46ab-b752-083e182d70ed-config\") pod \"console-operator-7866497494-rqghp\" (UID: \"0deee09d-6830-46ab-b752-083e182d70ed\") " pod="openshift-console-operator/console-operator-7866497494-rqghp" Jul 12 16:24:30.769053 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.769033 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0deee09d-6830-46ab-b752-083e182d70ed-trusted-ca\") pod \"console-operator-7866497494-rqghp\" (UID: \"0deee09d-6830-46ab-b752-083e182d70ed\") " pod="openshift-console-operator/console-operator-7866497494-rqghp" Jul 12 16:24:30.769168 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.769147 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/858081cc-8c94-4852-a450-c2e699e9b42d-config-volume\") pod \"dns-default-cmxw4\" (UID: \"858081cc-8c94-4852-a450-c2e699e9b42d\") " pod="openshift-dns/dns-default-cmxw4" Jul 12 16:24:30.770021 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.769993 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bvl9s" Jul 12 16:24:30.770639 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.770617 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0deee09d-6830-46ab-b752-083e182d70ed-serving-cert\") pod \"console-operator-7866497494-rqghp\" (UID: \"0deee09d-6830-46ab-b752-083e182d70ed\") " pod="openshift-console-operator/console-operator-7866497494-rqghp" Jul 12 16:24:30.770732 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.770700 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39d81524-c036-4b18-a3ec-74f2e318fd2e-cert\") pod \"ingress-canary-bfd2h\" (UID: \"39d81524-c036-4b18-a3ec-74f2e318fd2e\") " pod="openshift-ingress-canary/ingress-canary-bfd2h" Jul 12 16:24:30.777257 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.777236 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8d5q\" (UniqueName: \"kubernetes.io/projected/858081cc-8c94-4852-a450-c2e699e9b42d-kube-api-access-v8d5q\") pod \"dns-default-cmxw4\" (UID: \"858081cc-8c94-4852-a450-c2e699e9b42d\") " pod="openshift-dns/dns-default-cmxw4" Jul 12 16:24:30.777892 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.777724 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgsxn\" (UniqueName: \"kubernetes.io/projected/0deee09d-6830-46ab-b752-083e182d70ed-kube-api-access-mgsxn\") pod \"console-operator-7866497494-rqghp\" (UID: \"0deee09d-6830-46ab-b752-083e182d70ed\") " pod="openshift-console-operator/console-operator-7866497494-rqghp" Jul 12 16:24:30.778216 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.778199 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-668m9\" (UniqueName: \"kubernetes.io/projected/915fc3cf-e62f-4444-8024-c5b71d88fd3c-kube-api-access-668m9\") pod \"network-check-source-869dcfcdcd-tkdsp\" (UID: \"915fc3cf-e62f-4444-8024-c5b71d88fd3c\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-tkdsp" Jul 12 16:24:30.778335 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.778317 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s76vc\" (UniqueName: \"kubernetes.io/projected/18f6ae2d-f089-45ff-88bc-87fde221a451-kube-api-access-s76vc\") pod \"cluster-samples-operator-65db858894-mcrbc\" (UID: \"18f6ae2d-f089-45ff-88bc-87fde221a451\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcrbc" Jul 12 16:24:30.778401 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.778381 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7d9k\" (UniqueName: \"kubernetes.io/projected/39d81524-c036-4b18-a3ec-74f2e318fd2e-kube-api-access-p7d9k\") pod \"ingress-canary-bfd2h\" (UID: \"39d81524-c036-4b18-a3ec-74f2e318fd2e\") " pod="openshift-ingress-canary/ingress-canary-bfd2h" Jul 12 16:24:30.786966 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.786941 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-msnlw" Jul 12 16:24:30.802568 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.802537 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-rqghp" Jul 12 16:24:30.819377 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.819329 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-tkdsp" Jul 12 16:24:30.898212 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.895981 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bfd2h" Jul 12 16:24:30.963045 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.963018 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-gl9gj"] Jul 12 16:24:30.965926 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:30.965900 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bvl9s"] Jul 12 16:24:30.970370 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:24:30.970347 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0710e54e_dec4_4fd6_be9f_a923266bf153.slice/crio-a292216665e948c7a3429ebd478fd6caa855cd757280cc93bce3cc126ab809bb WatchSource:0}: Error finding container a292216665e948c7a3429ebd478fd6caa855cd757280cc93bce3cc126ab809bb: Status 404 returned error can't find the container with id a292216665e948c7a3429ebd478fd6caa855cd757280cc93bce3cc126ab809bb Jul 12 16:24:30.972017 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:24:30.971990 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaab24fb_7114_4a9f_a622_de960b401c40.slice/crio-fa2ce3508e6f514dbdee0ee811f7607aaa1c2b9f25335591cebbb6136d997963 WatchSource:0}: Error finding container fa2ce3508e6f514dbdee0ee811f7607aaa1c2b9f25335591cebbb6136d997963: Status 404 returned error can't find the container with id fa2ce3508e6f514dbdee0ee811f7607aaa1c2b9f25335591cebbb6136d997963 Jul 12 16:24:31.055016 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:31.054424 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:24:31.055016 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:31.054624 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:24:31.059663 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:31.058669 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 12 16:24:31.059663 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:31.058723 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2zz4s\"" Jul 12 16:24:31.121671 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:31.121243 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-rqghp"] Jul 12 16:24:31.124251 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:31.124227 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bfd2h"] Jul 12 16:24:31.135359 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:31.135336 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-msnlw"] Jul 12 16:24:31.138822 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:31.138801 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-tkdsp"] Jul 12 16:24:31.141962 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:24:31.141940 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0deee09d_6830_46ab_b752_083e182d70ed.slice/crio-f3226a2b06936b06b14656e617db145c1d3162581036e2ad8867b04a4a88c0d0 WatchSource:0}: Error finding container f3226a2b06936b06b14656e617db145c1d3162581036e2ad8867b04a4a88c0d0: Status 404 returned error can't find the container with id f3226a2b06936b06b14656e617db145c1d3162581036e2ad8867b04a4a88c0d0 Jul 12 16:24:31.148449 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:24:31.148420 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d81524_c036_4b18_a3ec_74f2e318fd2e.slice/crio-3a473efcc1663dd315a0e0c34869f7592a1b630739bcfae81a0ab408b8ee2b86 WatchSource:0}: Error finding container 3a473efcc1663dd315a0e0c34869f7592a1b630739bcfae81a0ab408b8ee2b86: Status 404 returned error can't find the container with id 3a473efcc1663dd315a0e0c34869f7592a1b630739bcfae81a0ab408b8ee2b86 Jul 12 16:24:31.150630 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:24:31.150601 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24ec1189_1069_45cb_b2de_11141419b010.slice/crio-59dbf278f17b20dd65d078f3c60ad076098937602deee94ce67053b4490e35a3 WatchSource:0}: Error finding container 59dbf278f17b20dd65d078f3c60ad076098937602deee94ce67053b4490e35a3: Status 404 returned error can't find the container with id 59dbf278f17b20dd65d078f3c60ad076098937602deee94ce67053b4490e35a3 Jul 12 16:24:31.170883 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:31.170860 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-tls\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:31.171012 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:31.170998 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 12 16:24:31.171050 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:31.171014 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5985f48fd5-s5dqd: secret "image-registry-tls" not found Jul 12 16:24:31.171084 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:31.171062 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-tls podName:742214ce-0dc3-454c-9b09-d44dc878e3cd nodeName:}" failed. No retries permitted until 2026-07-12 16:24:32.171046001 +0000 UTC m=+38.624433965 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-tls") pod "image-registry-5985f48fd5-s5dqd" (UID: "742214ce-0dc3-454c-9b09-d44dc878e3cd") : secret "image-registry-tls" not found Jul 12 16:24:31.261736 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:31.261688 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-msnlw" event={"ID":"24ec1189-1069-45cb-b2de-11141419b010","Type":"ContainerStarted","Data":"59dbf278f17b20dd65d078f3c60ad076098937602deee94ce67053b4490e35a3"} Jul 12 16:24:31.262796 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:31.262773 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bfd2h" event={"ID":"39d81524-c036-4b18-a3ec-74f2e318fd2e","Type":"ContainerStarted","Data":"3a473efcc1663dd315a0e0c34869f7592a1b630739bcfae81a0ab408b8ee2b86"} Jul 12 16:24:31.263791 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:31.263774 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-rqghp" event={"ID":"0deee09d-6830-46ab-b752-083e182d70ed","Type":"ContainerStarted","Data":"f3226a2b06936b06b14656e617db145c1d3162581036e2ad8867b04a4a88c0d0"} Jul 12 16:24:31.264759 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:31.264736 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bvl9s" event={"ID":"0710e54e-dec4-4fd6-be9f-a923266bf153","Type":"ContainerStarted","Data":"a292216665e948c7a3429ebd478fd6caa855cd757280cc93bce3cc126ab809bb"} Jul 12 16:24:31.265761 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:31.265742 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-tkdsp" event={"ID":"915fc3cf-e62f-4444-8024-c5b71d88fd3c","Type":"ContainerStarted","Data":"d2e4f44562c3f820ed10ccedcb2e9367f24bbdfc00aeb5de23246ca4aab4c1ac"} Jul 12 16:24:31.266837 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:31.266809 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-gl9gj" event={"ID":"aaab24fb-7114-4a9f-a622-de960b401c40","Type":"ContainerStarted","Data":"fa2ce3508e6f514dbdee0ee811f7607aaa1c2b9f25335591cebbb6136d997963"} Jul 12 16:24:31.269595 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:31.269577 2559 generic.go:356] "Generic (PLEG): container finished" podID="cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559" containerID="3385681a826f751979242205bd90832b0721f01d7222184f37c4beb5898dabab" exitCode=0 Jul 12 16:24:31.269662 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:31.269609 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hztg9" event={"ID":"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559","Type":"ContainerDied","Data":"3385681a826f751979242205bd90832b0721f01d7222184f37c4beb5898dabab"} Jul 12 16:24:31.271502 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:31.271482 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/18f6ae2d-f089-45ff-88bc-87fde221a451-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mcrbc\" (UID: \"18f6ae2d-f089-45ff-88bc-87fde221a451\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcrbc" Jul 12 16:24:31.271574 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:31.271543 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/858081cc-8c94-4852-a450-c2e699e9b42d-metrics-tls\") pod \"dns-default-cmxw4\" (UID: \"858081cc-8c94-4852-a450-c2e699e9b42d\") " pod="openshift-dns/dns-default-cmxw4" Jul 12 16:24:31.271639 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:31.271623 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 12 16:24:31.271688 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:31.271679 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f6ae2d-f089-45ff-88bc-87fde221a451-samples-operator-tls podName:18f6ae2d-f089-45ff-88bc-87fde221a451 nodeName:}" failed. No retries permitted until 2026-07-12 16:24:32.271661767 +0000 UTC m=+38.725049731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/18f6ae2d-f089-45ff-88bc-87fde221a451-samples-operator-tls") pod "cluster-samples-operator-65db858894-mcrbc" (UID: "18f6ae2d-f089-45ff-88bc-87fde221a451") : secret "samples-operator-tls" not found Jul 12 16:24:31.271750 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:31.271689 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 16:24:31.271750 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:31.271744 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/858081cc-8c94-4852-a450-c2e699e9b42d-metrics-tls podName:858081cc-8c94-4852-a450-c2e699e9b42d nodeName:}" failed. No retries permitted until 2026-07-12 16:24:32.27172741 +0000 UTC m=+38.725115395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/858081cc-8c94-4852-a450-c2e699e9b42d-metrics-tls") pod "dns-default-cmxw4" (UID: "858081cc-8c94-4852-a450-c2e699e9b42d") : secret "dns-default-metrics-tls" not found Jul 12 16:24:32.054024 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:32.053939 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:24:32.057456 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:32.057429 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 12 16:24:32.057752 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:32.057733 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kpptc\"" Jul 12 16:24:32.181034 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:32.180988 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-tls\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:32.181220 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:32.181202 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 12 16:24:32.181220 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:32.181215 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5985f48fd5-s5dqd: secret "image-registry-tls" not found Jul 12 16:24:32.181303 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:32.181268 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-tls podName:742214ce-0dc3-454c-9b09-d44dc878e3cd nodeName:}" failed. No retries permitted until 2026-07-12 16:24:34.181254137 +0000 UTC m=+40.634642114 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-tls") pod "image-registry-5985f48fd5-s5dqd" (UID: "742214ce-0dc3-454c-9b09-d44dc878e3cd") : secret "image-registry-tls" not found Jul 12 16:24:32.281474 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:32.281442 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/858081cc-8c94-4852-a450-c2e699e9b42d-metrics-tls\") pod \"dns-default-cmxw4\" (UID: \"858081cc-8c94-4852-a450-c2e699e9b42d\") " pod="openshift-dns/dns-default-cmxw4" Jul 12 16:24:32.281659 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:32.281551 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/18f6ae2d-f089-45ff-88bc-87fde221a451-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mcrbc\" (UID: \"18f6ae2d-f089-45ff-88bc-87fde221a451\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcrbc" Jul 12 16:24:32.281737 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:32.281710 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 12 16:24:32.281788 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:32.281765 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f6ae2d-f089-45ff-88bc-87fde221a451-samples-operator-tls podName:18f6ae2d-f089-45ff-88bc-87fde221a451 nodeName:}" failed. No retries permitted until 2026-07-12 16:24:34.281748303 +0000 UTC m=+40.735136273 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/18f6ae2d-f089-45ff-88bc-87fde221a451-samples-operator-tls") pod "cluster-samples-operator-65db858894-mcrbc" (UID: "18f6ae2d-f089-45ff-88bc-87fde221a451") : secret "samples-operator-tls" not found Jul 12 16:24:32.282404 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:32.282292 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 16:24:32.282404 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:32.282346 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/858081cc-8c94-4852-a450-c2e699e9b42d-metrics-tls podName:858081cc-8c94-4852-a450-c2e699e9b42d nodeName:}" failed. No retries permitted until 2026-07-12 16:24:34.282331242 +0000 UTC m=+40.735719207 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/858081cc-8c94-4852-a450-c2e699e9b42d-metrics-tls") pod "dns-default-cmxw4" (UID: "858081cc-8c94-4852-a450-c2e699e9b42d") : secret "dns-default-metrics-tls" not found Jul 12 16:24:32.283927 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:32.282976 2559 generic.go:356] "Generic (PLEG): container finished" podID="cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559" containerID="45a7ca6ffccb7524017a8456f577ba79482fe53e80d2b1f4821cdbc3f1c7295e" exitCode=0 Jul 12 16:24:32.283927 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:32.283056 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hztg9" event={"ID":"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559","Type":"ContainerDied","Data":"45a7ca6ffccb7524017a8456f577ba79482fe53e80d2b1f4821cdbc3f1c7295e"} Jul 12 16:24:33.290973 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:33.290722 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hztg9" event={"ID":"cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559","Type":"ContainerStarted","Data":"689b8bdfa5590485778b7b99b4660ab4dd15c20ee000d48202798ac6bcf0f7ac"} Jul 12 16:24:33.315745 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:33.315696 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hztg9" podStartSLOduration=6.670006711 podStartE2EDuration="38.315677298s" totalImagesPullingTime="31.645670587s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:23:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:24:33.315267839 +0000 UTC m=+39.768655827" watchObservedRunningTime="2026-07-12 16:24:33.315677298 +0000 UTC m=+39.769065284" Jul 12 16:24:34.203448 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:34.203409 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-tls\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:34.203667 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:34.203591 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 12 16:24:34.203667 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:34.203615 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5985f48fd5-s5dqd: secret "image-registry-tls" not found Jul 12 16:24:34.203761 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:34.203675 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-tls podName:742214ce-0dc3-454c-9b09-d44dc878e3cd nodeName:}" failed. No retries permitted until 2026-07-12 16:24:38.203658896 +0000 UTC m=+44.657046860 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-tls") pod "image-registry-5985f48fd5-s5dqd" (UID: "742214ce-0dc3-454c-9b09-d44dc878e3cd") : secret "image-registry-tls" not found Jul 12 16:24:34.304029 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:34.303991 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/858081cc-8c94-4852-a450-c2e699e9b42d-metrics-tls\") pod \"dns-default-cmxw4\" (UID: \"858081cc-8c94-4852-a450-c2e699e9b42d\") " pod="openshift-dns/dns-default-cmxw4" Jul 12 16:24:34.304490 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:34.304114 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/18f6ae2d-f089-45ff-88bc-87fde221a451-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mcrbc\" (UID: \"18f6ae2d-f089-45ff-88bc-87fde221a451\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcrbc" Jul 12 16:24:34.304490 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:34.304187 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 16:24:34.304490 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:34.304234 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 12 16:24:34.304490 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:34.304270 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/858081cc-8c94-4852-a450-c2e699e9b42d-metrics-tls podName:858081cc-8c94-4852-a450-c2e699e9b42d nodeName:}" failed. No retries permitted until 2026-07-12 16:24:38.304250956 +0000 UTC m=+44.757638923 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/858081cc-8c94-4852-a450-c2e699e9b42d-metrics-tls") pod "dns-default-cmxw4" (UID: "858081cc-8c94-4852-a450-c2e699e9b42d") : secret "dns-default-metrics-tls" not found Jul 12 16:24:34.304490 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:34.304290 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f6ae2d-f089-45ff-88bc-87fde221a451-samples-operator-tls podName:18f6ae2d-f089-45ff-88bc-87fde221a451 nodeName:}" failed. No retries permitted until 2026-07-12 16:24:38.304280427 +0000 UTC m=+44.757668395 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/18f6ae2d-f089-45ff-88bc-87fde221a451-samples-operator-tls") pod "cluster-samples-operator-65db858894-mcrbc" (UID: "18f6ae2d-f089-45ff-88bc-87fde221a451") : secret "samples-operator-tls" not found Jul 12 16:24:38.241849 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:38.241823 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-tls\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:38.242346 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:38.241974 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 12 16:24:38.242346 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:38.241993 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5985f48fd5-s5dqd: secret "image-registry-tls" not found Jul 12 16:24:38.242346 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:38.242050 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-tls podName:742214ce-0dc3-454c-9b09-d44dc878e3cd nodeName:}" failed. No retries permitted until 2026-07-12 16:24:46.242035374 +0000 UTC m=+52.695423341 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-tls") pod "image-registry-5985f48fd5-s5dqd" (UID: "742214ce-0dc3-454c-9b09-d44dc878e3cd") : secret "image-registry-tls" not found Jul 12 16:24:38.310404 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:38.310329 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-msnlw" event={"ID":"24ec1189-1069-45cb-b2de-11141419b010","Type":"ContainerStarted","Data":"9af27ada7f94bdfe471cd4bfcd7ca19d65d203e506d3621ada5f8db51b304466"} Jul 12 16:24:38.312890 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:38.312857 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-rqghp" event={"ID":"0deee09d-6830-46ab-b752-083e182d70ed","Type":"ContainerStarted","Data":"33afd05a88b3b77ec35d334b3cdf49e8d4a2ad6059c0f163751b5ed36e6f77b6"} Jul 12 16:24:38.343774 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:38.342862 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/858081cc-8c94-4852-a450-c2e699e9b42d-metrics-tls\") pod \"dns-default-cmxw4\" (UID: \"858081cc-8c94-4852-a450-c2e699e9b42d\") " pod="openshift-dns/dns-default-cmxw4" Jul 12 16:24:38.343774 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:38.342985 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/18f6ae2d-f089-45ff-88bc-87fde221a451-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mcrbc\" (UID: \"18f6ae2d-f089-45ff-88bc-87fde221a451\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcrbc" Jul 12 16:24:38.343774 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:38.343200 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 12 16:24:38.343774 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:38.343268 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f6ae2d-f089-45ff-88bc-87fde221a451-samples-operator-tls podName:18f6ae2d-f089-45ff-88bc-87fde221a451 nodeName:}" failed. No retries permitted until 2026-07-12 16:24:46.343248457 +0000 UTC m=+52.796636442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/18f6ae2d-f089-45ff-88bc-87fde221a451-samples-operator-tls") pod "cluster-samples-operator-65db858894-mcrbc" (UID: "18f6ae2d-f089-45ff-88bc-87fde221a451") : secret "samples-operator-tls" not found Jul 12 16:24:38.343774 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:38.343691 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 16:24:38.343774 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:38.343747 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/858081cc-8c94-4852-a450-c2e699e9b42d-metrics-tls podName:858081cc-8c94-4852-a450-c2e699e9b42d nodeName:}" failed. No retries permitted until 2026-07-12 16:24:46.343730114 +0000 UTC m=+52.797118085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/858081cc-8c94-4852-a450-c2e699e9b42d-metrics-tls") pod "dns-default-cmxw4" (UID: "858081cc-8c94-4852-a450-c2e699e9b42d") : secret "dns-default-metrics-tls" not found Jul 12 16:24:39.320412 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:39.320137 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-tkdsp" event={"ID":"915fc3cf-e62f-4444-8024-c5b71d88fd3c","Type":"ContainerStarted","Data":"adea38e7ea85b184d47731a4a7490619554986e87b8969af36d64073cbd970c2"} Jul 12 16:24:39.322241 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:39.322163 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-gl9gj" event={"ID":"aaab24fb-7114-4a9f-a622-de960b401c40","Type":"ContainerStarted","Data":"e3b795fc026cf49d184fd2dea57a08a17dab144d932f6782470d62bf77599510"} Jul 12 16:24:39.323854 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:39.323822 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bfd2h" event={"ID":"39d81524-c036-4b18-a3ec-74f2e318fd2e","Type":"ContainerStarted","Data":"278ac99a654acbb78ed8ae1a5b3273750f8528935b688bd276013b0db2ffeb94"} Jul 12 16:24:39.325557 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:39.325540 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/0.log" Jul 12 16:24:39.325660 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:39.325576 2559 generic.go:356] "Generic (PLEG): container finished" podID="0deee09d-6830-46ab-b752-083e182d70ed" containerID="33afd05a88b3b77ec35d334b3cdf49e8d4a2ad6059c0f163751b5ed36e6f77b6" exitCode=255 Jul 12 16:24:39.325660 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:39.325648 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-rqghp" event={"ID":"0deee09d-6830-46ab-b752-083e182d70ed","Type":"ContainerDied","Data":"33afd05a88b3b77ec35d334b3cdf49e8d4a2ad6059c0f163751b5ed36e6f77b6"} Jul 12 16:24:39.325839 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:39.325807 2559 scope.go:117] "RemoveContainer" containerID="33afd05a88b3b77ec35d334b3cdf49e8d4a2ad6059c0f163751b5ed36e6f77b6" Jul 12 16:24:39.327243 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:39.327226 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bvl9s" event={"ID":"0710e54e-dec4-4fd6-be9f-a923266bf153","Type":"ContainerStarted","Data":"c55814c17d07ab29e33acf510e6d5a54604600da7621c9fd478c4b3f6a97ea5f"} Jul 12 16:24:39.339005 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:39.338959 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-tkdsp" podStartSLOduration=16.361016469 podStartE2EDuration="23.338941557s" totalImagesPullingTime="6.977925088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:24:39.338298044 +0000 UTC m=+45.791686031" watchObservedRunningTime="2026-07-12 16:24:39.338941557 +0000 UTC m=+45.792329541" Jul 12 16:24:39.339418 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:39.339388 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-msnlw" podStartSLOduration=28.603894635 podStartE2EDuration="35.339377256s" totalImagesPullingTime="6.735482621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:24:38.32456939 +0000 UTC m=+44.777957370" watchObservedRunningTime="2026-07-12 16:24:39.339377256 +0000 UTC m=+45.792765241" Jul 12 16:24:39.371416 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:39.371367 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-gl9gj" podStartSLOduration=28.215316598 podStartE2EDuration="35.371345233s" totalImagesPullingTime="7.156028635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:24:39.369644688 +0000 UTC m=+45.823032673" watchObservedRunningTime="2026-07-12 16:24:39.371345233 +0000 UTC m=+45.824733221" Jul 12 16:24:39.392128 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:39.390432 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bvl9s" podStartSLOduration=28.233954291 podStartE2EDuration="35.390402797s" totalImagesPullingTime="7.156448506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:24:39.3883567 +0000 UTC m=+45.841744690" watchObservedRunningTime="2026-07-12 16:24:39.390402797 +0000 UTC m=+45.843790780" Jul 12 16:24:39.416038 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:39.415990 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bfd2h" podStartSLOduration=2.430937268 podStartE2EDuration="9.415972064s" totalImagesPullingTime="6.985034796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:24:39.414804016 +0000 UTC m=+45.868192002" watchObservedRunningTime="2026-07-12 16:24:39.415972064 +0000 UTC m=+45.869360058" Jul 12 16:24:40.333065 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:40.333037 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/1.log" Jul 12 16:24:40.333599 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:40.333455 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/0.log" Jul 12 16:24:40.333599 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:40.333484 2559 generic.go:356] "Generic (PLEG): container finished" podID="0deee09d-6830-46ab-b752-083e182d70ed" containerID="70fe5cf756e5d8544f8768a826abb497c9919bb5b185f066e72a005d24b6e9db" exitCode=255 Jul 12 16:24:40.333719 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:40.333589 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-rqghp" event={"ID":"0deee09d-6830-46ab-b752-083e182d70ed","Type":"ContainerDied","Data":"70fe5cf756e5d8544f8768a826abb497c9919bb5b185f066e72a005d24b6e9db"} Jul 12 16:24:40.333719 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:40.333665 2559 scope.go:117] "RemoveContainer" containerID="33afd05a88b3b77ec35d334b3cdf49e8d4a2ad6059c0f163751b5ed36e6f77b6" Jul 12 16:24:40.333949 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:40.333922 2559 scope.go:117] "RemoveContainer" containerID="70fe5cf756e5d8544f8768a826abb497c9919bb5b185f066e72a005d24b6e9db" Jul 12 16:24:40.334143 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:40.334122 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-rqghp_openshift-console-operator(0deee09d-6830-46ab-b752-083e182d70ed)\"" pod="openshift-console-operator/console-operator-7866497494-rqghp" podUID="0deee09d-6830-46ab-b752-083e182d70ed" Jul 12 16:24:40.802701 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:40.802663 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-rqghp" Jul 12 16:24:40.802909 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:40.802737 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-rqghp" Jul 12 16:24:41.338478 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:41.338448 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/1.log" Jul 12 16:24:41.338863 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:41.338795 2559 scope.go:117] "RemoveContainer" containerID="70fe5cf756e5d8544f8768a826abb497c9919bb5b185f066e72a005d24b6e9db" Jul 12 16:24:41.338953 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:41.338933 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-rqghp_openshift-console-operator(0deee09d-6830-46ab-b752-083e182d70ed)\"" pod="openshift-console-operator/console-operator-7866497494-rqghp" podUID="0deee09d-6830-46ab-b752-083e182d70ed" Jul 12 16:24:42.342106 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:42.342061 2559 scope.go:117] "RemoveContainer" containerID="70fe5cf756e5d8544f8768a826abb497c9919bb5b185f066e72a005d24b6e9db" Jul 12 16:24:42.342520 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:42.342237 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-rqghp_openshift-console-operator(0deee09d-6830-46ab-b752-083e182d70ed)\"" pod="openshift-console-operator/console-operator-7866497494-rqghp" podUID="0deee09d-6830-46ab-b752-083e182d70ed" Jul 12 16:24:46.303333 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:46.303295 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-tls\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:24:46.303883 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:46.303480 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 12 16:24:46.303883 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:46.303507 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5985f48fd5-s5dqd: secret "image-registry-tls" not found Jul 12 16:24:46.303883 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:46.303594 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-tls podName:742214ce-0dc3-454c-9b09-d44dc878e3cd nodeName:}" failed. No retries permitted until 2026-07-12 16:25:02.303572233 +0000 UTC m=+68.756960201 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-tls") pod "image-registry-5985f48fd5-s5dqd" (UID: "742214ce-0dc3-454c-9b09-d44dc878e3cd") : secret "image-registry-tls" not found Jul 12 16:24:46.403631 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:46.403594 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/858081cc-8c94-4852-a450-c2e699e9b42d-metrics-tls\") pod \"dns-default-cmxw4\" (UID: \"858081cc-8c94-4852-a450-c2e699e9b42d\") " pod="openshift-dns/dns-default-cmxw4" Jul 12 16:24:46.403836 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:46.403706 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/18f6ae2d-f089-45ff-88bc-87fde221a451-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mcrbc\" (UID: \"18f6ae2d-f089-45ff-88bc-87fde221a451\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcrbc" Jul 12 16:24:46.403836 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:46.403750 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 16:24:46.403836 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:46.403811 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/858081cc-8c94-4852-a450-c2e699e9b42d-metrics-tls podName:858081cc-8c94-4852-a450-c2e699e9b42d nodeName:}" failed. No retries permitted until 2026-07-12 16:25:02.403794712 +0000 UTC m=+68.857182675 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/858081cc-8c94-4852-a450-c2e699e9b42d-metrics-tls") pod "dns-default-cmxw4" (UID: "858081cc-8c94-4852-a450-c2e699e9b42d") : secret "dns-default-metrics-tls" not found Jul 12 16:24:46.403991 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:46.403840 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 12 16:24:46.403991 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:46.403904 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f6ae2d-f089-45ff-88bc-87fde221a451-samples-operator-tls podName:18f6ae2d-f089-45ff-88bc-87fde221a451 nodeName:}" failed. No retries permitted until 2026-07-12 16:25:02.403886843 +0000 UTC m=+68.857274810 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/18f6ae2d-f089-45ff-88bc-87fde221a451-samples-operator-tls") pod "cluster-samples-operator-65db858894-mcrbc" (UID: "18f6ae2d-f089-45ff-88bc-87fde221a451") : secret "samples-operator-tls" not found Jul 12 16:24:54.055241 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:54.055207 2559 scope.go:117] "RemoveContainer" containerID="70fe5cf756e5d8544f8768a826abb497c9919bb5b185f066e72a005d24b6e9db" Jul 12 16:24:54.377355 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:54.377283 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/2.log" Jul 12 16:24:54.377693 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:54.377680 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/1.log" Jul 12 16:24:54.377766 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:54.377712 2559 generic.go:356] "Generic (PLEG): container finished" podID="0deee09d-6830-46ab-b752-083e182d70ed" containerID="c1b22cd6ce4739e8dbfa65bcedeaf4e8b1fb2b57698d6525fac9c096a78da6eb" exitCode=255 Jul 12 16:24:54.377802 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:54.377765 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-rqghp" event={"ID":"0deee09d-6830-46ab-b752-083e182d70ed","Type":"ContainerDied","Data":"c1b22cd6ce4739e8dbfa65bcedeaf4e8b1fb2b57698d6525fac9c096a78da6eb"} Jul 12 16:24:54.377842 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:54.377816 2559 scope.go:117] "RemoveContainer" containerID="70fe5cf756e5d8544f8768a826abb497c9919bb5b185f066e72a005d24b6e9db" Jul 12 16:24:54.378160 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:54.378139 2559 scope.go:117] "RemoveContainer" containerID="c1b22cd6ce4739e8dbfa65bcedeaf4e8b1fb2b57698d6525fac9c096a78da6eb" Jul 12 16:24:54.378343 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:24:54.378313 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-rqghp_openshift-console-operator(0deee09d-6830-46ab-b752-083e182d70ed)\"" pod="openshift-console-operator/console-operator-7866497494-rqghp" podUID="0deee09d-6830-46ab-b752-083e182d70ed" Jul 12 16:24:55.257505 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:55.257474 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vg4zm" Jul 12 16:24:55.382135 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:55.382109 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/2.log" Jul 12 16:24:59.814618 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:59.814581 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccd1221a-8ea7-4bba-ba15-999ca853321e-metrics-certs\") pod \"network-metrics-daemon-vjfj4\" (UID: \"ccd1221a-8ea7-4bba-ba15-999ca853321e\") " pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:24:59.817328 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:59.817308 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 12 16:24:59.829757 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:59.829735 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccd1221a-8ea7-4bba-ba15-999ca853321e-metrics-certs\") pod \"network-metrics-daemon-vjfj4\" (UID: \"ccd1221a-8ea7-4bba-ba15-999ca853321e\") " pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:24:59.915154 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:59.915118 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbq2q\" (UniqueName: \"kubernetes.io/projected/537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1-kube-api-access-nbq2q\") pod \"network-check-target-8d275\" (UID: \"537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1\") " pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:24:59.915311 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:59.915192 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-original-pull-secret\") pod \"global-pull-secret-syncer-8l4qq\" (UID: \"9ef6eef5-8bcb-409b-92c8-8be3c0632ec9\") " pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:24:59.917735 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:59.917709 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbq2q\" (UniqueName: \"kubernetes.io/projected/537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1-kube-api-access-nbq2q\") pod \"network-check-target-8d275\" (UID: \"537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1\") " pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:24:59.918179 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:59.918164 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 12 16:24:59.928175 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:59.928152 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ef6eef5-8bcb-409b-92c8-8be3c0632ec9-original-pull-secret\") pod \"global-pull-secret-syncer-8l4qq\" (UID: \"9ef6eef5-8bcb-409b-92c8-8be3c0632ec9\") " pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:24:59.974208 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:59.974180 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kpptc\"" Jul 12 16:24:59.982204 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:24:59.982186 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjfj4" Jul 12 16:25:00.132133 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:00.132080 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vjfj4"] Jul 12 16:25:00.135606 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:25:00.135580 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccd1221a_8ea7_4bba_ba15_999ca853321e.slice/crio-46997fc5d45cfd5de85c05232dcb57a08a638aebb53071b1a7e57222dbb88985 WatchSource:0}: Error finding container 46997fc5d45cfd5de85c05232dcb57a08a638aebb53071b1a7e57222dbb88985: Status 404 returned error can't find the container with id 46997fc5d45cfd5de85c05232dcb57a08a638aebb53071b1a7e57222dbb88985 Jul 12 16:25:00.170804 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:00.170776 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2zz4s\"" Jul 12 16:25:00.177004 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:00.176982 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l4qq" Jul 12 16:25:00.179118 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:00.179083 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:25:00.332207 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:00.332178 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8l4qq"] Jul 12 16:25:00.335646 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:25:00.335574 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ef6eef5_8bcb_409b_92c8_8be3c0632ec9.slice/crio-72f8b36cbd4a479fb485c2a86f54a3f0120aee03b30893b36a918ebac299f511 WatchSource:0}: Error finding container 72f8b36cbd4a479fb485c2a86f54a3f0120aee03b30893b36a918ebac299f511: Status 404 returned error can't find the container with id 72f8b36cbd4a479fb485c2a86f54a3f0120aee03b30893b36a918ebac299f511 Jul 12 16:25:00.368365 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:00.368341 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8d275"] Jul 12 16:25:00.381712 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:25:00.381674 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod537ac4f2_4461_4b35_9dd8_8f9a2b4a35d1.slice/crio-f029d6f3a6565b63599e1de75b910662b0f492e8ecaa464eced714fec03d2120 WatchSource:0}: Error finding container f029d6f3a6565b63599e1de75b910662b0f492e8ecaa464eced714fec03d2120: Status 404 returned error can't find the container with id f029d6f3a6565b63599e1de75b910662b0f492e8ecaa464eced714fec03d2120 Jul 12 16:25:00.397204 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:00.397169 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vjfj4" event={"ID":"ccd1221a-8ea7-4bba-ba15-999ca853321e","Type":"ContainerStarted","Data":"46997fc5d45cfd5de85c05232dcb57a08a638aebb53071b1a7e57222dbb88985"} Jul 12 16:25:00.398321 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:00.398290 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8d275" event={"ID":"537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1","Type":"ContainerStarted","Data":"f029d6f3a6565b63599e1de75b910662b0f492e8ecaa464eced714fec03d2120"} Jul 12 16:25:00.399306 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:00.399283 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8l4qq" event={"ID":"9ef6eef5-8bcb-409b-92c8-8be3c0632ec9","Type":"ContainerStarted","Data":"72f8b36cbd4a479fb485c2a86f54a3f0120aee03b30893b36a918ebac299f511"} Jul 12 16:25:00.803698 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:00.803653 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-rqghp" Jul 12 16:25:00.803866 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:00.803724 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-rqghp" Jul 12 16:25:00.804141 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:00.804115 2559 scope.go:117] "RemoveContainer" containerID="c1b22cd6ce4739e8dbfa65bcedeaf4e8b1fb2b57698d6525fac9c096a78da6eb" Jul 12 16:25:00.804313 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:25:00.804289 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-rqghp_openshift-console-operator(0deee09d-6830-46ab-b752-083e182d70ed)\"" pod="openshift-console-operator/console-operator-7866497494-rqghp" podUID="0deee09d-6830-46ab-b752-083e182d70ed" Jul 12 16:25:01.409592 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:01.409556 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8d275" event={"ID":"537ac4f2-4461-4b35-9dd8-8f9a2b4a35d1","Type":"ContainerStarted","Data":"005aed2d4a5ec3da18e4326d75956a28be761927599799ca4829b462779293ce"} Jul 12 16:25:01.409990 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:01.409718 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:25:01.431025 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:01.430979 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8d275" podStartSLOduration=67.430958635 podStartE2EDuration="1m7.430958635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:23:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:01.429994853 +0000 UTC m=+67.883382839" watchObservedRunningTime="2026-07-12 16:25:01.430958635 +0000 UTC m=+67.884346623" Jul 12 16:25:02.335197 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:02.335152 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-tls\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:25:02.337782 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:02.337747 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-tls\") pod \"image-registry-5985f48fd5-s5dqd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:25:02.414818 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:02.414777 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vjfj4" event={"ID":"ccd1221a-8ea7-4bba-ba15-999ca853321e","Type":"ContainerStarted","Data":"bcd2e7f0dad07a372b12322d50bdde498b33b5edaa8085cc151a28769e7b29cc"} Jul 12 16:25:02.415266 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:02.414852 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vjfj4" event={"ID":"ccd1221a-8ea7-4bba-ba15-999ca853321e","Type":"ContainerStarted","Data":"e1bb114bd903c69978ac73266108719b84ec94b350c2c097a068ab310659140d"} Jul 12 16:25:02.433070 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:02.433016 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vjfj4" podStartSLOduration=67.261270202 podStartE2EDuration="1m8.433001465s" totalImagesPullingTime="1.171731263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:02.431767362 +0000 UTC m=+68.885155349" watchObservedRunningTime="2026-07-12 16:25:02.433001465 +0000 UTC m=+68.886389450" Jul 12 16:25:02.435520 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:02.435497 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/858081cc-8c94-4852-a450-c2e699e9b42d-metrics-tls\") pod \"dns-default-cmxw4\" (UID: \"858081cc-8c94-4852-a450-c2e699e9b42d\") " pod="openshift-dns/dns-default-cmxw4" Jul 12 16:25:02.435586 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:02.435548 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/18f6ae2d-f089-45ff-88bc-87fde221a451-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mcrbc\" (UID: \"18f6ae2d-f089-45ff-88bc-87fde221a451\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcrbc" Jul 12 16:25:02.438048 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:02.438013 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/858081cc-8c94-4852-a450-c2e699e9b42d-metrics-tls\") pod \"dns-default-cmxw4\" (UID: \"858081cc-8c94-4852-a450-c2e699e9b42d\") " pod="openshift-dns/dns-default-cmxw4" Jul 12 16:25:02.438171 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:02.438052 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/18f6ae2d-f089-45ff-88bc-87fde221a451-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mcrbc\" (UID: \"18f6ae2d-f089-45ff-88bc-87fde221a451\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcrbc" Jul 12 16:25:02.531935 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:02.531905 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vtt9v\"" Jul 12 16:25:02.540186 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:02.540149 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:25:02.636998 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:02.636967 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-49fd5\"" Jul 12 16:25:02.644401 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:02.644361 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcrbc" Jul 12 16:25:02.673061 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:02.673034 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j2h6m\"" Jul 12 16:25:02.680314 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:02.680286 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cmxw4" Jul 12 16:25:02.700640 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:02.699990 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5985f48fd5-s5dqd"] Jul 12 16:25:02.712553 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:25:02.707433 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod742214ce_0dc3_454c_9b09_d44dc878e3cd.slice/crio-117485b0e4c6d3946adc4aa68cafba7b854fd85938daf0c2e2f89a12cf117800 WatchSource:0}: Error finding container 117485b0e4c6d3946adc4aa68cafba7b854fd85938daf0c2e2f89a12cf117800: Status 404 returned error can't find the container with id 117485b0e4c6d3946adc4aa68cafba7b854fd85938daf0c2e2f89a12cf117800 Jul 12 16:25:02.837446 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:02.837411 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcrbc"] Jul 12 16:25:02.855636 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:02.855607 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cmxw4"] Jul 12 16:25:02.858605 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:25:02.858480 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod858081cc_8c94_4852_a450_c2e699e9b42d.slice/crio-267c0f1456e067438a72a26400b042fcbdec1488371cc3d298545b5837f95a57 WatchSource:0}: Error finding container 267c0f1456e067438a72a26400b042fcbdec1488371cc3d298545b5837f95a57: Status 404 returned error can't find the container with id 267c0f1456e067438a72a26400b042fcbdec1488371cc3d298545b5837f95a57 Jul 12 16:25:03.420185 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:03.420146 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cmxw4" event={"ID":"858081cc-8c94-4852-a450-c2e699e9b42d","Type":"ContainerStarted","Data":"267c0f1456e067438a72a26400b042fcbdec1488371cc3d298545b5837f95a57"} Jul 12 16:25:03.422502 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:03.422471 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" event={"ID":"742214ce-0dc3-454c-9b09-d44dc878e3cd","Type":"ContainerStarted","Data":"e30c5220c99c527d717cecf058934fec7a33eb63a30735be70f0aeb4b90a8eb4"} Jul 12 16:25:03.422641 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:03.422520 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" event={"ID":"742214ce-0dc3-454c-9b09-d44dc878e3cd","Type":"ContainerStarted","Data":"117485b0e4c6d3946adc4aa68cafba7b854fd85938daf0c2e2f89a12cf117800"} Jul 12 16:25:03.422641 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:03.422555 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:25:03.424255 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:03.424228 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcrbc" event={"ID":"18f6ae2d-f089-45ff-88bc-87fde221a451","Type":"ContainerStarted","Data":"eeb9edef2b9c69211e60ac035c62b536d890bc99c0d79cf60cdf23a9395113c4"} Jul 12 16:25:03.444074 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:03.444009 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" podStartSLOduration=68.443985314 podStartE2EDuration="1m8.443985314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:23:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:03.442025784 +0000 UTC m=+69.895413773" watchObservedRunningTime="2026-07-12 16:25:03.443985314 +0000 UTC m=+69.897373301" Jul 12 16:25:04.722857 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.722814 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b6fc68976-wkq2x"] Jul 12 16:25:04.726292 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.726266 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b6fc68976-wkq2x" Jul 12 16:25:04.729300 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.729274 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-dkql7\"" Jul 12 16:25:04.730561 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.730537 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 12 16:25:04.730881 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.730864 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 12 16:25:04.730998 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.730865 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 12 16:25:04.731359 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.731340 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 12 16:25:04.747802 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.747767 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b6fc68976-wkq2x"] Jul 12 16:25:04.811740 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.811697 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-6fzkl"] Jul 12 16:25:04.815107 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.815063 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-czbmv"] Jul 12 16:25:04.815264 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.815212 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-6fzkl" Jul 12 16:25:04.818235 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.818214 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-84d8b6c75b-z8cbq"] Jul 12 16:25:04.818359 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.818331 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-czbmv" Jul 12 16:25:04.818771 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.818751 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 12 16:25:04.819256 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.818973 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 12 16:25:04.819256 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.819058 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 12 16:25:04.820034 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.820012 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-svpsv\"" Jul 12 16:25:04.820135 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.820113 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 12 16:25:04.821235 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.821215 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-84d8b6c75b-z8cbq" Jul 12 16:25:04.823279 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.823258 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 12 16:25:04.823562 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.823542 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 12 16:25:04.823812 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.823796 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 12 16:25:04.823928 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.823550 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wn2b4\"" Jul 12 16:25:04.824279 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.824246 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 12 16:25:04.827215 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.827194 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 12 16:25:04.827504 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.827484 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 12 16:25:04.827713 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.827698 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 12 16:25:04.828002 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.827987 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 12 16:25:04.828212 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.828194 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 12 16:25:04.828441 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.828421 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-sc2mj\"" Jul 12 16:25:04.828615 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.828599 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 12 16:25:04.828840 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.828824 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 12 16:25:04.834333 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.834288 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-6fzkl"] Jul 12 16:25:04.835515 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.835490 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-czbmv"] Jul 12 16:25:04.838295 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.838275 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-84d8b6c75b-z8cbq"] Jul 12 16:25:04.853523 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.853496 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5vch\" (UniqueName: \"kubernetes.io/projected/f8a4983d-64c5-4bf8-92fd-383dab1323ba-kube-api-access-g5vch\") pod \"insights-operator-68d9dd94cf-6fzkl\" (UID: \"f8a4983d-64c5-4bf8-92fd-383dab1323ba\") " pod="openshift-insights/insights-operator-68d9dd94cf-6fzkl" Jul 12 16:25:04.853671 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.853534 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fd322d1-8f09-427d-af0b-21ba0d1c2291-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-czbmv\" (UID: \"3fd322d1-8f09-427d-af0b-21ba0d1c2291\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-czbmv" Jul 12 16:25:04.853671 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.853563 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d7f3297c-6de4-4db9-b1a9-df6b0c61dff4-stats-auth\") pod \"router-default-84d8b6c75b-z8cbq\" (UID: \"d7f3297c-6de4-4db9-b1a9-df6b0c61dff4\") " pod="openshift-ingress/router-default-84d8b6c75b-z8cbq" Jul 12 16:25:04.853671 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.853631 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72f5c\" (UniqueName: \"kubernetes.io/projected/d7f3297c-6de4-4db9-b1a9-df6b0c61dff4-kube-api-access-72f5c\") pod \"router-default-84d8b6c75b-z8cbq\" (UID: \"d7f3297c-6de4-4db9-b1a9-df6b0c61dff4\") " pod="openshift-ingress/router-default-84d8b6c75b-z8cbq" Jul 12 16:25:04.853671 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.853667 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/382bdc8c-5c29-47f5-9f35-04afc5737aca-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b6fc68976-wkq2x\" (UID: \"382bdc8c-5c29-47f5-9f35-04afc5737aca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b6fc68976-wkq2x" Jul 12 16:25:04.853872 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.853689 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f8a4983d-64c5-4bf8-92fd-383dab1323ba-snapshots\") pod \"insights-operator-68d9dd94cf-6fzkl\" (UID: \"f8a4983d-64c5-4bf8-92fd-383dab1323ba\") " pod="openshift-insights/insights-operator-68d9dd94cf-6fzkl" Jul 12 16:25:04.853872 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.853807 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8a4983d-64c5-4bf8-92fd-383dab1323ba-tmp\") pod \"insights-operator-68d9dd94cf-6fzkl\" (UID: \"f8a4983d-64c5-4bf8-92fd-383dab1323ba\") " pod="openshift-insights/insights-operator-68d9dd94cf-6fzkl" Jul 12 16:25:04.853872 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.853846 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8a4983d-64c5-4bf8-92fd-383dab1323ba-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-6fzkl\" (UID: \"f8a4983d-64c5-4bf8-92fd-383dab1323ba\") " pod="openshift-insights/insights-operator-68d9dd94cf-6fzkl" Jul 12 16:25:04.853998 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.853875 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2768\" (UniqueName: \"kubernetes.io/projected/382bdc8c-5c29-47f5-9f35-04afc5737aca-kube-api-access-l2768\") pod \"managed-serviceaccount-addon-agent-b6fc68976-wkq2x\" (UID: \"382bdc8c-5c29-47f5-9f35-04afc5737aca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b6fc68976-wkq2x" Jul 12 16:25:04.853998 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.853910 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7f3297c-6de4-4db9-b1a9-df6b0c61dff4-metrics-certs\") pod \"router-default-84d8b6c75b-z8cbq\" (UID: \"d7f3297c-6de4-4db9-b1a9-df6b0c61dff4\") " pod="openshift-ingress/router-default-84d8b6c75b-z8cbq" Jul 12 16:25:04.853998 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.853946 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8a4983d-64c5-4bf8-92fd-383dab1323ba-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-6fzkl\" (UID: \"f8a4983d-64c5-4bf8-92fd-383dab1323ba\") " pod="openshift-insights/insights-operator-68d9dd94cf-6fzkl" Jul 12 16:25:04.853998 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.853966 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2vd2\" (UniqueName: \"kubernetes.io/projected/3fd322d1-8f09-427d-af0b-21ba0d1c2291-kube-api-access-l2vd2\") pod \"cluster-monitoring-operator-5f7f494dd4-czbmv\" (UID: \"3fd322d1-8f09-427d-af0b-21ba0d1c2291\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-czbmv" Jul 12 16:25:04.853998 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.853991 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7f3297c-6de4-4db9-b1a9-df6b0c61dff4-service-ca-bundle\") pod \"router-default-84d8b6c75b-z8cbq\" (UID: \"d7f3297c-6de4-4db9-b1a9-df6b0c61dff4\") " pod="openshift-ingress/router-default-84d8b6c75b-z8cbq" Jul 12 16:25:04.854218 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.854038 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f8a4983d-64c5-4bf8-92fd-383dab1323ba-serving-cert\") pod \"insights-operator-68d9dd94cf-6fzkl\" (UID: \"f8a4983d-64c5-4bf8-92fd-383dab1323ba\") " pod="openshift-insights/insights-operator-68d9dd94cf-6fzkl" Jul 12 16:25:04.854218 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.854081 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3fd322d1-8f09-427d-af0b-21ba0d1c2291-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-czbmv\" (UID: \"3fd322d1-8f09-427d-af0b-21ba0d1c2291\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-czbmv" Jul 12 16:25:04.854218 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.854122 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d7f3297c-6de4-4db9-b1a9-df6b0c61dff4-default-certificate\") pod \"router-default-84d8b6c75b-z8cbq\" (UID: \"d7f3297c-6de4-4db9-b1a9-df6b0c61dff4\") " pod="openshift-ingress/router-default-84d8b6c75b-z8cbq" Jul 12 16:25:04.955328 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.955291 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8a4983d-64c5-4bf8-92fd-383dab1323ba-tmp\") pod \"insights-operator-68d9dd94cf-6fzkl\" (UID: \"f8a4983d-64c5-4bf8-92fd-383dab1323ba\") " pod="openshift-insights/insights-operator-68d9dd94cf-6fzkl" Jul 12 16:25:04.955607 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.955342 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8a4983d-64c5-4bf8-92fd-383dab1323ba-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-6fzkl\" (UID: \"f8a4983d-64c5-4bf8-92fd-383dab1323ba\") " pod="openshift-insights/insights-operator-68d9dd94cf-6fzkl" Jul 12 16:25:04.955607 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.955366 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2768\" (UniqueName: \"kubernetes.io/projected/382bdc8c-5c29-47f5-9f35-04afc5737aca-kube-api-access-l2768\") pod \"managed-serviceaccount-addon-agent-b6fc68976-wkq2x\" (UID: \"382bdc8c-5c29-47f5-9f35-04afc5737aca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b6fc68976-wkq2x" Jul 12 16:25:04.955607 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.955383 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7f3297c-6de4-4db9-b1a9-df6b0c61dff4-metrics-certs\") pod \"router-default-84d8b6c75b-z8cbq\" (UID: \"d7f3297c-6de4-4db9-b1a9-df6b0c61dff4\") " pod="openshift-ingress/router-default-84d8b6c75b-z8cbq" Jul 12 16:25:04.955607 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.955406 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8a4983d-64c5-4bf8-92fd-383dab1323ba-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-6fzkl\" (UID: \"f8a4983d-64c5-4bf8-92fd-383dab1323ba\") " pod="openshift-insights/insights-operator-68d9dd94cf-6fzkl" Jul 12 16:25:04.955607 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.955431 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2vd2\" (UniqueName: \"kubernetes.io/projected/3fd322d1-8f09-427d-af0b-21ba0d1c2291-kube-api-access-l2vd2\") pod \"cluster-monitoring-operator-5f7f494dd4-czbmv\" (UID: \"3fd322d1-8f09-427d-af0b-21ba0d1c2291\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-czbmv" Jul 12 16:25:04.955607 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.955448 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7f3297c-6de4-4db9-b1a9-df6b0c61dff4-service-ca-bundle\") pod \"router-default-84d8b6c75b-z8cbq\" (UID: \"d7f3297c-6de4-4db9-b1a9-df6b0c61dff4\") " pod="openshift-ingress/router-default-84d8b6c75b-z8cbq" Jul 12 16:25:04.955607 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.955471 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f8a4983d-64c5-4bf8-92fd-383dab1323ba-serving-cert\") pod \"insights-operator-68d9dd94cf-6fzkl\" (UID: \"f8a4983d-64c5-4bf8-92fd-383dab1323ba\") " pod="openshift-insights/insights-operator-68d9dd94cf-6fzkl" Jul 12 16:25:04.955607 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.955499 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3fd322d1-8f09-427d-af0b-21ba0d1c2291-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-czbmv\" (UID: \"3fd322d1-8f09-427d-af0b-21ba0d1c2291\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-czbmv" Jul 12 16:25:04.955607 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.955523 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d7f3297c-6de4-4db9-b1a9-df6b0c61dff4-default-certificate\") pod \"router-default-84d8b6c75b-z8cbq\" (UID: \"d7f3297c-6de4-4db9-b1a9-df6b0c61dff4\") " pod="openshift-ingress/router-default-84d8b6c75b-z8cbq" Jul 12 16:25:04.955607 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.955556 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5vch\" (UniqueName: \"kubernetes.io/projected/f8a4983d-64c5-4bf8-92fd-383dab1323ba-kube-api-access-g5vch\") pod \"insights-operator-68d9dd94cf-6fzkl\" (UID: \"f8a4983d-64c5-4bf8-92fd-383dab1323ba\") " pod="openshift-insights/insights-operator-68d9dd94cf-6fzkl" Jul 12 16:25:04.955607 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.955582 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fd322d1-8f09-427d-af0b-21ba0d1c2291-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-czbmv\" (UID: \"3fd322d1-8f09-427d-af0b-21ba0d1c2291\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-czbmv" Jul 12 16:25:04.956182 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.955605 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d7f3297c-6de4-4db9-b1a9-df6b0c61dff4-stats-auth\") pod \"router-default-84d8b6c75b-z8cbq\" (UID: \"d7f3297c-6de4-4db9-b1a9-df6b0c61dff4\") " pod="openshift-ingress/router-default-84d8b6c75b-z8cbq" Jul 12 16:25:04.956182 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.955657 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72f5c\" (UniqueName: \"kubernetes.io/projected/d7f3297c-6de4-4db9-b1a9-df6b0c61dff4-kube-api-access-72f5c\") pod \"router-default-84d8b6c75b-z8cbq\" (UID: \"d7f3297c-6de4-4db9-b1a9-df6b0c61dff4\") " pod="openshift-ingress/router-default-84d8b6c75b-z8cbq" Jul 12 16:25:04.956182 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.955690 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/382bdc8c-5c29-47f5-9f35-04afc5737aca-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b6fc68976-wkq2x\" (UID: \"382bdc8c-5c29-47f5-9f35-04afc5737aca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b6fc68976-wkq2x" Jul 12 16:25:04.956182 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.955719 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f8a4983d-64c5-4bf8-92fd-383dab1323ba-snapshots\") pod \"insights-operator-68d9dd94cf-6fzkl\" (UID: \"f8a4983d-64c5-4bf8-92fd-383dab1323ba\") " pod="openshift-insights/insights-operator-68d9dd94cf-6fzkl" Jul 12 16:25:04.956438 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.956418 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f8a4983d-64c5-4bf8-92fd-383dab1323ba-snapshots\") pod \"insights-operator-68d9dd94cf-6fzkl\" (UID: \"f8a4983d-64c5-4bf8-92fd-383dab1323ba\") " pod="openshift-insights/insights-operator-68d9dd94cf-6fzkl" Jul 12 16:25:04.956503 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.956464 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8a4983d-64c5-4bf8-92fd-383dab1323ba-tmp\") pod \"insights-operator-68d9dd94cf-6fzkl\" (UID: \"f8a4983d-64c5-4bf8-92fd-383dab1323ba\") " pod="openshift-insights/insights-operator-68d9dd94cf-6fzkl" Jul 12 16:25:04.958185 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.957173 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3fd322d1-8f09-427d-af0b-21ba0d1c2291-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-czbmv\" (UID: \"3fd322d1-8f09-427d-af0b-21ba0d1c2291\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-czbmv" Jul 12 16:25:04.958185 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.957831 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8a4983d-64c5-4bf8-92fd-383dab1323ba-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-6fzkl\" (UID: \"f8a4983d-64c5-4bf8-92fd-383dab1323ba\") " pod="openshift-insights/insights-operator-68d9dd94cf-6fzkl" Jul 12 16:25:04.958185 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.957987 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7f3297c-6de4-4db9-b1a9-df6b0c61dff4-service-ca-bundle\") pod \"router-default-84d8b6c75b-z8cbq\" (UID: \"d7f3297c-6de4-4db9-b1a9-df6b0c61dff4\") " pod="openshift-ingress/router-default-84d8b6c75b-z8cbq" Jul 12 16:25:04.958428 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.958239 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8a4983d-64c5-4bf8-92fd-383dab1323ba-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-6fzkl\" (UID: \"f8a4983d-64c5-4bf8-92fd-383dab1323ba\") " pod="openshift-insights/insights-operator-68d9dd94cf-6fzkl" Jul 12 16:25:04.959972 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.959919 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7f3297c-6de4-4db9-b1a9-df6b0c61dff4-metrics-certs\") pod \"router-default-84d8b6c75b-z8cbq\" (UID: \"d7f3297c-6de4-4db9-b1a9-df6b0c61dff4\") " pod="openshift-ingress/router-default-84d8b6c75b-z8cbq" Jul 12 16:25:04.959972 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.959963 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f8a4983d-64c5-4bf8-92fd-383dab1323ba-serving-cert\") pod \"insights-operator-68d9dd94cf-6fzkl\" (UID: \"f8a4983d-64c5-4bf8-92fd-383dab1323ba\") " pod="openshift-insights/insights-operator-68d9dd94cf-6fzkl" Jul 12 16:25:04.961029 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.961004 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fd322d1-8f09-427d-af0b-21ba0d1c2291-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-czbmv\" (UID: \"3fd322d1-8f09-427d-af0b-21ba0d1c2291\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-czbmv" Jul 12 16:25:04.961164 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.961036 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/382bdc8c-5c29-47f5-9f35-04afc5737aca-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b6fc68976-wkq2x\" (UID: \"382bdc8c-5c29-47f5-9f35-04afc5737aca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b6fc68976-wkq2x" Jul 12 16:25:04.961691 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.961651 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d7f3297c-6de4-4db9-b1a9-df6b0c61dff4-default-certificate\") pod \"router-default-84d8b6c75b-z8cbq\" (UID: \"d7f3297c-6de4-4db9-b1a9-df6b0c61dff4\") " pod="openshift-ingress/router-default-84d8b6c75b-z8cbq" Jul 12 16:25:04.961817 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.961796 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d7f3297c-6de4-4db9-b1a9-df6b0c61dff4-stats-auth\") pod \"router-default-84d8b6c75b-z8cbq\" (UID: \"d7f3297c-6de4-4db9-b1a9-df6b0c61dff4\") " pod="openshift-ingress/router-default-84d8b6c75b-z8cbq" Jul 12 16:25:04.970106 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.970063 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5vch\" (UniqueName: \"kubernetes.io/projected/f8a4983d-64c5-4bf8-92fd-383dab1323ba-kube-api-access-g5vch\") pod \"insights-operator-68d9dd94cf-6fzkl\" (UID: \"f8a4983d-64c5-4bf8-92fd-383dab1323ba\") " pod="openshift-insights/insights-operator-68d9dd94cf-6fzkl" Jul 12 16:25:04.970610 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.970585 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2768\" (UniqueName: \"kubernetes.io/projected/382bdc8c-5c29-47f5-9f35-04afc5737aca-kube-api-access-l2768\") pod \"managed-serviceaccount-addon-agent-b6fc68976-wkq2x\" (UID: \"382bdc8c-5c29-47f5-9f35-04afc5737aca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b6fc68976-wkq2x" Jul 12 16:25:04.977934 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.977860 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2vd2\" (UniqueName: \"kubernetes.io/projected/3fd322d1-8f09-427d-af0b-21ba0d1c2291-kube-api-access-l2vd2\") pod \"cluster-monitoring-operator-5f7f494dd4-czbmv\" (UID: \"3fd322d1-8f09-427d-af0b-21ba0d1c2291\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-czbmv" Jul 12 16:25:04.981998 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:04.981970 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72f5c\" (UniqueName: \"kubernetes.io/projected/d7f3297c-6de4-4db9-b1a9-df6b0c61dff4-kube-api-access-72f5c\") pod \"router-default-84d8b6c75b-z8cbq\" (UID: \"d7f3297c-6de4-4db9-b1a9-df6b0c61dff4\") " pod="openshift-ingress/router-default-84d8b6c75b-z8cbq" Jul 12 16:25:05.045359 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:05.045326 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b6fc68976-wkq2x" Jul 12 16:25:05.129623 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:05.129579 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-6fzkl" Jul 12 16:25:05.139605 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:05.139572 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-czbmv" Jul 12 16:25:05.146612 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:05.146586 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-84d8b6c75b-z8cbq" Jul 12 16:25:06.212944 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:06.212782 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-czbmv"] Jul 12 16:25:06.234517 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:25:06.234481 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fd322d1_8f09_427d_af0b_21ba0d1c2291.slice/crio-0b8f5c685d7b4a615538b143a0a10157ca0500cc4d43324d94ae0248a020eb6f WatchSource:0}: Error finding container 0b8f5c685d7b4a615538b143a0a10157ca0500cc4d43324d94ae0248a020eb6f: Status 404 returned error can't find the container with id 0b8f5c685d7b4a615538b143a0a10157ca0500cc4d43324d94ae0248a020eb6f Jul 12 16:25:06.436666 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:06.436566 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8l4qq" event={"ID":"9ef6eef5-8bcb-409b-92c8-8be3c0632ec9","Type":"ContainerStarted","Data":"7dda5740c047648784ffab2fd791ecfd0dad73b0b35e6c718f9ebeff9306fb67"} Jul 12 16:25:06.438348 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:06.438319 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcrbc" event={"ID":"18f6ae2d-f089-45ff-88bc-87fde221a451","Type":"ContainerStarted","Data":"dba9581180c2384ff9db44bdd93e37f0c25241f7e4f6015d5efbf9ab70c7935b"} Jul 12 16:25:06.438480 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:06.438373 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcrbc" event={"ID":"18f6ae2d-f089-45ff-88bc-87fde221a451","Type":"ContainerStarted","Data":"b58f37aab9ed934341a86fd00fadbe253a3a1f6d8154d2b725256f9f4f425f4b"} Jul 12 16:25:06.439489 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:06.439467 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-czbmv" event={"ID":"3fd322d1-8f09-427d-af0b-21ba0d1c2291","Type":"ContainerStarted","Data":"0b8f5c685d7b4a615538b143a0a10157ca0500cc4d43324d94ae0248a020eb6f"} Jul 12 16:25:06.441704 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:06.441591 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-6fzkl"] Jul 12 16:25:06.441773 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:06.441694 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cmxw4" event={"ID":"858081cc-8c94-4852-a450-c2e699e9b42d","Type":"ContainerStarted","Data":"ab3a11d6a4d384543a0a0d44fdf0bccc7a505e01394d6044d803c19c4fe940d8"} Jul 12 16:25:06.441773 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:06.441729 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cmxw4" event={"ID":"858081cc-8c94-4852-a450-c2e699e9b42d","Type":"ContainerStarted","Data":"3a0ebaad95b44c5e6d6f7d125f4e99d7a20c4826fa110de109e1df89b1d938c3"} Jul 12 16:25:06.441892 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:06.441841 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cmxw4" Jul 12 16:25:06.446012 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:06.445964 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-84d8b6c75b-z8cbq"] Jul 12 16:25:06.446544 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:06.446513 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b6fc68976-wkq2x"] Jul 12 16:25:06.449332 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:25:06.449309 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod382bdc8c_5c29_47f5_9f35_04afc5737aca.slice/crio-93b32301013b871085b87897bf4b1c0e2a10f4f33abc55536cabd3a09c98febe WatchSource:0}: Error finding container 93b32301013b871085b87897bf4b1c0e2a10f4f33abc55536cabd3a09c98febe: Status 404 returned error can't find the container with id 93b32301013b871085b87897bf4b1c0e2a10f4f33abc55536cabd3a09c98febe Jul 12 16:25:06.449932 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:25:06.449916 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7f3297c_6de4_4db9_b1a9_df6b0c61dff4.slice/crio-34be97c5a830ca2a538b54136b7d97e81be391b05fde6f177ba933bb46c7e30c WatchSource:0}: Error finding container 34be97c5a830ca2a538b54136b7d97e81be391b05fde6f177ba933bb46c7e30c: Status 404 returned error can't find the container with id 34be97c5a830ca2a538b54136b7d97e81be391b05fde6f177ba933bb46c7e30c Jul 12 16:25:06.470725 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:06.470669 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mcrbc" podStartSLOduration=59.338834426 podStartE2EDuration="1m2.470647426s" totalImagesPullingTime="3.131813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:06.469809883 +0000 UTC m=+72.923197870" watchObservedRunningTime="2026-07-12 16:25:06.470647426 +0000 UTC m=+72.924035415" Jul 12 16:25:06.471007 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:06.470978 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8l4qq" podStartSLOduration=65.798720306 podStartE2EDuration="1m11.470967244s" totalImagesPullingTime="5.672246938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:06.453757813 +0000 UTC m=+72.907145799" watchObservedRunningTime="2026-07-12 16:25:06.470967244 +0000 UTC m=+72.924355208" Jul 12 16:25:06.487408 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:06.487355 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cmxw4" podStartSLOduration=33.334102995 podStartE2EDuration="36.487333689s" totalImagesPullingTime="3.153230694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:06.487202125 +0000 UTC m=+72.940590115" watchObservedRunningTime="2026-07-12 16:25:06.487333689 +0000 UTC m=+72.940721677" Jul 12 16:25:07.449849 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:07.449805 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-6fzkl" event={"ID":"f8a4983d-64c5-4bf8-92fd-383dab1323ba","Type":"ContainerStarted","Data":"6e2135d2cd5dc2405362476ea18c9215937db0f6428ff51da162cd4386464ff7"} Jul 12 16:25:07.452771 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:07.452738 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-84d8b6c75b-z8cbq" event={"ID":"d7f3297c-6de4-4db9-b1a9-df6b0c61dff4","Type":"ContainerStarted","Data":"f7f5f42ebf155057f17542a2edb0756ff26222a4ad452533aefd031356ba5392"} Jul 12 16:25:07.452914 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:07.452849 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-84d8b6c75b-z8cbq" event={"ID":"d7f3297c-6de4-4db9-b1a9-df6b0c61dff4","Type":"ContainerStarted","Data":"34be97c5a830ca2a538b54136b7d97e81be391b05fde6f177ba933bb46c7e30c"} Jul 12 16:25:07.456235 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:07.455582 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b6fc68976-wkq2x" event={"ID":"382bdc8c-5c29-47f5-9f35-04afc5737aca","Type":"ContainerStarted","Data":"93b32301013b871085b87897bf4b1c0e2a10f4f33abc55536cabd3a09c98febe"} Jul 12 16:25:08.147153 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:08.147107 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-84d8b6c75b-z8cbq" Jul 12 16:25:08.150139 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:08.150113 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-84d8b6c75b-z8cbq" Jul 12 16:25:08.172183 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:08.172129 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-84d8b6c75b-z8cbq" podStartSLOduration=4.172112612 podStartE2EDuration="4.172112612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:25:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:07.474323919 +0000 UTC m=+73.927711906" watchObservedRunningTime="2026-07-12 16:25:08.172112612 +0000 UTC m=+74.625500592" Jul 12 16:25:08.459711 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:08.459685 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-84d8b6c75b-z8cbq" Jul 12 16:25:08.460920 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:08.460887 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-84d8b6c75b-z8cbq" Jul 12 16:25:11.475810 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.475766 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-czbmv" event={"ID":"3fd322d1-8f09-427d-af0b-21ba0d1c2291","Type":"ContainerStarted","Data":"fe2de3d266cf4aac36434ef4201fcec3160d371ac38190ee0889c7f2013c5988"} Jul 12 16:25:11.477413 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.477355 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-6fzkl" event={"ID":"f8a4983d-64c5-4bf8-92fd-383dab1323ba","Type":"ContainerStarted","Data":"fe5554f5463908ff6e755cc9d195960377941be2e6d25279a6407a3831b8f70a"} Jul 12 16:25:11.478980 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.478944 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b6fc68976-wkq2x" event={"ID":"382bdc8c-5c29-47f5-9f35-04afc5737aca","Type":"ContainerStarted","Data":"4bd2b010819b96f83f7891bc3de0e99d3369650313a0c26425b8141eefca8a15"} Jul 12 16:25:11.494412 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.494366 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-czbmv" podStartSLOduration=2.901715016 podStartE2EDuration="7.494336336s" totalImagesPullingTime="4.59262132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:11.492978737 +0000 UTC m=+77.946366723" watchObservedRunningTime="2026-07-12 16:25:11.494336336 +0000 UTC m=+77.947724313" Jul 12 16:25:11.509726 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.509641 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b6fc68976-wkq2x" podStartSLOduration=2.708483379 podStartE2EDuration="7.509620274s" totalImagesPullingTime="4.801136895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:11.508325661 +0000 UTC m=+77.961713647" watchObservedRunningTime="2026-07-12 16:25:11.509620274 +0000 UTC m=+77.963008261" Jul 12 16:25:11.526406 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.526360 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-6fzkl" podStartSLOduration=3.134489253 podStartE2EDuration="7.526345789s" totalImagesPullingTime="4.391856536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:11.525528057 +0000 UTC m=+77.978916042" watchObservedRunningTime="2026-07-12 16:25:11.526345789 +0000 UTC m=+77.979733774" Jul 12 16:25:11.602811 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.602770 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cts6x"] Jul 12 16:25:11.633017 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.632989 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cts6x"] Jul 12 16:25:11.633188 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.633119 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:11.635634 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.635612 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 12 16:25:11.635767 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.635649 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 12 16:25:11.635833 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.635777 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nfz87\"" Jul 12 16:25:11.713156 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.713119 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cqxc\" (UniqueName: \"kubernetes.io/projected/cbf613d9-055b-406e-a242-575ebd6c8456-kube-api-access-4cqxc\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:11.713298 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.713176 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cbf613d9-055b-406e-a242-575ebd6c8456-data-volume\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:11.713298 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.713212 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cbf613d9-055b-406e-a242-575ebd6c8456-crio-socket\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:11.713298 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.713234 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cbf613d9-055b-406e-a242-575ebd6c8456-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:11.713298 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.713260 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cbf613d9-055b-406e-a242-575ebd6c8456-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:11.814065 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.813983 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cqxc\" (UniqueName: \"kubernetes.io/projected/cbf613d9-055b-406e-a242-575ebd6c8456-kube-api-access-4cqxc\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:11.814065 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.814026 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cbf613d9-055b-406e-a242-575ebd6c8456-data-volume\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:11.814065 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.814050 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cbf613d9-055b-406e-a242-575ebd6c8456-crio-socket\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:11.814333 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.814071 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cbf613d9-055b-406e-a242-575ebd6c8456-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:11.814333 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.814119 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cbf613d9-055b-406e-a242-575ebd6c8456-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:11.814333 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.814155 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cbf613d9-055b-406e-a242-575ebd6c8456-crio-socket\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:11.814333 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:25:11.814225 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 12 16:25:11.814333 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:25:11.814266 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 16:25:11.814333 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:25:11.814296 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cbf613d9-055b-406e-a242-575ebd6c8456-kube-rbac-proxy-cm podName:cbf613d9-055b-406e-a242-575ebd6c8456 nodeName:}" failed. No retries permitted until 2026-07-12 16:25:12.314279049 +0000 UTC m=+78.767667015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cbf613d9-055b-406e-a242-575ebd6c8456-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cts6x" (UID: "cbf613d9-055b-406e-a242-575ebd6c8456") : configmap "kube-rbac-proxy" not found Jul 12 16:25:11.814333 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:25:11.814323 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbf613d9-055b-406e-a242-575ebd6c8456-insights-runtime-extractor-tls podName:cbf613d9-055b-406e-a242-575ebd6c8456 nodeName:}" failed. No retries permitted until 2026-07-12 16:25:12.314305532 +0000 UTC m=+78.767693511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cbf613d9-055b-406e-a242-575ebd6c8456-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cts6x" (UID: "cbf613d9-055b-406e-a242-575ebd6c8456") : secret "insights-runtime-extractor-tls" not found Jul 12 16:25:11.814612 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.814404 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cbf613d9-055b-406e-a242-575ebd6c8456-data-volume\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:11.822232 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:11.822202 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cqxc\" (UniqueName: \"kubernetes.io/projected/cbf613d9-055b-406e-a242-575ebd6c8456-kube-api-access-4cqxc\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:12.318811 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:12.318768 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cbf613d9-055b-406e-a242-575ebd6c8456-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:12.318994 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:12.318819 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cbf613d9-055b-406e-a242-575ebd6c8456-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:12.318994 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:25:12.318928 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 16:25:12.318994 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:25:12.318944 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 12 16:25:12.319194 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:25:12.319003 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbf613d9-055b-406e-a242-575ebd6c8456-insights-runtime-extractor-tls podName:cbf613d9-055b-406e-a242-575ebd6c8456 nodeName:}" failed. No retries permitted until 2026-07-12 16:25:13.318982617 +0000 UTC m=+79.772370588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cbf613d9-055b-406e-a242-575ebd6c8456-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cts6x" (UID: "cbf613d9-055b-406e-a242-575ebd6c8456") : secret "insights-runtime-extractor-tls" not found Jul 12 16:25:12.319194 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:25:12.319020 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cbf613d9-055b-406e-a242-575ebd6c8456-kube-rbac-proxy-cm podName:cbf613d9-055b-406e-a242-575ebd6c8456 nodeName:}" failed. No retries permitted until 2026-07-12 16:25:13.319012733 +0000 UTC m=+79.772400696 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cbf613d9-055b-406e-a242-575ebd6c8456-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cts6x" (UID: "cbf613d9-055b-406e-a242-575ebd6c8456") : configmap "kube-rbac-proxy" not found Jul 12 16:25:12.629194 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:12.629104 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cmxw4_858081cc-8c94-4852-a450-c2e699e9b42d/dns/0.log" Jul 12 16:25:12.814252 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:12.814224 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cmxw4_858081cc-8c94-4852-a450-c2e699e9b42d/kube-rbac-proxy/0.log" Jul 12 16:25:13.326197 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:13.326150 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cbf613d9-055b-406e-a242-575ebd6c8456-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:13.326197 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:13.326196 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cbf613d9-055b-406e-a242-575ebd6c8456-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:13.326410 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:25:13.326300 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 12 16:25:13.326410 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:25:13.326341 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 16:25:13.326410 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:25:13.326363 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cbf613d9-055b-406e-a242-575ebd6c8456-kube-rbac-proxy-cm podName:cbf613d9-055b-406e-a242-575ebd6c8456 nodeName:}" failed. No retries permitted until 2026-07-12 16:25:15.326349046 +0000 UTC m=+81.779737010 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cbf613d9-055b-406e-a242-575ebd6c8456-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cts6x" (UID: "cbf613d9-055b-406e-a242-575ebd6c8456") : configmap "kube-rbac-proxy" not found Jul 12 16:25:13.326526 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:25:13.326414 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbf613d9-055b-406e-a242-575ebd6c8456-insights-runtime-extractor-tls podName:cbf613d9-055b-406e-a242-575ebd6c8456 nodeName:}" failed. No retries permitted until 2026-07-12 16:25:15.3263948 +0000 UTC m=+81.779782777 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cbf613d9-055b-406e-a242-575ebd6c8456-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cts6x" (UID: "cbf613d9-055b-406e-a242-575ebd6c8456") : secret "insights-runtime-extractor-tls" not found Jul 12 16:25:13.814992 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:13.814968 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-trttp_08851e67-2ac0-483b-b958-00384bf7a112/dns-node-resolver/0.log" Jul 12 16:25:14.013453 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:14.013428 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5985f48fd5-s5dqd_742214ce-0dc3-454c-9b09-d44dc878e3cd/registry/0.log" Jul 12 16:25:14.813660 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:14.813553 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ng9tv_2698e055-6034-4dad-9f91-fa9dd870b375/node-ca/0.log" Jul 12 16:25:15.014191 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:15.014157 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84d8b6c75b-z8cbq_d7f3297c-6de4-4db9-b1a9-df6b0c61dff4/router/0.log" Jul 12 16:25:15.054252 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:15.054226 2559 scope.go:117] "RemoveContainer" containerID="c1b22cd6ce4739e8dbfa65bcedeaf4e8b1fb2b57698d6525fac9c096a78da6eb" Jul 12 16:25:15.214919 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:15.214889 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bfd2h_39d81524-c036-4b18-a3ec-74f2e318fd2e/serve-healthcheck-canary/0.log" Jul 12 16:25:15.344517 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:15.344417 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cbf613d9-055b-406e-a242-575ebd6c8456-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:15.344517 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:15.344461 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cbf613d9-055b-406e-a242-575ebd6c8456-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:15.344748 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:25:15.344530 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 12 16:25:15.344748 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:25:15.344573 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 16:25:15.344748 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:25:15.344594 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cbf613d9-055b-406e-a242-575ebd6c8456-kube-rbac-proxy-cm podName:cbf613d9-055b-406e-a242-575ebd6c8456 nodeName:}" failed. No retries permitted until 2026-07-12 16:25:19.34457968 +0000 UTC m=+85.797967645 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cbf613d9-055b-406e-a242-575ebd6c8456-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cts6x" (UID: "cbf613d9-055b-406e-a242-575ebd6c8456") : configmap "kube-rbac-proxy" not found Jul 12 16:25:15.344748 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:25:15.344630 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbf613d9-055b-406e-a242-575ebd6c8456-insights-runtime-extractor-tls podName:cbf613d9-055b-406e-a242-575ebd6c8456 nodeName:}" failed. No retries permitted until 2026-07-12 16:25:19.344615112 +0000 UTC m=+85.798003076 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cbf613d9-055b-406e-a242-575ebd6c8456-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cts6x" (UID: "cbf613d9-055b-406e-a242-575ebd6c8456") : secret "insights-runtime-extractor-tls" not found Jul 12 16:25:15.496040 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:15.496016 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/2.log" Jul 12 16:25:15.496204 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:15.496117 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-rqghp" event={"ID":"0deee09d-6830-46ab-b752-083e182d70ed","Type":"ContainerStarted","Data":"e1192b81ce1d6d1abc85681ead877208c7bf9da42dba5fd6beff8ca36833b064"} Jul 12 16:25:15.496402 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:15.496383 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-rqghp" Jul 12 16:25:15.501426 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:15.501403 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-rqghp" Jul 12 16:25:15.553660 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:15.553608 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-rqghp" podStartSLOduration=64.567732301 podStartE2EDuration="1m11.553592354s" totalImagesPullingTime="6.985860053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:15.517769525 +0000 UTC m=+81.971157512" watchObservedRunningTime="2026-07-12 16:25:15.553592354 +0000 UTC m=+82.006980341" Jul 12 16:25:16.457888 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:16.457862 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cmxw4" Jul 12 16:25:19.376491 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:19.376455 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cbf613d9-055b-406e-a242-575ebd6c8456-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:19.376896 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:19.376498 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cbf613d9-055b-406e-a242-575ebd6c8456-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:19.376896 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:25:19.376574 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 12 16:25:19.376896 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:25:19.376613 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 16:25:19.376896 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:25:19.376628 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cbf613d9-055b-406e-a242-575ebd6c8456-kube-rbac-proxy-cm podName:cbf613d9-055b-406e-a242-575ebd6c8456 nodeName:}" failed. No retries permitted until 2026-07-12 16:25:27.376613322 +0000 UTC m=+93.830001286 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cbf613d9-055b-406e-a242-575ebd6c8456-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cts6x" (UID: "cbf613d9-055b-406e-a242-575ebd6c8456") : configmap "kube-rbac-proxy" not found Jul 12 16:25:19.376896 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:25:19.376679 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbf613d9-055b-406e-a242-575ebd6c8456-insights-runtime-extractor-tls podName:cbf613d9-055b-406e-a242-575ebd6c8456 nodeName:}" failed. No retries permitted until 2026-07-12 16:25:27.376656008 +0000 UTC m=+93.830043973 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cbf613d9-055b-406e-a242-575ebd6c8456-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cts6x" (UID: "cbf613d9-055b-406e-a242-575ebd6c8456") : secret "insights-runtime-extractor-tls" not found Jul 12 16:25:22.544710 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:22.544663 2559 patch_prober.go:28] interesting pod/image-registry-5985f48fd5-s5dqd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 12 16:25:22.545110 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:22.544729 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" podUID="742214ce-0dc3-454c-9b09-d44dc878e3cd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 12 16:25:24.432410 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:24.432382 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:25:26.813374 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:26.813333 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-46c2b"] Jul 12 16:25:26.816845 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:26.816821 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:26.819924 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:26.819901 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vl55q\"" Jul 12 16:25:26.819924 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:26.819922 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 12 16:25:26.820166 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:26.819922 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 12 16:25:26.820971 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:26.820957 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 12 16:25:26.821028 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:26.821014 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 12 16:25:26.939347 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:26.939314 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/51857d11-273c-4de9-9996-029443eff815-node-exporter-accelerators-collector-config\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:26.939347 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:26.939350 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51857d11-273c-4de9-9996-029443eff815-sys\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:26.939553 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:26.939372 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51857d11-273c-4de9-9996-029443eff815-metrics-client-ca\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:26.939553 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:26.939464 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/51857d11-273c-4de9-9996-029443eff815-root\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:26.939553 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:26.939501 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/51857d11-273c-4de9-9996-029443eff815-node-exporter-textfile\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:26.939553 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:26.939522 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/51857d11-273c-4de9-9996-029443eff815-node-exporter-wtmp\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:26.939696 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:26.939577 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/51857d11-273c-4de9-9996-029443eff815-node-exporter-tls\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:26.939696 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:26.939607 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw2nk\" (UniqueName: \"kubernetes.io/projected/51857d11-273c-4de9-9996-029443eff815-kube-api-access-bw2nk\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:26.939696 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:26.939662 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/51857d11-273c-4de9-9996-029443eff815-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:27.040113 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.040057 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/51857d11-273c-4de9-9996-029443eff815-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:27.040297 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.040132 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/51857d11-273c-4de9-9996-029443eff815-node-exporter-accelerators-collector-config\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:27.040297 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.040162 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51857d11-273c-4de9-9996-029443eff815-sys\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:27.040297 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.040197 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51857d11-273c-4de9-9996-029443eff815-metrics-client-ca\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:27.040297 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.040246 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/51857d11-273c-4de9-9996-029443eff815-root\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:27.040297 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.040271 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/51857d11-273c-4de9-9996-029443eff815-node-exporter-textfile\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:27.040297 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.040295 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/51857d11-273c-4de9-9996-029443eff815-node-exporter-wtmp\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:27.040596 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.040307 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51857d11-273c-4de9-9996-029443eff815-sys\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:27.040596 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.040320 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/51857d11-273c-4de9-9996-029443eff815-root\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:27.040596 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.040328 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/51857d11-273c-4de9-9996-029443eff815-node-exporter-tls\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:27.040596 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.040418 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw2nk\" (UniqueName: \"kubernetes.io/projected/51857d11-273c-4de9-9996-029443eff815-kube-api-access-bw2nk\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:27.040596 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.040464 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/51857d11-273c-4de9-9996-029443eff815-node-exporter-wtmp\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:27.040596 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.040566 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/51857d11-273c-4de9-9996-029443eff815-node-exporter-textfile\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:27.041371 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.040827 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/51857d11-273c-4de9-9996-029443eff815-node-exporter-accelerators-collector-config\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:27.041371 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.040918 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51857d11-273c-4de9-9996-029443eff815-metrics-client-ca\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:27.042680 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.042659 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/51857d11-273c-4de9-9996-029443eff815-node-exporter-tls\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:27.042782 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.042731 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/51857d11-273c-4de9-9996-029443eff815-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:27.048793 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.048764 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw2nk\" (UniqueName: \"kubernetes.io/projected/51857d11-273c-4de9-9996-029443eff815-kube-api-access-bw2nk\") pod \"node-exporter-46c2b\" (UID: \"51857d11-273c-4de9-9996-029443eff815\") " pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:27.125877 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.125804 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-46c2b" Jul 12 16:25:27.138790 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:25:27.138755 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51857d11_273c_4de9_9996_029443eff815.slice/crio-0650e036492bfc4ffacbdade28f63aac1ce62a81f2cf203c2ff0aacf0bb33bec WatchSource:0}: Error finding container 0650e036492bfc4ffacbdade28f63aac1ce62a81f2cf203c2ff0aacf0bb33bec: Status 404 returned error can't find the container with id 0650e036492bfc4ffacbdade28f63aac1ce62a81f2cf203c2ff0aacf0bb33bec Jul 12 16:25:27.443612 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.443582 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cbf613d9-055b-406e-a242-575ebd6c8456-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:27.443612 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.443617 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cbf613d9-055b-406e-a242-575ebd6c8456-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:27.444188 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.444161 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cbf613d9-055b-406e-a242-575ebd6c8456-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:27.446325 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.446302 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cbf613d9-055b-406e-a242-575ebd6c8456-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cts6x\" (UID: \"cbf613d9-055b-406e-a242-575ebd6c8456\") " pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:27.539788 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.539753 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-46c2b" event={"ID":"51857d11-273c-4de9-9996-029443eff815","Type":"ContainerStarted","Data":"0650e036492bfc4ffacbdade28f63aac1ce62a81f2cf203c2ff0aacf0bb33bec"} Jul 12 16:25:27.543018 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.542995 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cts6x" Jul 12 16:25:27.676147 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:27.676119 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cts6x"] Jul 12 16:25:27.678687 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:25:27.678658 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf613d9_055b_406e_a242_575ebd6c8456.slice/crio-180b2a2aa9301006bd1b0ee9d545f28e21bd4005c9e63ecbb34707f5d86711f0 WatchSource:0}: Error finding container 180b2a2aa9301006bd1b0ee9d545f28e21bd4005c9e63ecbb34707f5d86711f0: Status 404 returned error can't find the container with id 180b2a2aa9301006bd1b0ee9d545f28e21bd4005c9e63ecbb34707f5d86711f0 Jul 12 16:25:28.550157 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:28.549915 2559 generic.go:356] "Generic (PLEG): container finished" podID="51857d11-273c-4de9-9996-029443eff815" containerID="d7b7e6f6869e93cf40f053fb0b9b48443c31715940ef09377e523b2333c16fd2" exitCode=0 Jul 12 16:25:28.550157 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:28.550030 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-46c2b" event={"ID":"51857d11-273c-4de9-9996-029443eff815","Type":"ContainerDied","Data":"d7b7e6f6869e93cf40f053fb0b9b48443c31715940ef09377e523b2333c16fd2"} Jul 12 16:25:28.557144 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:28.557073 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cts6x" event={"ID":"cbf613d9-055b-406e-a242-575ebd6c8456","Type":"ContainerStarted","Data":"180b2a2aa9301006bd1b0ee9d545f28e21bd4005c9e63ecbb34707f5d86711f0"} Jul 12 16:25:29.119528 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:29.119491 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5985f48fd5-s5dqd"] Jul 12 16:25:29.564278 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:29.564240 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-46c2b" event={"ID":"51857d11-273c-4de9-9996-029443eff815","Type":"ContainerStarted","Data":"701c3398b9abe90c9c99b8a4222ca7ce071e7fb60be782845c126955a6822d6b"} Jul 12 16:25:29.564790 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:29.564298 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-46c2b" event={"ID":"51857d11-273c-4de9-9996-029443eff815","Type":"ContainerStarted","Data":"5eadfde857dca7a2dfc93c9bc791cc66167d969900bfbd8a7c1bf3a85f79142f"} Jul 12 16:25:29.596380 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:29.596330 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-46c2b" podStartSLOduration=2.412503116 podStartE2EDuration="3.596315514s" totalImagesPullingTime="1.087441762s" totalInitContainerRuntime="96.370636ms" isStatefulPod=true podCreationTimestamp="2026-07-12 16:25:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:29.595165281 +0000 UTC m=+96.048553268" watchObservedRunningTime="2026-07-12 16:25:29.596315514 +0000 UTC m=+96.049703500" Jul 12 16:25:32.417696 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:32.417669 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8d275" Jul 12 16:25:32.585052 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:32.584948 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cts6x" event={"ID":"cbf613d9-055b-406e-a242-575ebd6c8456","Type":"ContainerStarted","Data":"80905a0153c53be7344e7a97fac9e027140a232a9ee26d28f65526c43ee3e294"} Jul 12 16:25:32.585052 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:32.585027 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cts6x" event={"ID":"cbf613d9-055b-406e-a242-575ebd6c8456","Type":"ContainerStarted","Data":"d7ae7a7717aef55bb1ff0d07b964bf01017846c5aba5b2a5dd1c5aca615109fd"} Jul 12 16:25:34.389837 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.389804 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-655cfb6d68-9x72n"] Jul 12 16:25:34.400915 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.400886 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:34.403896 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.403866 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-655cfb6d68-9x72n"] Jul 12 16:25:34.404222 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.404191 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 12 16:25:34.405391 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.405368 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 12 16:25:34.405508 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.405420 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 12 16:25:34.405668 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.405644 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 12 16:25:34.405771 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.405738 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 12 16:25:34.405847 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.405657 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 12 16:25:34.406037 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.406018 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-b8vd7\"" Jul 12 16:25:34.406772 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.406740 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 12 16:25:34.410963 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.410941 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 12 16:25:34.502452 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.502411 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56550b6a-8f48-420f-971b-6192c0f53b9e-console-config\") pod \"console-655cfb6d68-9x72n\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:34.502637 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.502514 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56550b6a-8f48-420f-971b-6192c0f53b9e-oauth-serving-cert\") pod \"console-655cfb6d68-9x72n\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:34.502637 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.502577 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56550b6a-8f48-420f-971b-6192c0f53b9e-console-serving-cert\") pod \"console-655cfb6d68-9x72n\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:34.502637 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.502607 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt9sv\" (UniqueName: \"kubernetes.io/projected/56550b6a-8f48-420f-971b-6192c0f53b9e-kube-api-access-bt9sv\") pod \"console-655cfb6d68-9x72n\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:34.502777 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.502660 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56550b6a-8f48-420f-971b-6192c0f53b9e-console-oauth-config\") pod \"console-655cfb6d68-9x72n\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:34.502777 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.502686 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56550b6a-8f48-420f-971b-6192c0f53b9e-trusted-ca-bundle\") pod \"console-655cfb6d68-9x72n\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:34.502853 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.502780 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56550b6a-8f48-420f-971b-6192c0f53b9e-service-ca\") pod \"console-655cfb6d68-9x72n\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:34.603428 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.603401 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56550b6a-8f48-420f-971b-6192c0f53b9e-trusted-ca-bundle\") pod \"console-655cfb6d68-9x72n\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:34.603617 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.603468 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56550b6a-8f48-420f-971b-6192c0f53b9e-service-ca\") pod \"console-655cfb6d68-9x72n\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:34.603617 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.603510 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56550b6a-8f48-420f-971b-6192c0f53b9e-console-config\") pod \"console-655cfb6d68-9x72n\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:34.603617 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.603555 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56550b6a-8f48-420f-971b-6192c0f53b9e-oauth-serving-cert\") pod \"console-655cfb6d68-9x72n\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:34.603617 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.603604 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56550b6a-8f48-420f-971b-6192c0f53b9e-console-serving-cert\") pod \"console-655cfb6d68-9x72n\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:34.603884 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.603633 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt9sv\" (UniqueName: \"kubernetes.io/projected/56550b6a-8f48-420f-971b-6192c0f53b9e-kube-api-access-bt9sv\") pod \"console-655cfb6d68-9x72n\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:34.603884 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.603664 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56550b6a-8f48-420f-971b-6192c0f53b9e-console-oauth-config\") pod \"console-655cfb6d68-9x72n\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:34.604285 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.604253 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56550b6a-8f48-420f-971b-6192c0f53b9e-service-ca\") pod \"console-655cfb6d68-9x72n\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:34.604710 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.604672 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56550b6a-8f48-420f-971b-6192c0f53b9e-oauth-serving-cert\") pod \"console-655cfb6d68-9x72n\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:34.604828 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.604773 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56550b6a-8f48-420f-971b-6192c0f53b9e-trusted-ca-bundle\") pod \"console-655cfb6d68-9x72n\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:34.605119 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.605076 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56550b6a-8f48-420f-971b-6192c0f53b9e-console-config\") pod \"console-655cfb6d68-9x72n\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:34.606595 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.606576 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56550b6a-8f48-420f-971b-6192c0f53b9e-console-oauth-config\") pod \"console-655cfb6d68-9x72n\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:34.606919 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.606894 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56550b6a-8f48-420f-971b-6192c0f53b9e-console-serving-cert\") pod \"console-655cfb6d68-9x72n\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:34.612821 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.612799 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt9sv\" (UniqueName: \"kubernetes.io/projected/56550b6a-8f48-420f-971b-6192c0f53b9e-kube-api-access-bt9sv\") pod \"console-655cfb6d68-9x72n\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:34.716683 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.716651 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:34.909751 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:34.909725 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-655cfb6d68-9x72n"] Jul 12 16:25:34.913727 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:25:34.913698 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56550b6a_8f48_420f_971b_6192c0f53b9e.slice/crio-cf373af9907654f22afaf3b93bfb185774b9f6d43e1a7b454b9fd09f262a698e WatchSource:0}: Error finding container cf373af9907654f22afaf3b93bfb185774b9f6d43e1a7b454b9fd09f262a698e: Status 404 returned error can't find the container with id cf373af9907654f22afaf3b93bfb185774b9f6d43e1a7b454b9fd09f262a698e Jul 12 16:25:35.598258 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:35.598216 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-655cfb6d68-9x72n" event={"ID":"56550b6a-8f48-420f-971b-6192c0f53b9e","Type":"ContainerStarted","Data":"cf373af9907654f22afaf3b93bfb185774b9f6d43e1a7b454b9fd09f262a698e"} Jul 12 16:25:35.600558 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:35.600526 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cts6x" event={"ID":"cbf613d9-055b-406e-a242-575ebd6c8456","Type":"ContainerStarted","Data":"b69e4a22e64f01dfa2b6e9625169df21c2c3f60dc7356ae1e6e0a2e43755907b"} Jul 12 16:25:35.621621 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:35.621559 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cts6x" podStartSLOduration=17.604023967 podStartE2EDuration="24.621541968s" totalImagesPullingTime="7.017518001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:25:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:35.619562403 +0000 UTC m=+102.072950388" watchObservedRunningTime="2026-07-12 16:25:35.621541968 +0000 UTC m=+102.074929990" Jul 12 16:25:38.612741 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:38.612684 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-655cfb6d68-9x72n" event={"ID":"56550b6a-8f48-420f-971b-6192c0f53b9e","Type":"ContainerStarted","Data":"46148dd70ffe0e11b34e7a13b50c5f1243935363448b7ca55a1c75a95816a3bf"} Jul 12 16:25:38.631239 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:38.631189 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-655cfb6d68-9x72n" podStartSLOduration=1.9288343540000001 podStartE2EDuration="4.631172113s" totalImagesPullingTime="2.702337759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:25:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:38.630364523 +0000 UTC m=+105.083752509" watchObservedRunningTime="2026-07-12 16:25:38.631172113 +0000 UTC m=+105.084560098" Jul 12 16:25:44.717602 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:44.717550 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:44.718073 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:44.717633 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:44.722329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:44.722307 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:45.641364 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:45.641336 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:25:49.653544 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:49.653514 2559 generic.go:356] "Generic (PLEG): container finished" podID="aaab24fb-7114-4a9f-a622-de960b401c40" containerID="e3b795fc026cf49d184fd2dea57a08a17dab144d932f6782470d62bf77599510" exitCode=0 Jul 12 16:25:49.653904 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:49.653580 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-gl9gj" event={"ID":"aaab24fb-7114-4a9f-a622-de960b401c40","Type":"ContainerDied","Data":"e3b795fc026cf49d184fd2dea57a08a17dab144d932f6782470d62bf77599510"} Jul 12 16:25:49.653904 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:49.653869 2559 scope.go:117] "RemoveContainer" containerID="e3b795fc026cf49d184fd2dea57a08a17dab144d932f6782470d62bf77599510" Jul 12 16:25:50.659057 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:50.659022 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-gl9gj" event={"ID":"aaab24fb-7114-4a9f-a622-de960b401c40","Type":"ContainerStarted","Data":"4da17210682a80ef3a882987a433cea0587a80fdbefc6db3f8cf86ea828250f9"} Jul 12 16:25:53.051676 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.051643 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bb8c86f5c-wxp49"] Jul 12 16:25:53.054630 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.054613 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:25:53.078313 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.078282 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bb8c86f5c-wxp49"] Jul 12 16:25:53.146478 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.146439 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4zgn\" (UniqueName: \"kubernetes.io/projected/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-kube-api-access-k4zgn\") pod \"console-6bb8c86f5c-wxp49\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:25:53.146643 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.146494 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-console-config\") pod \"console-6bb8c86f5c-wxp49\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:25:53.146643 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.146513 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-oauth-serving-cert\") pod \"console-6bb8c86f5c-wxp49\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:25:53.146643 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.146538 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-console-serving-cert\") pod \"console-6bb8c86f5c-wxp49\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:25:53.146643 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.146575 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-console-oauth-config\") pod \"console-6bb8c86f5c-wxp49\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:25:53.146643 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.146638 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-trusted-ca-bundle\") pod \"console-6bb8c86f5c-wxp49\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:25:53.146840 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.146667 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-service-ca\") pod \"console-6bb8c86f5c-wxp49\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:25:53.247409 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.247368 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-trusted-ca-bundle\") pod \"console-6bb8c86f5c-wxp49\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:25:53.247409 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.247410 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-service-ca\") pod \"console-6bb8c86f5c-wxp49\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:25:53.247658 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.247430 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4zgn\" (UniqueName: \"kubernetes.io/projected/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-kube-api-access-k4zgn\") pod \"console-6bb8c86f5c-wxp49\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:25:53.247658 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.247562 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-console-config\") pod \"console-6bb8c86f5c-wxp49\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:25:53.247658 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.247604 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-oauth-serving-cert\") pod \"console-6bb8c86f5c-wxp49\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:25:53.247815 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.247733 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-console-serving-cert\") pod \"console-6bb8c86f5c-wxp49\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:25:53.247815 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.247804 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-console-oauth-config\") pod \"console-6bb8c86f5c-wxp49\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:25:53.248251 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.248213 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-service-ca\") pod \"console-6bb8c86f5c-wxp49\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:25:53.248380 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.248313 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-console-config\") pod \"console-6bb8c86f5c-wxp49\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:25:53.248380 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.248341 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-oauth-serving-cert\") pod \"console-6bb8c86f5c-wxp49\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:25:53.248757 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.248733 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-trusted-ca-bundle\") pod \"console-6bb8c86f5c-wxp49\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:25:53.250417 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.250385 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-console-oauth-config\") pod \"console-6bb8c86f5c-wxp49\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:25:53.250528 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.250427 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-console-serving-cert\") pod \"console-6bb8c86f5c-wxp49\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:25:53.260169 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.260146 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4zgn\" (UniqueName: \"kubernetes.io/projected/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-kube-api-access-k4zgn\") pod \"console-6bb8c86f5c-wxp49\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:25:53.363443 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.363363 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:25:53.506708 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.506622 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bb8c86f5c-wxp49"] Jul 12 16:25:53.509347 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:25:53.509318 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee36a005_aa0f_4c0a_bc0a_c7f85bb16e84.slice/crio-ad6e4b894a017d939a219bca3fec1201070abe039bf723e4545e89b4c244c527 WatchSource:0}: Error finding container ad6e4b894a017d939a219bca3fec1201070abe039bf723e4545e89b4c244c527: Status 404 returned error can't find the container with id ad6e4b894a017d939a219bca3fec1201070abe039bf723e4545e89b4c244c527 Jul 12 16:25:53.671332 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.671297 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bb8c86f5c-wxp49" event={"ID":"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84","Type":"ContainerStarted","Data":"6278d402cdd353a14359ca0a8fcb4c7cdb9a891f898d80fbc93e0c83740d20c5"} Jul 12 16:25:53.671503 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.671355 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bb8c86f5c-wxp49" event={"ID":"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84","Type":"ContainerStarted","Data":"ad6e4b894a017d939a219bca3fec1201070abe039bf723e4545e89b4c244c527"} Jul 12 16:25:53.702560 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:53.702509 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bb8c86f5c-wxp49" podStartSLOduration=0.702492576 podStartE2EDuration="702.492576ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:25:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:53.702165665 +0000 UTC m=+120.155553651" watchObservedRunningTime="2026-07-12 16:25:53.702492576 +0000 UTC m=+120.155880561" Jul 12 16:25:54.145304 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.145208 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" podUID="742214ce-0dc3-454c-9b09-d44dc878e3cd" containerName="registry" containerID="cri-o://e30c5220c99c527d717cecf058934fec7a33eb63a30735be70f0aeb4b90a8eb4" gracePeriod=30 Jul 12 16:25:54.398747 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.398694 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:25:54.459820 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.459790 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjlbt\" (UniqueName: \"kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-kube-api-access-vjlbt\") pod \"742214ce-0dc3-454c-9b09-d44dc878e3cd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " Jul 12 16:25:54.459820 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.459827 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-tls\") pod \"742214ce-0dc3-454c-9b09-d44dc878e3cd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " Jul 12 16:25:54.460035 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.459845 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-bound-sa-token\") pod \"742214ce-0dc3-454c-9b09-d44dc878e3cd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " Jul 12 16:25:54.460035 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.459877 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-certificates\") pod \"742214ce-0dc3-454c-9b09-d44dc878e3cd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " Jul 12 16:25:54.460035 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.460008 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/742214ce-0dc3-454c-9b09-d44dc878e3cd-installation-pull-secrets\") pod \"742214ce-0dc3-454c-9b09-d44dc878e3cd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " Jul 12 16:25:54.460277 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.460070 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/742214ce-0dc3-454c-9b09-d44dc878e3cd-trusted-ca\") pod \"742214ce-0dc3-454c-9b09-d44dc878e3cd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " Jul 12 16:25:54.460277 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.460129 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/742214ce-0dc3-454c-9b09-d44dc878e3cd-image-registry-private-configuration\") pod \"742214ce-0dc3-454c-9b09-d44dc878e3cd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " Jul 12 16:25:54.460277 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.460174 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/742214ce-0dc3-454c-9b09-d44dc878e3cd-ca-trust-extracted\") pod \"742214ce-0dc3-454c-9b09-d44dc878e3cd\" (UID: \"742214ce-0dc3-454c-9b09-d44dc878e3cd\") " Jul 12 16:25:54.460428 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.460341 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "742214ce-0dc3-454c-9b09-d44dc878e3cd" (UID: "742214ce-0dc3-454c-9b09-d44dc878e3cd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 16:25:54.460482 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.460468 2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-certificates\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:25:54.460603 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.460574 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/742214ce-0dc3-454c-9b09-d44dc878e3cd-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "742214ce-0dc3-454c-9b09-d44dc878e3cd" (UID: "742214ce-0dc3-454c-9b09-d44dc878e3cd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 16:25:54.462468 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.462438 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "742214ce-0dc3-454c-9b09-d44dc878e3cd" (UID: "742214ce-0dc3-454c-9b09-d44dc878e3cd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 16:25:54.462801 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.462775 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-kube-api-access-vjlbt" (OuterVolumeSpecName: "kube-api-access-vjlbt") pod "742214ce-0dc3-454c-9b09-d44dc878e3cd" (UID: "742214ce-0dc3-454c-9b09-d44dc878e3cd"). InnerVolumeSpecName "kube-api-access-vjlbt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 16:25:54.462870 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.462803 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/742214ce-0dc3-454c-9b09-d44dc878e3cd-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "742214ce-0dc3-454c-9b09-d44dc878e3cd" (UID: "742214ce-0dc3-454c-9b09-d44dc878e3cd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 16:25:54.462870 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.462831 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "742214ce-0dc3-454c-9b09-d44dc878e3cd" (UID: "742214ce-0dc3-454c-9b09-d44dc878e3cd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 16:25:54.462966 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.462949 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/742214ce-0dc3-454c-9b09-d44dc878e3cd-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "742214ce-0dc3-454c-9b09-d44dc878e3cd" (UID: "742214ce-0dc3-454c-9b09-d44dc878e3cd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 16:25:54.468960 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.468938 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/742214ce-0dc3-454c-9b09-d44dc878e3cd-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "742214ce-0dc3-454c-9b09-d44dc878e3cd" (UID: "742214ce-0dc3-454c-9b09-d44dc878e3cd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:25:54.561664 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.561632 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-registry-tls\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:25:54.561664 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.561658 2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-bound-sa-token\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:25:54.561664 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.561667 2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/742214ce-0dc3-454c-9b09-d44dc878e3cd-installation-pull-secrets\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:25:54.561890 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.561676 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/742214ce-0dc3-454c-9b09-d44dc878e3cd-trusted-ca\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:25:54.561890 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.561685 2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/742214ce-0dc3-454c-9b09-d44dc878e3cd-image-registry-private-configuration\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:25:54.561890 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.561694 2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/742214ce-0dc3-454c-9b09-d44dc878e3cd-ca-trust-extracted\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:25:54.561890 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.561702 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjlbt\" (UniqueName: \"kubernetes.io/projected/742214ce-0dc3-454c-9b09-d44dc878e3cd-kube-api-access-vjlbt\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:25:54.676405 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.676371 2559 generic.go:356] "Generic (PLEG): container finished" podID="742214ce-0dc3-454c-9b09-d44dc878e3cd" containerID="e30c5220c99c527d717cecf058934fec7a33eb63a30735be70f0aeb4b90a8eb4" exitCode=0 Jul 12 16:25:54.676567 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.676418 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" Jul 12 16:25:54.676567 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.676460 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" event={"ID":"742214ce-0dc3-454c-9b09-d44dc878e3cd","Type":"ContainerDied","Data":"e30c5220c99c527d717cecf058934fec7a33eb63a30735be70f0aeb4b90a8eb4"} Jul 12 16:25:54.676567 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.676521 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5985f48fd5-s5dqd" event={"ID":"742214ce-0dc3-454c-9b09-d44dc878e3cd","Type":"ContainerDied","Data":"117485b0e4c6d3946adc4aa68cafba7b854fd85938daf0c2e2f89a12cf117800"} Jul 12 16:25:54.676567 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.676548 2559 scope.go:117] "RemoveContainer" containerID="e30c5220c99c527d717cecf058934fec7a33eb63a30735be70f0aeb4b90a8eb4" Jul 12 16:25:54.685566 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.685540 2559 scope.go:117] "RemoveContainer" containerID="e30c5220c99c527d717cecf058934fec7a33eb63a30735be70f0aeb4b90a8eb4" Jul 12 16:25:54.685844 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:25:54.685825 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e30c5220c99c527d717cecf058934fec7a33eb63a30735be70f0aeb4b90a8eb4\": container with ID starting with e30c5220c99c527d717cecf058934fec7a33eb63a30735be70f0aeb4b90a8eb4 not found: ID does not exist" containerID="e30c5220c99c527d717cecf058934fec7a33eb63a30735be70f0aeb4b90a8eb4" Jul 12 16:25:54.685899 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.685852 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e30c5220c99c527d717cecf058934fec7a33eb63a30735be70f0aeb4b90a8eb4"} err="failed to get container status \"e30c5220c99c527d717cecf058934fec7a33eb63a30735be70f0aeb4b90a8eb4\": rpc error: code = NotFound desc = could not find container \"e30c5220c99c527d717cecf058934fec7a33eb63a30735be70f0aeb4b90a8eb4\": container with ID starting with e30c5220c99c527d717cecf058934fec7a33eb63a30735be70f0aeb4b90a8eb4 not found: ID does not exist" Jul 12 16:25:54.702445 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.702421 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5985f48fd5-s5dqd"] Jul 12 16:25:54.709386 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:54.709361 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5985f48fd5-s5dqd"] Jul 12 16:25:56.058815 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:25:56.058783 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="742214ce-0dc3-454c-9b09-d44dc878e3cd" path="/var/lib/kubelet/pods/742214ce-0dc3-454c-9b09-d44dc878e3cd/volumes" Jul 12 16:26:03.363805 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:03.363765 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:26:03.364299 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:03.364012 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:26:03.369707 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:03.369680 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:26:03.717737 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:03.717708 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:26:03.791778 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:03.791740 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-655cfb6d68-9x72n"] Jul 12 16:26:04.718918 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:04.718878 2559 generic.go:356] "Generic (PLEG): container finished" podID="0710e54e-dec4-4fd6-be9f-a923266bf153" containerID="c55814c17d07ab29e33acf510e6d5a54604600da7621c9fd478c4b3f6a97ea5f" exitCode=0 Jul 12 16:26:04.719340 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:04.718955 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bvl9s" event={"ID":"0710e54e-dec4-4fd6-be9f-a923266bf153","Type":"ContainerDied","Data":"c55814c17d07ab29e33acf510e6d5a54604600da7621c9fd478c4b3f6a97ea5f"} Jul 12 16:26:04.719405 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:04.719378 2559 scope.go:117] "RemoveContainer" containerID="c55814c17d07ab29e33acf510e6d5a54604600da7621c9fd478c4b3f6a97ea5f" Jul 12 16:26:05.724068 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:05.724037 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bvl9s" event={"ID":"0710e54e-dec4-4fd6-be9f-a923266bf153","Type":"ContainerStarted","Data":"79f8ede90210887af9ff8bf0f497f6925fd701111a2c4e9508edf09014c427fd"} Jul 12 16:26:28.813191 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:28.813147 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-655cfb6d68-9x72n" podUID="56550b6a-8f48-420f-971b-6192c0f53b9e" containerName="console" containerID="cri-o://46148dd70ffe0e11b34e7a13b50c5f1243935363448b7ca55a1c75a95816a3bf" gracePeriod=15 Jul 12 16:26:29.058441 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.058418 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:26:29.148316 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.148224 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56550b6a-8f48-420f-971b-6192c0f53b9e-console-oauth-config\") pod \"56550b6a-8f48-420f-971b-6192c0f53b9e\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " Jul 12 16:26:29.148316 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.148267 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56550b6a-8f48-420f-971b-6192c0f53b9e-console-config\") pod \"56550b6a-8f48-420f-971b-6192c0f53b9e\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " Jul 12 16:26:29.148316 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.148297 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bt9sv\" (UniqueName: \"kubernetes.io/projected/56550b6a-8f48-420f-971b-6192c0f53b9e-kube-api-access-bt9sv\") pod \"56550b6a-8f48-420f-971b-6192c0f53b9e\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " Jul 12 16:26:29.148569 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.148328 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56550b6a-8f48-420f-971b-6192c0f53b9e-console-serving-cert\") pod \"56550b6a-8f48-420f-971b-6192c0f53b9e\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " Jul 12 16:26:29.148569 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.148360 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56550b6a-8f48-420f-971b-6192c0f53b9e-trusted-ca-bundle\") pod \"56550b6a-8f48-420f-971b-6192c0f53b9e\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " Jul 12 16:26:29.148569 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.148388 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56550b6a-8f48-420f-971b-6192c0f53b9e-oauth-serving-cert\") pod \"56550b6a-8f48-420f-971b-6192c0f53b9e\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " Jul 12 16:26:29.148569 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.148438 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56550b6a-8f48-420f-971b-6192c0f53b9e-service-ca\") pod \"56550b6a-8f48-420f-971b-6192c0f53b9e\" (UID: \"56550b6a-8f48-420f-971b-6192c0f53b9e\") " Jul 12 16:26:29.148861 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.148816 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56550b6a-8f48-420f-971b-6192c0f53b9e-console-config" (OuterVolumeSpecName: "console-config") pod "56550b6a-8f48-420f-971b-6192c0f53b9e" (UID: "56550b6a-8f48-420f-971b-6192c0f53b9e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 16:26:29.148933 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.148874 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56550b6a-8f48-420f-971b-6192c0f53b9e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "56550b6a-8f48-420f-971b-6192c0f53b9e" (UID: "56550b6a-8f48-420f-971b-6192c0f53b9e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 16:26:29.148933 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.148910 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56550b6a-8f48-420f-971b-6192c0f53b9e-service-ca" (OuterVolumeSpecName: "service-ca") pod "56550b6a-8f48-420f-971b-6192c0f53b9e" (UID: "56550b6a-8f48-420f-971b-6192c0f53b9e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 16:26:29.149055 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.148933 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56550b6a-8f48-420f-971b-6192c0f53b9e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "56550b6a-8f48-420f-971b-6192c0f53b9e" (UID: "56550b6a-8f48-420f-971b-6192c0f53b9e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 16:26:29.150874 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.150844 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56550b6a-8f48-420f-971b-6192c0f53b9e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "56550b6a-8f48-420f-971b-6192c0f53b9e" (UID: "56550b6a-8f48-420f-971b-6192c0f53b9e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 16:26:29.150874 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.150861 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56550b6a-8f48-420f-971b-6192c0f53b9e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "56550b6a-8f48-420f-971b-6192c0f53b9e" (UID: "56550b6a-8f48-420f-971b-6192c0f53b9e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 16:26:29.151141 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.151122 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56550b6a-8f48-420f-971b-6192c0f53b9e-kube-api-access-bt9sv" (OuterVolumeSpecName: "kube-api-access-bt9sv") pod "56550b6a-8f48-420f-971b-6192c0f53b9e" (UID: "56550b6a-8f48-420f-971b-6192c0f53b9e"). InnerVolumeSpecName "kube-api-access-bt9sv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 16:26:29.249247 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.249210 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56550b6a-8f48-420f-971b-6192c0f53b9e-oauth-serving-cert\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:26:29.249247 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.249241 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56550b6a-8f48-420f-971b-6192c0f53b9e-service-ca\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:26:29.249247 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.249250 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56550b6a-8f48-420f-971b-6192c0f53b9e-console-oauth-config\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:26:29.249467 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.249259 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56550b6a-8f48-420f-971b-6192c0f53b9e-console-config\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:26:29.249467 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.249268 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bt9sv\" (UniqueName: \"kubernetes.io/projected/56550b6a-8f48-420f-971b-6192c0f53b9e-kube-api-access-bt9sv\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:26:29.249467 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.249276 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56550b6a-8f48-420f-971b-6192c0f53b9e-console-serving-cert\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:26:29.249467 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.249284 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56550b6a-8f48-420f-971b-6192c0f53b9e-trusted-ca-bundle\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:26:29.813166 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.813133 2559 generic.go:356] "Generic (PLEG): container finished" podID="56550b6a-8f48-420f-971b-6192c0f53b9e" containerID="46148dd70ffe0e11b34e7a13b50c5f1243935363448b7ca55a1c75a95816a3bf" exitCode=0 Jul 12 16:26:29.813352 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.813181 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-655cfb6d68-9x72n" Jul 12 16:26:29.813352 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.813225 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-655cfb6d68-9x72n" event={"ID":"56550b6a-8f48-420f-971b-6192c0f53b9e","Type":"ContainerDied","Data":"46148dd70ffe0e11b34e7a13b50c5f1243935363448b7ca55a1c75a95816a3bf"} Jul 12 16:26:29.813352 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.813281 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-655cfb6d68-9x72n" event={"ID":"56550b6a-8f48-420f-971b-6192c0f53b9e","Type":"ContainerDied","Data":"cf373af9907654f22afaf3b93bfb185774b9f6d43e1a7b454b9fd09f262a698e"} Jul 12 16:26:29.813352 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.813309 2559 scope.go:117] "RemoveContainer" containerID="46148dd70ffe0e11b34e7a13b50c5f1243935363448b7ca55a1c75a95816a3bf" Jul 12 16:26:29.821985 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.821968 2559 scope.go:117] "RemoveContainer" containerID="46148dd70ffe0e11b34e7a13b50c5f1243935363448b7ca55a1c75a95816a3bf" Jul 12 16:26:29.822257 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:26:29.822235 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46148dd70ffe0e11b34e7a13b50c5f1243935363448b7ca55a1c75a95816a3bf\": container with ID starting with 46148dd70ffe0e11b34e7a13b50c5f1243935363448b7ca55a1c75a95816a3bf not found: ID does not exist" containerID="46148dd70ffe0e11b34e7a13b50c5f1243935363448b7ca55a1c75a95816a3bf" Jul 12 16:26:29.822326 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.822265 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46148dd70ffe0e11b34e7a13b50c5f1243935363448b7ca55a1c75a95816a3bf"} err="failed to get container status \"46148dd70ffe0e11b34e7a13b50c5f1243935363448b7ca55a1c75a95816a3bf\": rpc error: code = NotFound desc = could not find container \"46148dd70ffe0e11b34e7a13b50c5f1243935363448b7ca55a1c75a95816a3bf\": container with ID starting with 46148dd70ffe0e11b34e7a13b50c5f1243935363448b7ca55a1c75a95816a3bf not found: ID does not exist" Jul 12 16:26:29.833560 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.833529 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-655cfb6d68-9x72n"] Jul 12 16:26:29.837798 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:29.837770 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-655cfb6d68-9x72n"] Jul 12 16:26:30.059260 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:30.059219 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56550b6a-8f48-420f-971b-6192c0f53b9e" path="/var/lib/kubelet/pods/56550b6a-8f48-420f-971b-6192c0f53b9e/volumes" Jul 12 16:26:50.856513 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:50.856434 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-869464ddbd-2gzdk"] Jul 12 16:26:50.857046 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:50.856846 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56550b6a-8f48-420f-971b-6192c0f53b9e" containerName="console" Jul 12 16:26:50.857046 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:50.856865 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="56550b6a-8f48-420f-971b-6192c0f53b9e" containerName="console" Jul 12 16:26:50.857046 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:50.856915 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="742214ce-0dc3-454c-9b09-d44dc878e3cd" containerName="registry" Jul 12 16:26:50.857046 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:50.856925 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="742214ce-0dc3-454c-9b09-d44dc878e3cd" containerName="registry" Jul 12 16:26:50.857046 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:50.856997 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="56550b6a-8f48-420f-971b-6192c0f53b9e" containerName="console" Jul 12 16:26:50.857046 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:50.857011 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="742214ce-0dc3-454c-9b09-d44dc878e3cd" containerName="registry" Jul 12 16:26:50.860133 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:50.860106 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:26:50.871248 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:50.871197 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-869464ddbd-2gzdk"] Jul 12 16:26:50.916843 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:50.916810 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54c71635-7f1d-4024-a9af-2b23a917030e-console-serving-cert\") pod \"console-869464ddbd-2gzdk\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:26:50.916843 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:50.916843 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c71635-7f1d-4024-a9af-2b23a917030e-trusted-ca-bundle\") pod \"console-869464ddbd-2gzdk\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:26:50.917059 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:50.916866 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54c71635-7f1d-4024-a9af-2b23a917030e-console-config\") pod \"console-869464ddbd-2gzdk\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:26:50.917059 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:50.916882 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llbcx\" (UniqueName: \"kubernetes.io/projected/54c71635-7f1d-4024-a9af-2b23a917030e-kube-api-access-llbcx\") pod \"console-869464ddbd-2gzdk\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:26:50.917059 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:50.916899 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54c71635-7f1d-4024-a9af-2b23a917030e-console-oauth-config\") pod \"console-869464ddbd-2gzdk\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:26:50.917059 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:50.917013 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54c71635-7f1d-4024-a9af-2b23a917030e-service-ca\") pod \"console-869464ddbd-2gzdk\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:26:50.917059 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:50.917053 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54c71635-7f1d-4024-a9af-2b23a917030e-oauth-serving-cert\") pod \"console-869464ddbd-2gzdk\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:26:51.017918 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:51.017886 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c71635-7f1d-4024-a9af-2b23a917030e-trusted-ca-bundle\") pod \"console-869464ddbd-2gzdk\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:26:51.018067 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:51.017927 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54c71635-7f1d-4024-a9af-2b23a917030e-console-config\") pod \"console-869464ddbd-2gzdk\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:26:51.018067 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:51.017948 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llbcx\" (UniqueName: \"kubernetes.io/projected/54c71635-7f1d-4024-a9af-2b23a917030e-kube-api-access-llbcx\") pod \"console-869464ddbd-2gzdk\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:26:51.018067 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:51.017978 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54c71635-7f1d-4024-a9af-2b23a917030e-console-oauth-config\") pod \"console-869464ddbd-2gzdk\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:26:51.018067 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:51.018027 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54c71635-7f1d-4024-a9af-2b23a917030e-service-ca\") pod \"console-869464ddbd-2gzdk\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:26:51.018256 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:51.018073 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54c71635-7f1d-4024-a9af-2b23a917030e-oauth-serving-cert\") pod \"console-869464ddbd-2gzdk\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:26:51.018256 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:51.018149 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54c71635-7f1d-4024-a9af-2b23a917030e-console-serving-cert\") pod \"console-869464ddbd-2gzdk\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:26:51.018771 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:51.018742 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54c71635-7f1d-4024-a9af-2b23a917030e-console-config\") pod \"console-869464ddbd-2gzdk\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:26:51.018904 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:51.018851 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54c71635-7f1d-4024-a9af-2b23a917030e-service-ca\") pod \"console-869464ddbd-2gzdk\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:26:51.018970 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:51.018900 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c71635-7f1d-4024-a9af-2b23a917030e-trusted-ca-bundle\") pod \"console-869464ddbd-2gzdk\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:26:51.019051 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:51.019027 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54c71635-7f1d-4024-a9af-2b23a917030e-oauth-serving-cert\") pod \"console-869464ddbd-2gzdk\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:26:51.020671 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:51.020643 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54c71635-7f1d-4024-a9af-2b23a917030e-console-oauth-config\") pod \"console-869464ddbd-2gzdk\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:26:51.020765 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:51.020680 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54c71635-7f1d-4024-a9af-2b23a917030e-console-serving-cert\") pod \"console-869464ddbd-2gzdk\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:26:51.025793 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:51.025771 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llbcx\" (UniqueName: \"kubernetes.io/projected/54c71635-7f1d-4024-a9af-2b23a917030e-kube-api-access-llbcx\") pod \"console-869464ddbd-2gzdk\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:26:51.171337 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:51.171308 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:26:51.302754 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:51.302722 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-869464ddbd-2gzdk"] Jul 12 16:26:51.305578 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:26:51.305547 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c71635_7f1d_4024_a9af_2b23a917030e.slice/crio-c11928849b04f210186cb3e36921535ba7c97fd7bf67181775ead1ef964f6a13 WatchSource:0}: Error finding container c11928849b04f210186cb3e36921535ba7c97fd7bf67181775ead1ef964f6a13: Status 404 returned error can't find the container with id c11928849b04f210186cb3e36921535ba7c97fd7bf67181775ead1ef964f6a13 Jul 12 16:26:51.897228 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:51.897182 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869464ddbd-2gzdk" event={"ID":"54c71635-7f1d-4024-a9af-2b23a917030e","Type":"ContainerStarted","Data":"f1b3db886cd129ac8e854f4f014bf01d7c807ea59e31db2ec30af66555fdc27d"} Jul 12 16:26:51.897652 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:51.897243 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869464ddbd-2gzdk" event={"ID":"54c71635-7f1d-4024-a9af-2b23a917030e","Type":"ContainerStarted","Data":"c11928849b04f210186cb3e36921535ba7c97fd7bf67181775ead1ef964f6a13"} Jul 12 16:26:51.915938 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:26:51.915889 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-869464ddbd-2gzdk" podStartSLOduration=1.9158456149999998 podStartE2EDuration="1.915845615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:26:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:26:51.915231318 +0000 UTC m=+178.368619305" watchObservedRunningTime="2026-07-12 16:26:51.915845615 +0000 UTC m=+178.369233601" Jul 12 16:27:01.171680 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:01.171636 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:27:01.172165 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:01.171706 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:27:01.176540 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:01.176516 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:27:01.937258 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:01.937230 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:27:01.983141 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:01.983104 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bb8c86f5c-wxp49"] Jul 12 16:27:27.007648 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:27.007609 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6bb8c86f5c-wxp49" podUID="ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84" containerName="console" containerID="cri-o://6278d402cdd353a14359ca0a8fcb4c7cdb9a891f898d80fbc93e0c83740d20c5" gracePeriod=15 Jul 12 16:27:27.270657 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:27.270633 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:27:27.410965 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:27.410929 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4zgn\" (UniqueName: \"kubernetes.io/projected/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-kube-api-access-k4zgn\") pod \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " Jul 12 16:27:27.410965 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:27.410969 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-service-ca\") pod \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " Jul 12 16:27:27.411255 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:27.410993 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-oauth-serving-cert\") pod \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " Jul 12 16:27:27.411255 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:27.411010 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-console-oauth-config\") pod \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " Jul 12 16:27:27.411255 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:27.411028 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-trusted-ca-bundle\") pod \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " Jul 12 16:27:27.411255 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:27.411083 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-console-config\") pod \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " Jul 12 16:27:27.411255 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:27.411147 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-console-serving-cert\") pod \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\" (UID: \"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84\") " Jul 12 16:27:27.411750 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:27.411713 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84" (UID: "ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 16:27:27.411837 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:27.411779 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-service-ca" (OuterVolumeSpecName: "service-ca") pod "ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84" (UID: "ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 16:27:27.411837 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:27.411793 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-console-config" (OuterVolumeSpecName: "console-config") pod "ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84" (UID: "ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 16:27:27.416162 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:27.412353 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84" (UID: "ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 16:27:27.416162 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:27.412573 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-trusted-ca-bundle\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:27:27.416162 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:27.412597 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-console-config\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:27:27.416162 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:27.412619 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-service-ca\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:27:27.416162 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:27.412632 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-oauth-serving-cert\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:27:27.416162 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:27.414432 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-kube-api-access-k4zgn" (OuterVolumeSpecName: "kube-api-access-k4zgn") pod "ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84" (UID: "ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84"). InnerVolumeSpecName "kube-api-access-k4zgn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 16:27:27.416162 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:27.414616 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84" (UID: "ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 16:27:27.416559 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:27.416211 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84" (UID: "ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 16:27:27.513845 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:27.513764 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-console-serving-cert\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:27:27.513845 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:27.513793 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4zgn\" (UniqueName: \"kubernetes.io/projected/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-kube-api-access-k4zgn\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:27:27.513845 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:27.513804 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84-console-oauth-config\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:27:28.027247 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:28.027212 2559 generic.go:356] "Generic (PLEG): container finished" podID="ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84" containerID="6278d402cdd353a14359ca0a8fcb4c7cdb9a891f898d80fbc93e0c83740d20c5" exitCode=0 Jul 12 16:27:28.027645 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:28.027282 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bb8c86f5c-wxp49" Jul 12 16:27:28.027645 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:28.027293 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bb8c86f5c-wxp49" event={"ID":"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84","Type":"ContainerDied","Data":"6278d402cdd353a14359ca0a8fcb4c7cdb9a891f898d80fbc93e0c83740d20c5"} Jul 12 16:27:28.027645 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:28.027372 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bb8c86f5c-wxp49" event={"ID":"ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84","Type":"ContainerDied","Data":"ad6e4b894a017d939a219bca3fec1201070abe039bf723e4545e89b4c244c527"} Jul 12 16:27:28.027645 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:28.027400 2559 scope.go:117] "RemoveContainer" containerID="6278d402cdd353a14359ca0a8fcb4c7cdb9a891f898d80fbc93e0c83740d20c5" Jul 12 16:27:28.036952 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:28.036934 2559 scope.go:117] "RemoveContainer" containerID="6278d402cdd353a14359ca0a8fcb4c7cdb9a891f898d80fbc93e0c83740d20c5" Jul 12 16:27:28.037249 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:27:28.037229 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6278d402cdd353a14359ca0a8fcb4c7cdb9a891f898d80fbc93e0c83740d20c5\": container with ID starting with 6278d402cdd353a14359ca0a8fcb4c7cdb9a891f898d80fbc93e0c83740d20c5 not found: ID does not exist" containerID="6278d402cdd353a14359ca0a8fcb4c7cdb9a891f898d80fbc93e0c83740d20c5" Jul 12 16:27:28.037328 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:28.037258 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6278d402cdd353a14359ca0a8fcb4c7cdb9a891f898d80fbc93e0c83740d20c5"} err="failed to get container status \"6278d402cdd353a14359ca0a8fcb4c7cdb9a891f898d80fbc93e0c83740d20c5\": rpc error: code = NotFound desc = could not find container \"6278d402cdd353a14359ca0a8fcb4c7cdb9a891f898d80fbc93e0c83740d20c5\": container with ID starting with 6278d402cdd353a14359ca0a8fcb4c7cdb9a891f898d80fbc93e0c83740d20c5 not found: ID does not exist" Jul 12 16:27:28.048163 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:28.048143 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bb8c86f5c-wxp49"] Jul 12 16:27:28.051767 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:28.051747 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bb8c86f5c-wxp49"] Jul 12 16:27:28.058051 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:28.058030 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84" path="/var/lib/kubelet/pods/ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84/volumes" Jul 12 16:27:47.499831 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:47.499796 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq"] Jul 12 16:27:47.500214 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:47.500054 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84" containerName="console" Jul 12 16:27:47.500214 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:47.500064 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84" containerName="console" Jul 12 16:27:47.500214 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:47.500144 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee36a005-aa0f-4c0a-bc0a-c7f85bb16e84" containerName="console" Jul 12 16:27:47.503035 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:47.503019 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq" Jul 12 16:27:47.505682 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:47.505665 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9wtw2\"" Jul 12 16:27:47.505737 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:47.505677 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 12 16:27:47.506794 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:47.506776 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 12 16:27:47.514124 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:47.513696 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq"] Jul 12 16:27:47.563510 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:47.563466 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mjlr\" (UniqueName: \"kubernetes.io/projected/ffc5b9de-3f91-41e1-a9e7-46bbae3a3239-kube-api-access-6mjlr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq\" (UID: \"ffc5b9de-3f91-41e1-a9e7-46bbae3a3239\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq" Jul 12 16:27:47.563676 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:47.563528 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffc5b9de-3f91-41e1-a9e7-46bbae3a3239-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq\" (UID: \"ffc5b9de-3f91-41e1-a9e7-46bbae3a3239\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq" Jul 12 16:27:47.563676 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:47.563548 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffc5b9de-3f91-41e1-a9e7-46bbae3a3239-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq\" (UID: \"ffc5b9de-3f91-41e1-a9e7-46bbae3a3239\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq" Jul 12 16:27:47.664805 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:47.664757 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mjlr\" (UniqueName: \"kubernetes.io/projected/ffc5b9de-3f91-41e1-a9e7-46bbae3a3239-kube-api-access-6mjlr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq\" (UID: \"ffc5b9de-3f91-41e1-a9e7-46bbae3a3239\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq" Jul 12 16:27:47.664978 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:47.664847 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffc5b9de-3f91-41e1-a9e7-46bbae3a3239-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq\" (UID: \"ffc5b9de-3f91-41e1-a9e7-46bbae3a3239\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq" Jul 12 16:27:47.664978 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:47.664871 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffc5b9de-3f91-41e1-a9e7-46bbae3a3239-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq\" (UID: \"ffc5b9de-3f91-41e1-a9e7-46bbae3a3239\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq" Jul 12 16:27:47.665315 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:47.665294 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffc5b9de-3f91-41e1-a9e7-46bbae3a3239-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq\" (UID: \"ffc5b9de-3f91-41e1-a9e7-46bbae3a3239\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq" Jul 12 16:27:47.665393 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:47.665312 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffc5b9de-3f91-41e1-a9e7-46bbae3a3239-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq\" (UID: \"ffc5b9de-3f91-41e1-a9e7-46bbae3a3239\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq" Jul 12 16:27:47.673627 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:47.673603 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mjlr\" (UniqueName: \"kubernetes.io/projected/ffc5b9de-3f91-41e1-a9e7-46bbae3a3239-kube-api-access-6mjlr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq\" (UID: \"ffc5b9de-3f91-41e1-a9e7-46bbae3a3239\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq" Jul 12 16:27:47.814988 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:47.814903 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq" Jul 12 16:27:47.946340 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:47.946305 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq"] Jul 12 16:27:47.949303 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:27:47.949273 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffc5b9de_3f91_41e1_a9e7_46bbae3a3239.slice/crio-ce62704a888caf49d1f87dcf8e8f2d01be1118538720d0fab58f1b4695d16f27 WatchSource:0}: Error finding container ce62704a888caf49d1f87dcf8e8f2d01be1118538720d0fab58f1b4695d16f27: Status 404 returned error can't find the container with id ce62704a888caf49d1f87dcf8e8f2d01be1118538720d0fab58f1b4695d16f27 Jul 12 16:27:48.103344 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:48.103258 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq" event={"ID":"ffc5b9de-3f91-41e1-a9e7-46bbae3a3239","Type":"ContainerStarted","Data":"ce62704a888caf49d1f87dcf8e8f2d01be1118538720d0fab58f1b4695d16f27"} Jul 12 16:27:54.128231 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:54.128190 2559 generic.go:356] "Generic (PLEG): container finished" podID="ffc5b9de-3f91-41e1-a9e7-46bbae3a3239" containerID="c01f6adfab1d4e1b6f551ce59fbce90076aa124cf23c8b36a8c466985cf682f6" exitCode=0 Jul 12 16:27:54.128591 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:54.128279 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq" event={"ID":"ffc5b9de-3f91-41e1-a9e7-46bbae3a3239","Type":"ContainerDied","Data":"c01f6adfab1d4e1b6f551ce59fbce90076aa124cf23c8b36a8c466985cf682f6"} Jul 12 16:27:57.142068 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:57.142030 2559 generic.go:356] "Generic (PLEG): container finished" podID="ffc5b9de-3f91-41e1-a9e7-46bbae3a3239" containerID="44efb1936d5ddb0ad05915392dccb732bbcc89cc26c7b8f6c9059165feaa25ea" exitCode=0 Jul 12 16:27:57.142475 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:27:57.142116 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq" event={"ID":"ffc5b9de-3f91-41e1-a9e7-46bbae3a3239","Type":"ContainerDied","Data":"44efb1936d5ddb0ad05915392dccb732bbcc89cc26c7b8f6c9059165feaa25ea"} Jul 12 16:28:05.178140 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:05.178030 2559 generic.go:356] "Generic (PLEG): container finished" podID="ffc5b9de-3f91-41e1-a9e7-46bbae3a3239" containerID="3f2f69f99462b462bf255e20ccb3c1c2a192b41cb8b64b0029fcdb3c393d1ec5" exitCode=0 Jul 12 16:28:05.178553 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:05.178137 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq" event={"ID":"ffc5b9de-3f91-41e1-a9e7-46bbae3a3239","Type":"ContainerDied","Data":"3f2f69f99462b462bf255e20ccb3c1c2a192b41cb8b64b0029fcdb3c393d1ec5"} Jul 12 16:28:06.301883 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:06.301853 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq" Jul 12 16:28:06.415577 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:06.415546 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffc5b9de-3f91-41e1-a9e7-46bbae3a3239-bundle\") pod \"ffc5b9de-3f91-41e1-a9e7-46bbae3a3239\" (UID: \"ffc5b9de-3f91-41e1-a9e7-46bbae3a3239\") " Jul 12 16:28:06.415737 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:06.415598 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffc5b9de-3f91-41e1-a9e7-46bbae3a3239-util\") pod \"ffc5b9de-3f91-41e1-a9e7-46bbae3a3239\" (UID: \"ffc5b9de-3f91-41e1-a9e7-46bbae3a3239\") " Jul 12 16:28:06.415737 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:06.415666 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mjlr\" (UniqueName: \"kubernetes.io/projected/ffc5b9de-3f91-41e1-a9e7-46bbae3a3239-kube-api-access-6mjlr\") pod \"ffc5b9de-3f91-41e1-a9e7-46bbae3a3239\" (UID: \"ffc5b9de-3f91-41e1-a9e7-46bbae3a3239\") " Jul 12 16:28:06.416372 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:06.416344 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffc5b9de-3f91-41e1-a9e7-46bbae3a3239-bundle" (OuterVolumeSpecName: "bundle") pod "ffc5b9de-3f91-41e1-a9e7-46bbae3a3239" (UID: "ffc5b9de-3f91-41e1-a9e7-46bbae3a3239"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:28:06.417886 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:06.417867 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffc5b9de-3f91-41e1-a9e7-46bbae3a3239-kube-api-access-6mjlr" (OuterVolumeSpecName: "kube-api-access-6mjlr") pod "ffc5b9de-3f91-41e1-a9e7-46bbae3a3239" (UID: "ffc5b9de-3f91-41e1-a9e7-46bbae3a3239"). InnerVolumeSpecName "kube-api-access-6mjlr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 16:28:06.421427 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:06.421400 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffc5b9de-3f91-41e1-a9e7-46bbae3a3239-util" (OuterVolumeSpecName: "util") pod "ffc5b9de-3f91-41e1-a9e7-46bbae3a3239" (UID: "ffc5b9de-3f91-41e1-a9e7-46bbae3a3239"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:28:06.516560 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:06.516476 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mjlr\" (UniqueName: \"kubernetes.io/projected/ffc5b9de-3f91-41e1-a9e7-46bbae3a3239-kube-api-access-6mjlr\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:28:06.516560 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:06.516506 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffc5b9de-3f91-41e1-a9e7-46bbae3a3239-bundle\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:28:06.516560 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:06.516515 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffc5b9de-3f91-41e1-a9e7-46bbae3a3239-util\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:28:07.187653 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:07.187620 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq" event={"ID":"ffc5b9de-3f91-41e1-a9e7-46bbae3a3239","Type":"ContainerDied","Data":"ce62704a888caf49d1f87dcf8e8f2d01be1118538720d0fab58f1b4695d16f27"} Jul 12 16:28:07.187653 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:07.187657 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzgxq" Jul 12 16:28:07.187896 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:07.187668 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce62704a888caf49d1f87dcf8e8f2d01be1118538720d0fab58f1b4695d16f27" Jul 12 16:28:10.373184 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:10.373145 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rrqlw"] Jul 12 16:28:10.373659 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:10.373531 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffc5b9de-3f91-41e1-a9e7-46bbae3a3239" containerName="extract" Jul 12 16:28:10.373659 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:10.373549 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffc5b9de-3f91-41e1-a9e7-46bbae3a3239" containerName="extract" Jul 12 16:28:10.373659 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:10.373568 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffc5b9de-3f91-41e1-a9e7-46bbae3a3239" containerName="util" Jul 12 16:28:10.373659 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:10.373577 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffc5b9de-3f91-41e1-a9e7-46bbae3a3239" containerName="util" Jul 12 16:28:10.373659 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:10.373596 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffc5b9de-3f91-41e1-a9e7-46bbae3a3239" containerName="pull" Jul 12 16:28:10.373659 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:10.373604 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffc5b9de-3f91-41e1-a9e7-46bbae3a3239" containerName="pull" Jul 12 16:28:10.373953 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:10.373678 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffc5b9de-3f91-41e1-a9e7-46bbae3a3239" containerName="extract" Jul 12 16:28:10.406669 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:10.406627 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rrqlw"] Jul 12 16:28:10.406814 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:10.406749 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rrqlw" Jul 12 16:28:10.409578 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:10.409555 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-nb9tl\"" Jul 12 16:28:10.409826 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:10.409809 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 12 16:28:10.409876 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:10.409816 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 12 16:28:10.451927 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:10.451890 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rjzs\" (UniqueName: \"kubernetes.io/projected/0c3c8adb-0b71-429c-ac46-57e068071e37-kube-api-access-4rjzs\") pod \"cert-manager-operator-controller-manager-55c444bf86-rrqlw\" (UID: \"0c3c8adb-0b71-429c-ac46-57e068071e37\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rrqlw" Jul 12 16:28:10.452113 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:10.451940 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c3c8adb-0b71-429c-ac46-57e068071e37-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rrqlw\" (UID: \"0c3c8adb-0b71-429c-ac46-57e068071e37\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rrqlw" Jul 12 16:28:10.553078 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:10.553040 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rjzs\" (UniqueName: \"kubernetes.io/projected/0c3c8adb-0b71-429c-ac46-57e068071e37-kube-api-access-4rjzs\") pod \"cert-manager-operator-controller-manager-55c444bf86-rrqlw\" (UID: \"0c3c8adb-0b71-429c-ac46-57e068071e37\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rrqlw" Jul 12 16:28:10.553274 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:10.553118 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c3c8adb-0b71-429c-ac46-57e068071e37-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rrqlw\" (UID: \"0c3c8adb-0b71-429c-ac46-57e068071e37\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rrqlw" Jul 12 16:28:10.553448 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:10.553433 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c3c8adb-0b71-429c-ac46-57e068071e37-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rrqlw\" (UID: \"0c3c8adb-0b71-429c-ac46-57e068071e37\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rrqlw" Jul 12 16:28:10.563187 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:10.563164 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rjzs\" (UniqueName: \"kubernetes.io/projected/0c3c8adb-0b71-429c-ac46-57e068071e37-kube-api-access-4rjzs\") pod \"cert-manager-operator-controller-manager-55c444bf86-rrqlw\" (UID: \"0c3c8adb-0b71-429c-ac46-57e068071e37\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rrqlw" Jul 12 16:28:10.716204 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:10.716172 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rrqlw" Jul 12 16:28:10.875202 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:10.875172 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rrqlw"] Jul 12 16:28:10.878743 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:28:10.878717 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c3c8adb_0b71_429c_ac46_57e068071e37.slice/crio-89eb29170a6657ae044fc6c478e96de581797eec1ef2cc3123b13c04300d4dc3 WatchSource:0}: Error finding container 89eb29170a6657ae044fc6c478e96de581797eec1ef2cc3123b13c04300d4dc3: Status 404 returned error can't find the container with id 89eb29170a6657ae044fc6c478e96de581797eec1ef2cc3123b13c04300d4dc3 Jul 12 16:28:11.203236 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:11.203197 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rrqlw" event={"ID":"0c3c8adb-0b71-429c-ac46-57e068071e37","Type":"ContainerStarted","Data":"89eb29170a6657ae044fc6c478e96de581797eec1ef2cc3123b13c04300d4dc3"} Jul 12 16:28:13.213521 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:13.213482 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rrqlw" event={"ID":"0c3c8adb-0b71-429c-ac46-57e068071e37","Type":"ContainerStarted","Data":"90728518b5b0ccfb877d622dda5b93bb6e8f198c76ab4c351557f5050423de11"} Jul 12 16:28:13.234246 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:13.234193 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rrqlw" podStartSLOduration=1.018184382 podStartE2EDuration="3.234175179s" totalImagesPullingTime="2.215990797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:28:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:28:13.232341485 +0000 UTC m=+259.685729472" watchObservedRunningTime="2026-07-12 16:28:13.234175179 +0000 UTC m=+259.687563164" Jul 12 16:28:14.154578 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.154541 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86"] Jul 12 16:28:14.157647 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.157630 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86" Jul 12 16:28:14.160300 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.160274 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 12 16:28:14.160444 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.160377 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 12 16:28:14.166442 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.161873 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9wtw2\"" Jul 12 16:28:14.168826 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.168796 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86"] Jul 12 16:28:14.285192 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.285151 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7234d56-1db4-495e-9411-9b6b7a6c89b5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86\" (UID: \"f7234d56-1db4-495e-9411-9b6b7a6c89b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86" Jul 12 16:28:14.285547 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.285226 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7234d56-1db4-495e-9411-9b6b7a6c89b5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86\" (UID: \"f7234d56-1db4-495e-9411-9b6b7a6c89b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86" Jul 12 16:28:14.285547 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.285251 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcdxm\" (UniqueName: \"kubernetes.io/projected/f7234d56-1db4-495e-9411-9b6b7a6c89b5-kube-api-access-rcdxm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86\" (UID: \"f7234d56-1db4-495e-9411-9b6b7a6c89b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86" Jul 12 16:28:14.308330 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.308302 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-cb6c8"] Jul 12 16:28:14.311438 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.311422 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-cb6c8" Jul 12 16:28:14.314322 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.314294 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 12 16:28:14.314474 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.314454 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 12 16:28:14.314545 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.314486 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-ps5lg\"" Jul 12 16:28:14.320980 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.320954 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-cb6c8"] Jul 12 16:28:14.386040 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.386001 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7234d56-1db4-495e-9411-9b6b7a6c89b5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86\" (UID: \"f7234d56-1db4-495e-9411-9b6b7a6c89b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86" Jul 12 16:28:14.386258 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.386046 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6r82\" (UniqueName: \"kubernetes.io/projected/be18793c-d0fc-4627-b469-e76b530bc1b1-kube-api-access-c6r82\") pod \"cert-manager-webhook-6486ffd997-cb6c8\" (UID: \"be18793c-d0fc-4627-b469-e76b530bc1b1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cb6c8" Jul 12 16:28:14.386258 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.386139 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7234d56-1db4-495e-9411-9b6b7a6c89b5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86\" (UID: \"f7234d56-1db4-495e-9411-9b6b7a6c89b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86" Jul 12 16:28:14.386258 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.386164 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcdxm\" (UniqueName: \"kubernetes.io/projected/f7234d56-1db4-495e-9411-9b6b7a6c89b5-kube-api-access-rcdxm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86\" (UID: \"f7234d56-1db4-495e-9411-9b6b7a6c89b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86" Jul 12 16:28:14.386258 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.386214 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be18793c-d0fc-4627-b469-e76b530bc1b1-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-cb6c8\" (UID: \"be18793c-d0fc-4627-b469-e76b530bc1b1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cb6c8" Jul 12 16:28:14.386474 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.386455 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7234d56-1db4-495e-9411-9b6b7a6c89b5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86\" (UID: \"f7234d56-1db4-495e-9411-9b6b7a6c89b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86" Jul 12 16:28:14.386515 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.386477 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7234d56-1db4-495e-9411-9b6b7a6c89b5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86\" (UID: \"f7234d56-1db4-495e-9411-9b6b7a6c89b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86" Jul 12 16:28:14.397099 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.397062 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcdxm\" (UniqueName: \"kubernetes.io/projected/f7234d56-1db4-495e-9411-9b6b7a6c89b5-kube-api-access-rcdxm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86\" (UID: \"f7234d56-1db4-495e-9411-9b6b7a6c89b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86" Jul 12 16:28:14.472007 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.471916 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86" Jul 12 16:28:14.487224 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.487198 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be18793c-d0fc-4627-b469-e76b530bc1b1-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-cb6c8\" (UID: \"be18793c-d0fc-4627-b469-e76b530bc1b1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cb6c8" Jul 12 16:28:14.487354 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.487248 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6r82\" (UniqueName: \"kubernetes.io/projected/be18793c-d0fc-4627-b469-e76b530bc1b1-kube-api-access-c6r82\") pod \"cert-manager-webhook-6486ffd997-cb6c8\" (UID: \"be18793c-d0fc-4627-b469-e76b530bc1b1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cb6c8" Jul 12 16:28:14.508302 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.508269 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be18793c-d0fc-4627-b469-e76b530bc1b1-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-cb6c8\" (UID: \"be18793c-d0fc-4627-b469-e76b530bc1b1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cb6c8" Jul 12 16:28:14.512598 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.512574 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6r82\" (UniqueName: \"kubernetes.io/projected/be18793c-d0fc-4627-b469-e76b530bc1b1-kube-api-access-c6r82\") pod \"cert-manager-webhook-6486ffd997-cb6c8\" (UID: \"be18793c-d0fc-4627-b469-e76b530bc1b1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cb6c8" Jul 12 16:28:14.604618 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.604581 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86"] Jul 12 16:28:14.607683 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:28:14.607660 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7234d56_1db4_495e_9411_9b6b7a6c89b5.slice/crio-88a923fae46c5fef021a4a5d46e841721fe8cb3c847e2453b1357784c5e1e1e4 WatchSource:0}: Error finding container 88a923fae46c5fef021a4a5d46e841721fe8cb3c847e2453b1357784c5e1e1e4: Status 404 returned error can't find the container with id 88a923fae46c5fef021a4a5d46e841721fe8cb3c847e2453b1357784c5e1e1e4 Jul 12 16:28:14.620209 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.620183 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-cb6c8" Jul 12 16:28:14.759980 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:14.759958 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-cb6c8"] Jul 12 16:28:14.766970 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:28:14.766941 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe18793c_d0fc_4627_b469_e76b530bc1b1.slice/crio-c3e4460d0f37fcb8b42227a47801320e52a4c28a316e4ae485bcb7d4c1eb4626 WatchSource:0}: Error finding container c3e4460d0f37fcb8b42227a47801320e52a4c28a316e4ae485bcb7d4c1eb4626: Status 404 returned error can't find the container with id c3e4460d0f37fcb8b42227a47801320e52a4c28a316e4ae485bcb7d4c1eb4626 Jul 12 16:28:15.222562 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:15.222517 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-cb6c8" event={"ID":"be18793c-d0fc-4627-b469-e76b530bc1b1","Type":"ContainerStarted","Data":"c3e4460d0f37fcb8b42227a47801320e52a4c28a316e4ae485bcb7d4c1eb4626"} Jul 12 16:28:15.223805 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:15.223783 2559 generic.go:356] "Generic (PLEG): container finished" podID="f7234d56-1db4-495e-9411-9b6b7a6c89b5" containerID="134cd241e7162769d29e8a04fc086edf14c2a311f24e9318f0d35751cacb37f5" exitCode=0 Jul 12 16:28:15.223960 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:15.223857 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86" event={"ID":"f7234d56-1db4-495e-9411-9b6b7a6c89b5","Type":"ContainerDied","Data":"134cd241e7162769d29e8a04fc086edf14c2a311f24e9318f0d35751cacb37f5"} Jul 12 16:28:15.223960 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:15.223912 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86" event={"ID":"f7234d56-1db4-495e-9411-9b6b7a6c89b5","Type":"ContainerStarted","Data":"88a923fae46c5fef021a4a5d46e841721fe8cb3c847e2453b1357784c5e1e1e4"} Jul 12 16:28:19.252957 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:19.252918 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-cb6c8" event={"ID":"be18793c-d0fc-4627-b469-e76b530bc1b1","Type":"ContainerStarted","Data":"52feb263ee4c5a42f1bb401437fa917397668cf12d95bb9fad35d321c05e88c0"} Jul 12 16:28:19.253462 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:19.253026 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-cb6c8" Jul 12 16:28:19.254843 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:19.254819 2559 generic.go:356] "Generic (PLEG): container finished" podID="f7234d56-1db4-495e-9411-9b6b7a6c89b5" containerID="a76131bd626fe8e220130e31c2b54ecb7f7838a2c5905d8b4b25d04edccbebcb" exitCode=0 Jul 12 16:28:19.254963 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:19.254849 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86" event={"ID":"f7234d56-1db4-495e-9411-9b6b7a6c89b5","Type":"ContainerDied","Data":"a76131bd626fe8e220130e31c2b54ecb7f7838a2c5905d8b4b25d04edccbebcb"} Jul 12 16:28:19.269323 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:19.269281 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-cb6c8" podStartSLOduration=1.87522741 podStartE2EDuration="5.269264822s" totalImagesPullingTime="3.394037412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:28:19.268346479 +0000 UTC m=+265.721734478" watchObservedRunningTime="2026-07-12 16:28:19.269264822 +0000 UTC m=+265.722652807" Jul 12 16:28:20.260979 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:20.260940 2559 generic.go:356] "Generic (PLEG): container finished" podID="f7234d56-1db4-495e-9411-9b6b7a6c89b5" containerID="eb2e8303b5eb66f12dc0d727522621c812fa771802bd27f9de1522deefbdbaa1" exitCode=0 Jul 12 16:28:20.261386 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:20.261027 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86" event={"ID":"f7234d56-1db4-495e-9411-9b6b7a6c89b5","Type":"ContainerDied","Data":"eb2e8303b5eb66f12dc0d727522621c812fa771802bd27f9de1522deefbdbaa1"} Jul 12 16:28:21.392205 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:21.392176 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86" Jul 12 16:28:21.542618 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:21.542520 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7234d56-1db4-495e-9411-9b6b7a6c89b5-util\") pod \"f7234d56-1db4-495e-9411-9b6b7a6c89b5\" (UID: \"f7234d56-1db4-495e-9411-9b6b7a6c89b5\") " Jul 12 16:28:21.542618 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:21.542599 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7234d56-1db4-495e-9411-9b6b7a6c89b5-bundle\") pod \"f7234d56-1db4-495e-9411-9b6b7a6c89b5\" (UID: \"f7234d56-1db4-495e-9411-9b6b7a6c89b5\") " Jul 12 16:28:21.542838 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:21.542667 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcdxm\" (UniqueName: \"kubernetes.io/projected/f7234d56-1db4-495e-9411-9b6b7a6c89b5-kube-api-access-rcdxm\") pod \"f7234d56-1db4-495e-9411-9b6b7a6c89b5\" (UID: \"f7234d56-1db4-495e-9411-9b6b7a6c89b5\") " Jul 12 16:28:21.543061 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:21.543022 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7234d56-1db4-495e-9411-9b6b7a6c89b5-bundle" (OuterVolumeSpecName: "bundle") pod "f7234d56-1db4-495e-9411-9b6b7a6c89b5" (UID: "f7234d56-1db4-495e-9411-9b6b7a6c89b5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:28:21.544867 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:21.544843 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7234d56-1db4-495e-9411-9b6b7a6c89b5-kube-api-access-rcdxm" (OuterVolumeSpecName: "kube-api-access-rcdxm") pod "f7234d56-1db4-495e-9411-9b6b7a6c89b5" (UID: "f7234d56-1db4-495e-9411-9b6b7a6c89b5"). InnerVolumeSpecName "kube-api-access-rcdxm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 16:28:21.547506 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:21.547482 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7234d56-1db4-495e-9411-9b6b7a6c89b5-util" (OuterVolumeSpecName: "util") pod "f7234d56-1db4-495e-9411-9b6b7a6c89b5" (UID: "f7234d56-1db4-495e-9411-9b6b7a6c89b5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:28:21.643413 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:21.643378 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7234d56-1db4-495e-9411-9b6b7a6c89b5-util\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:28:21.643413 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:21.643410 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7234d56-1db4-495e-9411-9b6b7a6c89b5-bundle\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:28:21.643615 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:21.643423 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcdxm\" (UniqueName: \"kubernetes.io/projected/f7234d56-1db4-495e-9411-9b6b7a6c89b5-kube-api-access-rcdxm\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:28:22.270774 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:22.270744 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86" event={"ID":"f7234d56-1db4-495e-9411-9b6b7a6c89b5","Type":"ContainerDied","Data":"88a923fae46c5fef021a4a5d46e841721fe8cb3c847e2453b1357784c5e1e1e4"} Jul 12 16:28:22.270774 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:22.270775 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2f86" Jul 12 16:28:22.270961 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:22.270789 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88a923fae46c5fef021a4a5d46e841721fe8cb3c847e2453b1357784c5e1e1e4" Jul 12 16:28:25.263897 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:25.263862 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-cb6c8" Jul 12 16:28:39.987444 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:39.987407 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d"] Jul 12 16:28:39.987929 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:39.987679 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7234d56-1db4-495e-9411-9b6b7a6c89b5" containerName="util" Jul 12 16:28:39.987929 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:39.987688 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7234d56-1db4-495e-9411-9b6b7a6c89b5" containerName="util" Jul 12 16:28:39.987929 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:39.987698 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7234d56-1db4-495e-9411-9b6b7a6c89b5" containerName="pull" Jul 12 16:28:39.987929 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:39.987703 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7234d56-1db4-495e-9411-9b6b7a6c89b5" containerName="pull" Jul 12 16:28:39.987929 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:39.987714 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7234d56-1db4-495e-9411-9b6b7a6c89b5" containerName="extract" Jul 12 16:28:39.987929 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:39.987719 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7234d56-1db4-495e-9411-9b6b7a6c89b5" containerName="extract" Jul 12 16:28:39.987929 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:39.987771 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7234d56-1db4-495e-9411-9b6b7a6c89b5" containerName="extract" Jul 12 16:28:39.990871 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:39.990854 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d" Jul 12 16:28:39.993509 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:39.993483 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 12 16:28:39.993509 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:39.993492 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 12 16:28:39.994638 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:39.994624 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9wtw2\"" Jul 12 16:28:39.999361 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:39.999336 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d"] Jul 12 16:28:40.094475 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:40.094439 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f4ht\" (UniqueName: \"kubernetes.io/projected/a6bcc88b-aaa9-40d7-8274-ae2fb9531a85-kube-api-access-2f4ht\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d\" (UID: \"a6bcc88b-aaa9-40d7-8274-ae2fb9531a85\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d" Jul 12 16:28:40.094679 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:40.094485 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6bcc88b-aaa9-40d7-8274-ae2fb9531a85-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d\" (UID: \"a6bcc88b-aaa9-40d7-8274-ae2fb9531a85\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d" Jul 12 16:28:40.094679 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:40.094563 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6bcc88b-aaa9-40d7-8274-ae2fb9531a85-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d\" (UID: \"a6bcc88b-aaa9-40d7-8274-ae2fb9531a85\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d" Jul 12 16:28:40.195552 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:40.195513 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f4ht\" (UniqueName: \"kubernetes.io/projected/a6bcc88b-aaa9-40d7-8274-ae2fb9531a85-kube-api-access-2f4ht\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d\" (UID: \"a6bcc88b-aaa9-40d7-8274-ae2fb9531a85\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d" Jul 12 16:28:40.195735 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:40.195562 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6bcc88b-aaa9-40d7-8274-ae2fb9531a85-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d\" (UID: \"a6bcc88b-aaa9-40d7-8274-ae2fb9531a85\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d" Jul 12 16:28:40.195735 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:40.195597 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6bcc88b-aaa9-40d7-8274-ae2fb9531a85-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d\" (UID: \"a6bcc88b-aaa9-40d7-8274-ae2fb9531a85\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d" Jul 12 16:28:40.195940 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:40.195921 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6bcc88b-aaa9-40d7-8274-ae2fb9531a85-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d\" (UID: \"a6bcc88b-aaa9-40d7-8274-ae2fb9531a85\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d" Jul 12 16:28:40.196011 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:40.195969 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6bcc88b-aaa9-40d7-8274-ae2fb9531a85-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d\" (UID: \"a6bcc88b-aaa9-40d7-8274-ae2fb9531a85\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d" Jul 12 16:28:40.204050 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:40.204025 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f4ht\" (UniqueName: \"kubernetes.io/projected/a6bcc88b-aaa9-40d7-8274-ae2fb9531a85-kube-api-access-2f4ht\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d\" (UID: \"a6bcc88b-aaa9-40d7-8274-ae2fb9531a85\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d" Jul 12 16:28:40.300795 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:40.300715 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d" Jul 12 16:28:40.431451 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:40.431421 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d"] Jul 12 16:28:40.433670 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:28:40.433642 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6bcc88b_aaa9_40d7_8274_ae2fb9531a85.slice/crio-02183a0d7a84d18e488130521d40d787368b9825f5a5ea6ea83030033c7b14bb WatchSource:0}: Error finding container 02183a0d7a84d18e488130521d40d787368b9825f5a5ea6ea83030033c7b14bb: Status 404 returned error can't find the container with id 02183a0d7a84d18e488130521d40d787368b9825f5a5ea6ea83030033c7b14bb Jul 12 16:28:41.349696 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:41.349664 2559 generic.go:356] "Generic (PLEG): container finished" podID="a6bcc88b-aaa9-40d7-8274-ae2fb9531a85" containerID="76c5ed6d66d43aea48725aecf6ee28c475d69680a911e23d16804c57a028e835" exitCode=0 Jul 12 16:28:41.350082 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:41.349718 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d" event={"ID":"a6bcc88b-aaa9-40d7-8274-ae2fb9531a85","Type":"ContainerDied","Data":"76c5ed6d66d43aea48725aecf6ee28c475d69680a911e23d16804c57a028e835"} Jul 12 16:28:41.350082 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:41.349754 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d" event={"ID":"a6bcc88b-aaa9-40d7-8274-ae2fb9531a85","Type":"ContainerStarted","Data":"02183a0d7a84d18e488130521d40d787368b9825f5a5ea6ea83030033c7b14bb"} Jul 12 16:28:42.355787 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:42.355694 2559 generic.go:356] "Generic (PLEG): container finished" podID="a6bcc88b-aaa9-40d7-8274-ae2fb9531a85" containerID="4ce939f953c8c4b05b54c765967976aa0ab1eb9c45aa5b8556d5a3b999155397" exitCode=0 Jul 12 16:28:42.355787 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:42.355742 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d" event={"ID":"a6bcc88b-aaa9-40d7-8274-ae2fb9531a85","Type":"ContainerDied","Data":"4ce939f953c8c4b05b54c765967976aa0ab1eb9c45aa5b8556d5a3b999155397"} Jul 12 16:28:43.362299 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:43.362254 2559 generic.go:356] "Generic (PLEG): container finished" podID="a6bcc88b-aaa9-40d7-8274-ae2fb9531a85" containerID="d8574780ff8d2fb641c97ef6124e320e1ffc9a9e60e45802c1fc094fbafa4e27" exitCode=0 Jul 12 16:28:43.362735 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:43.362345 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d" event={"ID":"a6bcc88b-aaa9-40d7-8274-ae2fb9531a85","Type":"ContainerDied","Data":"d8574780ff8d2fb641c97ef6124e320e1ffc9a9e60e45802c1fc094fbafa4e27"} Jul 12 16:28:44.490389 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:44.490365 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d" Jul 12 16:28:44.631171 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:44.631044 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2f4ht\" (UniqueName: \"kubernetes.io/projected/a6bcc88b-aaa9-40d7-8274-ae2fb9531a85-kube-api-access-2f4ht\") pod \"a6bcc88b-aaa9-40d7-8274-ae2fb9531a85\" (UID: \"a6bcc88b-aaa9-40d7-8274-ae2fb9531a85\") " Jul 12 16:28:44.631325 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:44.631197 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6bcc88b-aaa9-40d7-8274-ae2fb9531a85-util\") pod \"a6bcc88b-aaa9-40d7-8274-ae2fb9531a85\" (UID: \"a6bcc88b-aaa9-40d7-8274-ae2fb9531a85\") " Jul 12 16:28:44.631325 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:44.631222 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6bcc88b-aaa9-40d7-8274-ae2fb9531a85-bundle\") pod \"a6bcc88b-aaa9-40d7-8274-ae2fb9531a85\" (UID: \"a6bcc88b-aaa9-40d7-8274-ae2fb9531a85\") " Jul 12 16:28:44.632130 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:44.632068 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6bcc88b-aaa9-40d7-8274-ae2fb9531a85-bundle" (OuterVolumeSpecName: "bundle") pod "a6bcc88b-aaa9-40d7-8274-ae2fb9531a85" (UID: "a6bcc88b-aaa9-40d7-8274-ae2fb9531a85"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:28:44.633254 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:44.633231 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6bcc88b-aaa9-40d7-8274-ae2fb9531a85-kube-api-access-2f4ht" (OuterVolumeSpecName: "kube-api-access-2f4ht") pod "a6bcc88b-aaa9-40d7-8274-ae2fb9531a85" (UID: "a6bcc88b-aaa9-40d7-8274-ae2fb9531a85"). InnerVolumeSpecName "kube-api-access-2f4ht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 16:28:44.637503 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:44.637476 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6bcc88b-aaa9-40d7-8274-ae2fb9531a85-util" (OuterVolumeSpecName: "util") pod "a6bcc88b-aaa9-40d7-8274-ae2fb9531a85" (UID: "a6bcc88b-aaa9-40d7-8274-ae2fb9531a85"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:28:44.731746 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:44.731709 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2f4ht\" (UniqueName: \"kubernetes.io/projected/a6bcc88b-aaa9-40d7-8274-ae2fb9531a85-kube-api-access-2f4ht\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:28:44.731746 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:44.731741 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6bcc88b-aaa9-40d7-8274-ae2fb9531a85-util\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:28:44.731942 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:44.731756 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6bcc88b-aaa9-40d7-8274-ae2fb9531a85-bundle\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:28:45.371437 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:45.371404 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d" event={"ID":"a6bcc88b-aaa9-40d7-8274-ae2fb9531a85","Type":"ContainerDied","Data":"02183a0d7a84d18e488130521d40d787368b9825f5a5ea6ea83030033c7b14bb"} Jul 12 16:28:45.371437 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:45.371426 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrk9d" Jul 12 16:28:45.371695 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:45.371455 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02183a0d7a84d18e488130521d40d787368b9825f5a5ea6ea83030033c7b14bb" Jul 12 16:28:51.453756 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.453723 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt"] Jul 12 16:28:51.454127 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.453991 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6bcc88b-aaa9-40d7-8274-ae2fb9531a85" containerName="pull" Jul 12 16:28:51.454127 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.454001 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6bcc88b-aaa9-40d7-8274-ae2fb9531a85" containerName="pull" Jul 12 16:28:51.454127 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.454011 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6bcc88b-aaa9-40d7-8274-ae2fb9531a85" containerName="extract" Jul 12 16:28:51.454127 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.454016 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6bcc88b-aaa9-40d7-8274-ae2fb9531a85" containerName="extract" Jul 12 16:28:51.454127 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.454023 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6bcc88b-aaa9-40d7-8274-ae2fb9531a85" containerName="util" Jul 12 16:28:51.454127 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.454029 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6bcc88b-aaa9-40d7-8274-ae2fb9531a85" containerName="util" Jul 12 16:28:51.454127 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.454081 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6bcc88b-aaa9-40d7-8274-ae2fb9531a85" containerName="extract" Jul 12 16:28:51.459790 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.459773 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt" Jul 12 16:28:51.462530 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.462503 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 12 16:28:51.462530 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.462523 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 12 16:28:51.463115 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.463074 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 12 16:28:51.463229 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.463156 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ns54g\"" Jul 12 16:28:51.463433 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.463416 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 12 16:28:51.472454 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.472432 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt"] Jul 12 16:28:51.481695 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.481670 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b9b7cc988-jjtxt\" (UID: \"57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt" Jul 12 16:28:51.481808 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.481713 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8-webhook-cert\") pod \"opendatahub-operator-controller-manager-b9b7cc988-jjtxt\" (UID: \"57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt" Jul 12 16:28:51.481808 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.481735 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8-tmp\") pod \"opendatahub-operator-controller-manager-b9b7cc988-jjtxt\" (UID: \"57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt" Jul 12 16:28:51.481883 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.481813 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csmsd\" (UniqueName: \"kubernetes.io/projected/57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8-kube-api-access-csmsd\") pod \"opendatahub-operator-controller-manager-b9b7cc988-jjtxt\" (UID: \"57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt" Jul 12 16:28:51.481883 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.481846 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8-manifests\") pod \"opendatahub-operator-controller-manager-b9b7cc988-jjtxt\" (UID: \"57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt" Jul 12 16:28:51.582949 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.582908 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csmsd\" (UniqueName: \"kubernetes.io/projected/57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8-kube-api-access-csmsd\") pod \"opendatahub-operator-controller-manager-b9b7cc988-jjtxt\" (UID: \"57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt" Jul 12 16:28:51.583165 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.582959 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8-manifests\") pod \"opendatahub-operator-controller-manager-b9b7cc988-jjtxt\" (UID: \"57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt" Jul 12 16:28:51.583165 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.583131 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b9b7cc988-jjtxt\" (UID: \"57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt" Jul 12 16:28:51.583254 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.583200 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8-webhook-cert\") pod \"opendatahub-operator-controller-manager-b9b7cc988-jjtxt\" (UID: \"57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt" Jul 12 16:28:51.583254 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.583229 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8-tmp\") pod \"opendatahub-operator-controller-manager-b9b7cc988-jjtxt\" (UID: \"57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt" Jul 12 16:28:51.583383 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.583362 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8-manifests\") pod \"opendatahub-operator-controller-manager-b9b7cc988-jjtxt\" (UID: \"57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt" Jul 12 16:28:51.585642 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.585610 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8-tmp\") pod \"opendatahub-operator-controller-manager-b9b7cc988-jjtxt\" (UID: \"57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt" Jul 12 16:28:51.585957 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.585933 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8-webhook-cert\") pod \"opendatahub-operator-controller-manager-b9b7cc988-jjtxt\" (UID: \"57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt" Jul 12 16:28:51.586021 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.585939 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b9b7cc988-jjtxt\" (UID: \"57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt" Jul 12 16:28:51.592302 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.592268 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csmsd\" (UniqueName: \"kubernetes.io/projected/57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8-kube-api-access-csmsd\") pod \"opendatahub-operator-controller-manager-b9b7cc988-jjtxt\" (UID: \"57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt" Jul 12 16:28:51.769435 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.769344 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt" Jul 12 16:28:51.917058 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:51.917030 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt"] Jul 12 16:28:51.919064 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:28:51.919037 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57c0e390_0f41_43ed_a0e7_ec8d78eeb3a8.slice/crio-dee71c8ae02e551aa7e8d47f46fe6cfb37032556388df34318ba2cde16271505 WatchSource:0}: Error finding container dee71c8ae02e551aa7e8d47f46fe6cfb37032556388df34318ba2cde16271505: Status 404 returned error can't find the container with id dee71c8ae02e551aa7e8d47f46fe6cfb37032556388df34318ba2cde16271505 Jul 12 16:28:52.403361 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:52.403329 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt" event={"ID":"57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8","Type":"ContainerStarted","Data":"dee71c8ae02e551aa7e8d47f46fe6cfb37032556388df34318ba2cde16271505"} Jul 12 16:28:54.757148 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:54.757117 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/2.log" Jul 12 16:28:54.759562 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:54.757321 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/2.log" Jul 12 16:28:54.764653 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:54.764635 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4zm_b89054d2-a85b-40ac-aa21-69eefa2ed9e8/ovn-acl-logging/0.log" Jul 12 16:28:54.765041 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:54.765022 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4zm_b89054d2-a85b-40ac-aa21-69eefa2ed9e8/ovn-acl-logging/0.log" Jul 12 16:28:54.767815 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:54.767800 2559 kubelet.go:1648] "Image garbage collection succeeded" Jul 12 16:28:55.420798 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:55.420754 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt" event={"ID":"57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8","Type":"ContainerStarted","Data":"670e6a883b5afc8f63e338738d434448f4eff1e31c7771b30f655570857721b2"} Jul 12 16:28:56.426796 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:56.426761 2559 generic.go:356] "Generic (PLEG): container finished" podID="57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8" containerID="670e6a883b5afc8f63e338738d434448f4eff1e31c7771b30f655570857721b2" exitCode=0 Jul 12 16:28:56.427199 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:56.426834 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt" event={"ID":"57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8","Type":"ContainerDied","Data":"670e6a883b5afc8f63e338738d434448f4eff1e31c7771b30f655570857721b2"} Jul 12 16:28:56.427311 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:56.427295 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 16:28:57.433043 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:57.433007 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt" event={"ID":"57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8","Type":"ContainerStarted","Data":"a730a036e42bd55ff3f0c18ba7b25207ade302f2018b77a3d47fd2640c54ab31"} Jul 12 16:28:57.433431 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:57.433134 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt" Jul 12 16:28:57.455769 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:28:57.455721 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt" podStartSLOduration=2.185174418 podStartE2EDuration="6.45570553s" totalImagesPullingTime="3.215943174s" totalInitContainerRuntime="1.054587938s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:28:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:28:57.455365975 +0000 UTC m=+303.908753965" watchObservedRunningTime="2026-07-12 16:28:57.45570553 +0000 UTC m=+303.909093515" Jul 12 16:29:08.440572 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:08.440541 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b9b7cc988-jjtxt" Jul 12 16:29:08.889394 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:08.889318 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cdff5df8d-rjlxq"] Jul 12 16:29:08.898287 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:08.898257 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7cdff5df8d-rjlxq" Jul 12 16:29:08.900219 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:08.900195 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cdff5df8d-rjlxq"] Jul 12 16:29:08.901054 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:08.901035 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 12 16:29:08.901165 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:08.901039 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 12 16:29:08.901165 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:08.901103 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 12 16:29:08.902376 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:08.902354 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 12 16:29:08.902490 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:08.902400 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 12 16:29:08.902619 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:08.902602 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bqcfp\"" Jul 12 16:29:08.913590 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:08.913561 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlx4f\" (UniqueName: \"kubernetes.io/projected/78e88911-9946-485c-b169-92cd325d0c2b-kube-api-access-hlx4f\") pod \"lws-controller-manager-7cdff5df8d-rjlxq\" (UID: \"78e88911-9946-485c-b169-92cd325d0c2b\") " pod="openshift-lws-operator/lws-controller-manager-7cdff5df8d-rjlxq" Jul 12 16:29:08.913730 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:08.913607 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/78e88911-9946-485c-b169-92cd325d0c2b-metrics-cert\") pod \"lws-controller-manager-7cdff5df8d-rjlxq\" (UID: \"78e88911-9946-485c-b169-92cd325d0c2b\") " pod="openshift-lws-operator/lws-controller-manager-7cdff5df8d-rjlxq" Jul 12 16:29:08.913730 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:08.913710 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78e88911-9946-485c-b169-92cd325d0c2b-cert\") pod \"lws-controller-manager-7cdff5df8d-rjlxq\" (UID: \"78e88911-9946-485c-b169-92cd325d0c2b\") " pod="openshift-lws-operator/lws-controller-manager-7cdff5df8d-rjlxq" Jul 12 16:29:08.913846 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:08.913748 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/78e88911-9946-485c-b169-92cd325d0c2b-manager-config\") pod \"lws-controller-manager-7cdff5df8d-rjlxq\" (UID: \"78e88911-9946-485c-b169-92cd325d0c2b\") " pod="openshift-lws-operator/lws-controller-manager-7cdff5df8d-rjlxq" Jul 12 16:29:09.014107 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:09.014049 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/78e88911-9946-485c-b169-92cd325d0c2b-metrics-cert\") pod \"lws-controller-manager-7cdff5df8d-rjlxq\" (UID: \"78e88911-9946-485c-b169-92cd325d0c2b\") " pod="openshift-lws-operator/lws-controller-manager-7cdff5df8d-rjlxq" Jul 12 16:29:09.014299 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:09.014141 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78e88911-9946-485c-b169-92cd325d0c2b-cert\") pod \"lws-controller-manager-7cdff5df8d-rjlxq\" (UID: \"78e88911-9946-485c-b169-92cd325d0c2b\") " pod="openshift-lws-operator/lws-controller-manager-7cdff5df8d-rjlxq" Jul 12 16:29:09.014299 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:09.014164 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/78e88911-9946-485c-b169-92cd325d0c2b-manager-config\") pod \"lws-controller-manager-7cdff5df8d-rjlxq\" (UID: \"78e88911-9946-485c-b169-92cd325d0c2b\") " pod="openshift-lws-operator/lws-controller-manager-7cdff5df8d-rjlxq" Jul 12 16:29:09.014299 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:09.014214 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlx4f\" (UniqueName: \"kubernetes.io/projected/78e88911-9946-485c-b169-92cd325d0c2b-kube-api-access-hlx4f\") pod \"lws-controller-manager-7cdff5df8d-rjlxq\" (UID: \"78e88911-9946-485c-b169-92cd325d0c2b\") " pod="openshift-lws-operator/lws-controller-manager-7cdff5df8d-rjlxq" Jul 12 16:29:09.014808 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:09.014780 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/78e88911-9946-485c-b169-92cd325d0c2b-manager-config\") pod \"lws-controller-manager-7cdff5df8d-rjlxq\" (UID: \"78e88911-9946-485c-b169-92cd325d0c2b\") " pod="openshift-lws-operator/lws-controller-manager-7cdff5df8d-rjlxq" Jul 12 16:29:09.016749 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:09.016725 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/78e88911-9946-485c-b169-92cd325d0c2b-metrics-cert\") pod \"lws-controller-manager-7cdff5df8d-rjlxq\" (UID: \"78e88911-9946-485c-b169-92cd325d0c2b\") " pod="openshift-lws-operator/lws-controller-manager-7cdff5df8d-rjlxq" Jul 12 16:29:09.016849 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:09.016832 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78e88911-9946-485c-b169-92cd325d0c2b-cert\") pod \"lws-controller-manager-7cdff5df8d-rjlxq\" (UID: \"78e88911-9946-485c-b169-92cd325d0c2b\") " pod="openshift-lws-operator/lws-controller-manager-7cdff5df8d-rjlxq" Jul 12 16:29:09.024146 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:09.024117 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlx4f\" (UniqueName: \"kubernetes.io/projected/78e88911-9946-485c-b169-92cd325d0c2b-kube-api-access-hlx4f\") pod \"lws-controller-manager-7cdff5df8d-rjlxq\" (UID: \"78e88911-9946-485c-b169-92cd325d0c2b\") " pod="openshift-lws-operator/lws-controller-manager-7cdff5df8d-rjlxq" Jul 12 16:29:09.208419 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:09.208384 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7cdff5df8d-rjlxq" Jul 12 16:29:09.340364 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:09.340333 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cdff5df8d-rjlxq"] Jul 12 16:29:09.343410 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:29:09.343369 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78e88911_9946_485c_b169_92cd325d0c2b.slice/crio-5bb590ad2abd32c8a2a1dfa6bbd56cc9ab9478f7846260a4e4da010cd1e2744f WatchSource:0}: Error finding container 5bb590ad2abd32c8a2a1dfa6bbd56cc9ab9478f7846260a4e4da010cd1e2744f: Status 404 returned error can't find the container with id 5bb590ad2abd32c8a2a1dfa6bbd56cc9ab9478f7846260a4e4da010cd1e2744f Jul 12 16:29:09.487509 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:09.487405 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7cdff5df8d-rjlxq" event={"ID":"78e88911-9946-485c-b169-92cd325d0c2b","Type":"ContainerStarted","Data":"5bb590ad2abd32c8a2a1dfa6bbd56cc9ab9478f7846260a4e4da010cd1e2744f"} Jul 12 16:29:11.498862 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:11.498820 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7cdff5df8d-rjlxq" event={"ID":"78e88911-9946-485c-b169-92cd325d0c2b","Type":"ContainerStarted","Data":"0570406cf9bab0efaaa430298a035c212754015c3c4d6338ed22eec298b927d4"} Jul 12 16:29:11.499375 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:11.498896 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7cdff5df8d-rjlxq" Jul 12 16:29:12.070863 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:12.070811 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7cdff5df8d-rjlxq" podStartSLOduration=2.334334657 podStartE2EDuration="4.070791184s" totalImagesPullingTime="1.736456527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:29:11.518123478 +0000 UTC m=+317.971511465" watchObservedRunningTime="2026-07-12 16:29:12.070791184 +0000 UTC m=+318.524179170" Jul 12 16:29:12.072316 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:12.072299 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4bzdk"] Jul 12 16:29:12.075585 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:12.075569 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-4bzdk" Jul 12 16:29:12.078044 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:12.078016 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-k7xds\"" Jul 12 16:29:12.078044 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:12.078017 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 12 16:29:12.086973 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:12.086950 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4bzdk"] Jul 12 16:29:12.141045 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:12.141008 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9c4g\" (UniqueName: \"kubernetes.io/projected/af582587-b92c-4b9d-a6f9-ff2de31e0549-kube-api-access-m9c4g\") pod \"model-serving-api-54d89bd5fc-4bzdk\" (UID: \"af582587-b92c-4b9d-a6f9-ff2de31e0549\") " pod="opendatahub/model-serving-api-54d89bd5fc-4bzdk" Jul 12 16:29:12.141045 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:12.141047 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af582587-b92c-4b9d-a6f9-ff2de31e0549-tls-certs\") pod \"model-serving-api-54d89bd5fc-4bzdk\" (UID: \"af582587-b92c-4b9d-a6f9-ff2de31e0549\") " pod="opendatahub/model-serving-api-54d89bd5fc-4bzdk" Jul 12 16:29:12.242155 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:12.242116 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9c4g\" (UniqueName: \"kubernetes.io/projected/af582587-b92c-4b9d-a6f9-ff2de31e0549-kube-api-access-m9c4g\") pod \"model-serving-api-54d89bd5fc-4bzdk\" (UID: \"af582587-b92c-4b9d-a6f9-ff2de31e0549\") " pod="opendatahub/model-serving-api-54d89bd5fc-4bzdk" Jul 12 16:29:12.242317 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:12.242175 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af582587-b92c-4b9d-a6f9-ff2de31e0549-tls-certs\") pod \"model-serving-api-54d89bd5fc-4bzdk\" (UID: \"af582587-b92c-4b9d-a6f9-ff2de31e0549\") " pod="opendatahub/model-serving-api-54d89bd5fc-4bzdk" Jul 12 16:29:12.242317 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:29:12.242303 2559 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 12 16:29:12.242404 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:29:12.242377 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af582587-b92c-4b9d-a6f9-ff2de31e0549-tls-certs podName:af582587-b92c-4b9d-a6f9-ff2de31e0549 nodeName:}" failed. No retries permitted until 2026-07-12 16:29:12.742358886 +0000 UTC m=+319.195746850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/af582587-b92c-4b9d-a6f9-ff2de31e0549-tls-certs") pod "model-serving-api-54d89bd5fc-4bzdk" (UID: "af582587-b92c-4b9d-a6f9-ff2de31e0549") : secret "model-serving-api-tls" not found Jul 12 16:29:12.250797 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:12.250774 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9c4g\" (UniqueName: \"kubernetes.io/projected/af582587-b92c-4b9d-a6f9-ff2de31e0549-kube-api-access-m9c4g\") pod \"model-serving-api-54d89bd5fc-4bzdk\" (UID: \"af582587-b92c-4b9d-a6f9-ff2de31e0549\") " pod="opendatahub/model-serving-api-54d89bd5fc-4bzdk" Jul 12 16:29:12.746139 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:12.746103 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af582587-b92c-4b9d-a6f9-ff2de31e0549-tls-certs\") pod \"model-serving-api-54d89bd5fc-4bzdk\" (UID: \"af582587-b92c-4b9d-a6f9-ff2de31e0549\") " pod="opendatahub/model-serving-api-54d89bd5fc-4bzdk" Jul 12 16:29:12.748627 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:12.748599 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af582587-b92c-4b9d-a6f9-ff2de31e0549-tls-certs\") pod \"model-serving-api-54d89bd5fc-4bzdk\" (UID: \"af582587-b92c-4b9d-a6f9-ff2de31e0549\") " pod="opendatahub/model-serving-api-54d89bd5fc-4bzdk" Jul 12 16:29:12.987411 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:12.987373 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-4bzdk" Jul 12 16:29:13.120654 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:13.120625 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4bzdk"] Jul 12 16:29:13.122910 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:29:13.122877 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf582587_b92c_4b9d_a6f9_ff2de31e0549.slice/crio-fe6feb94ac9618c0a42ec97afbf105c2a036101b9fc4b276fa35fb43f0d2d807 WatchSource:0}: Error finding container fe6feb94ac9618c0a42ec97afbf105c2a036101b9fc4b276fa35fb43f0d2d807: Status 404 returned error can't find the container with id fe6feb94ac9618c0a42ec97afbf105c2a036101b9fc4b276fa35fb43f0d2d807 Jul 12 16:29:13.508322 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:13.508288 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-4bzdk" event={"ID":"af582587-b92c-4b9d-a6f9-ff2de31e0549","Type":"ContainerStarted","Data":"fe6feb94ac9618c0a42ec97afbf105c2a036101b9fc4b276fa35fb43f0d2d807"} Jul 12 16:29:15.522054 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:15.522019 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-4bzdk" event={"ID":"af582587-b92c-4b9d-a6f9-ff2de31e0549","Type":"ContainerStarted","Data":"3bb68d777cd0aee2a9814c25deebd49543086302c009a11149f48a60ae040a47"} Jul 12 16:29:15.522444 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:15.522149 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-4bzdk" Jul 12 16:29:15.540356 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:15.540302 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-4bzdk" podStartSLOduration=1.7511918340000001 podStartE2EDuration="3.540288414s" totalImagesPullingTime="1.78909658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:29:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:29:15.539339335 +0000 UTC m=+321.992727326" watchObservedRunningTime="2026-07-12 16:29:15.540288414 +0000 UTC m=+321.993676399" Jul 12 16:29:18.372182 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.372143 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c"] Jul 12 16:29:18.375440 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.375423 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.378103 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.378067 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 12 16:29:18.378438 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.378205 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vq5mx\"" Jul 12 16:29:18.389051 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.389024 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c"] Jul 12 16:29:18.495290 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.495251 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxqdp\" (UniqueName: \"kubernetes.io/projected/9ada764e-9915-4557-86ae-dc90393975ff-kube-api-access-xxqdp\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.495467 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.495303 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ada764e-9915-4557-86ae-dc90393975ff-istio-data\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.495467 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.495362 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ada764e-9915-4557-86ae-dc90393975ff-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.495467 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.495385 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ada764e-9915-4557-86ae-dc90393975ff-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.495467 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.495445 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ada764e-9915-4557-86ae-dc90393975ff-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.495633 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.495483 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ada764e-9915-4557-86ae-dc90393975ff-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.495633 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.495507 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ada764e-9915-4557-86ae-dc90393975ff-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.495633 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.495533 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ada764e-9915-4557-86ae-dc90393975ff-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.495633 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.495553 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ada764e-9915-4557-86ae-dc90393975ff-istio-token\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.596350 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.596302 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxqdp\" (UniqueName: \"kubernetes.io/projected/9ada764e-9915-4557-86ae-dc90393975ff-kube-api-access-xxqdp\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.596556 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.596384 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ada764e-9915-4557-86ae-dc90393975ff-istio-data\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.596556 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.596424 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ada764e-9915-4557-86ae-dc90393975ff-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.596556 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.596443 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ada764e-9915-4557-86ae-dc90393975ff-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.596556 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.596482 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ada764e-9915-4557-86ae-dc90393975ff-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.596556 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.596521 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ada764e-9915-4557-86ae-dc90393975ff-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.596849 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.596557 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ada764e-9915-4557-86ae-dc90393975ff-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.596849 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.596595 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ada764e-9915-4557-86ae-dc90393975ff-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.596849 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.596627 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ada764e-9915-4557-86ae-dc90393975ff-istio-token\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.597180 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.597154 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ada764e-9915-4557-86ae-dc90393975ff-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.597359 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.597175 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ada764e-9915-4557-86ae-dc90393975ff-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.597460 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.597211 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ada764e-9915-4557-86ae-dc90393975ff-istio-data\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.597460 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.597282 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ada764e-9915-4557-86ae-dc90393975ff-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.597608 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.597586 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ada764e-9915-4557-86ae-dc90393975ff-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.599236 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.599213 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ada764e-9915-4557-86ae-dc90393975ff-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.599338 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.599298 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ada764e-9915-4557-86ae-dc90393975ff-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.613592 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.613555 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ada764e-9915-4557-86ae-dc90393975ff-istio-token\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.613709 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.613670 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxqdp\" (UniqueName: \"kubernetes.io/projected/9ada764e-9915-4557-86ae-dc90393975ff-kube-api-access-xxqdp\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dv976c\" (UID: \"9ada764e-9915-4557-86ae-dc90393975ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.690275 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.690240 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:18.826956 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:18.826929 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c"] Jul 12 16:29:18.828776 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:29:18.828744 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ada764e_9915_4557_86ae_dc90393975ff.slice/crio-5a00a8138583db7cdd56007ca2e3582b0a1a10c925d2c10b7ef8204b955b3277 WatchSource:0}: Error finding container 5a00a8138583db7cdd56007ca2e3582b0a1a10c925d2c10b7ef8204b955b3277: Status 404 returned error can't find the container with id 5a00a8138583db7cdd56007ca2e3582b0a1a10c925d2c10b7ef8204b955b3277 Jul 12 16:29:19.543686 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:19.543650 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" event={"ID":"9ada764e-9915-4557-86ae-dc90393975ff","Type":"ContainerStarted","Data":"5a00a8138583db7cdd56007ca2e3582b0a1a10c925d2c10b7ef8204b955b3277"} Jul 12 16:29:21.667187 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:21.667152 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 16:29:21.667467 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:21.667225 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 16:29:21.667467 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:21.667255 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 16:29:22.505550 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:22.505516 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7cdff5df8d-rjlxq" Jul 12 16:29:22.561656 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:22.561622 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" event={"ID":"9ada764e-9915-4557-86ae-dc90393975ff","Type":"ContainerStarted","Data":"e094b284540c9b1c11178949b12c0e7b3c81aaac70445d267fa3f2b18c1e0e18"} Jul 12 16:29:22.622444 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:22.622381 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" podStartSLOduration=1.786252187 podStartE2EDuration="4.622358899s" totalImagesPullingTime="2.836106712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:29:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:29:22.609538161 +0000 UTC m=+329.062926138" watchObservedRunningTime="2026-07-12 16:29:22.622358899 +0000 UTC m=+329.075746886" Jul 12 16:29:22.690768 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:22.690737 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:22.695619 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:22.695594 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:22.814226 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:22.814152 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lqdjs"] Jul 12 16:29:22.817580 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:22.817563 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lqdjs" Jul 12 16:29:22.839740 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:22.839701 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 12 16:29:22.840026 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:22.840005 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-hxtms\"" Jul 12 16:29:22.841636 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:22.841617 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6pxcd"] Jul 12 16:29:22.844769 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:22.844751 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lqdjs"] Jul 12 16:29:22.844872 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:22.844833 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pxcd" Jul 12 16:29:22.849526 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:22.849501 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-xmb2r\"" Jul 12 16:29:22.849657 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:22.849637 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 12 16:29:22.865844 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:22.865820 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6pxcd"] Jul 12 16:29:22.938510 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:22.938467 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwhdm\" (UniqueName: \"kubernetes.io/projected/65f26595-63f4-4127-83b1-ff7d7a09b091-kube-api-access-lwhdm\") pod \"llmisvc-controller-manager-777c6bd7d5-6pxcd\" (UID: \"65f26595-63f4-4127-83b1-ff7d7a09b091\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pxcd" Jul 12 16:29:22.938510 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:22.938514 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b54f4131-97b3-4587-82da-b5a6d9c425e9-cert\") pod \"kserve-controller-manager-d6f4b65b8-lqdjs\" (UID: \"b54f4131-97b3-4587-82da-b5a6d9c425e9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lqdjs" Jul 12 16:29:22.938743 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:22.938544 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27r56\" (UniqueName: \"kubernetes.io/projected/b54f4131-97b3-4587-82da-b5a6d9c425e9-kube-api-access-27r56\") pod \"kserve-controller-manager-d6f4b65b8-lqdjs\" (UID: \"b54f4131-97b3-4587-82da-b5a6d9c425e9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lqdjs" Jul 12 16:29:22.938743 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:22.938585 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65f26595-63f4-4127-83b1-ff7d7a09b091-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6pxcd\" (UID: \"65f26595-63f4-4127-83b1-ff7d7a09b091\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pxcd" Jul 12 16:29:23.039535 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:23.039501 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65f26595-63f4-4127-83b1-ff7d7a09b091-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6pxcd\" (UID: \"65f26595-63f4-4127-83b1-ff7d7a09b091\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pxcd" Jul 12 16:29:23.039742 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:23.039593 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwhdm\" (UniqueName: \"kubernetes.io/projected/65f26595-63f4-4127-83b1-ff7d7a09b091-kube-api-access-lwhdm\") pod \"llmisvc-controller-manager-777c6bd7d5-6pxcd\" (UID: \"65f26595-63f4-4127-83b1-ff7d7a09b091\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pxcd" Jul 12 16:29:23.039742 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:23.039622 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b54f4131-97b3-4587-82da-b5a6d9c425e9-cert\") pod \"kserve-controller-manager-d6f4b65b8-lqdjs\" (UID: \"b54f4131-97b3-4587-82da-b5a6d9c425e9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lqdjs" Jul 12 16:29:23.039742 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:23.039659 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27r56\" (UniqueName: \"kubernetes.io/projected/b54f4131-97b3-4587-82da-b5a6d9c425e9-kube-api-access-27r56\") pod \"kserve-controller-manager-d6f4b65b8-lqdjs\" (UID: \"b54f4131-97b3-4587-82da-b5a6d9c425e9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lqdjs" Jul 12 16:29:23.039903 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:29:23.039743 2559 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 12 16:29:23.039903 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:29:23.039802 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b54f4131-97b3-4587-82da-b5a6d9c425e9-cert podName:b54f4131-97b3-4587-82da-b5a6d9c425e9 nodeName:}" failed. No retries permitted until 2026-07-12 16:29:23.539786648 +0000 UTC m=+329.993174612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b54f4131-97b3-4587-82da-b5a6d9c425e9-cert") pod "kserve-controller-manager-d6f4b65b8-lqdjs" (UID: "b54f4131-97b3-4587-82da-b5a6d9c425e9") : secret "kserve-webhook-server-cert" not found Jul 12 16:29:23.042048 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:23.042018 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65f26595-63f4-4127-83b1-ff7d7a09b091-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6pxcd\" (UID: \"65f26595-63f4-4127-83b1-ff7d7a09b091\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pxcd" Jul 12 16:29:23.070738 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:23.070679 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27r56\" (UniqueName: \"kubernetes.io/projected/b54f4131-97b3-4587-82da-b5a6d9c425e9-kube-api-access-27r56\") pod \"kserve-controller-manager-d6f4b65b8-lqdjs\" (UID: \"b54f4131-97b3-4587-82da-b5a6d9c425e9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lqdjs" Jul 12 16:29:23.071213 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:23.071196 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwhdm\" (UniqueName: \"kubernetes.io/projected/65f26595-63f4-4127-83b1-ff7d7a09b091-kube-api-access-lwhdm\") pod \"llmisvc-controller-manager-777c6bd7d5-6pxcd\" (UID: \"65f26595-63f4-4127-83b1-ff7d7a09b091\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pxcd" Jul 12 16:29:23.156532 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:23.156498 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pxcd" Jul 12 16:29:23.307847 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:23.307820 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6pxcd"] Jul 12 16:29:23.309022 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:29:23.308998 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod65f26595_63f4_4127_83b1_ff7d7a09b091.slice/crio-eae1dc8ca3f5bf92d3fe5bbdeefcac1685453496b24a782e31ccc794ed59398b WatchSource:0}: Error finding container eae1dc8ca3f5bf92d3fe5bbdeefcac1685453496b24a782e31ccc794ed59398b: Status 404 returned error can't find the container with id eae1dc8ca3f5bf92d3fe5bbdeefcac1685453496b24a782e31ccc794ed59398b Jul 12 16:29:23.545157 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:23.545122 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b54f4131-97b3-4587-82da-b5a6d9c425e9-cert\") pod \"kserve-controller-manager-d6f4b65b8-lqdjs\" (UID: \"b54f4131-97b3-4587-82da-b5a6d9c425e9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lqdjs" Jul 12 16:29:23.547605 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:23.547585 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b54f4131-97b3-4587-82da-b5a6d9c425e9-cert\") pod \"kserve-controller-manager-d6f4b65b8-lqdjs\" (UID: \"b54f4131-97b3-4587-82da-b5a6d9c425e9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lqdjs" Jul 12 16:29:23.567493 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:23.567461 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pxcd" event={"ID":"65f26595-63f4-4127-83b1-ff7d7a09b091","Type":"ContainerStarted","Data":"eae1dc8ca3f5bf92d3fe5bbdeefcac1685453496b24a782e31ccc794ed59398b"} Jul 12 16:29:23.567660 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:23.567649 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:23.568553 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:23.568535 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dv976c" Jul 12 16:29:23.727432 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:23.727393 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lqdjs" Jul 12 16:29:23.906117 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:23.906070 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lqdjs"] Jul 12 16:29:23.907419 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:29:23.907395 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb54f4131_97b3_4587_82da_b5a6d9c425e9.slice/crio-ea3736a40294b20e7b31cc0ed81f6c60bd39506e010d62934e1edf9d84011a4c WatchSource:0}: Error finding container ea3736a40294b20e7b31cc0ed81f6c60bd39506e010d62934e1edf9d84011a4c: Status 404 returned error can't find the container with id ea3736a40294b20e7b31cc0ed81f6c60bd39506e010d62934e1edf9d84011a4c Jul 12 16:29:24.574849 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:24.574810 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lqdjs" event={"ID":"b54f4131-97b3-4587-82da-b5a6d9c425e9","Type":"ContainerStarted","Data":"ea3736a40294b20e7b31cc0ed81f6c60bd39506e010d62934e1edf9d84011a4c"} Jul 12 16:29:26.531541 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:26.531515 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-4bzdk" Jul 12 16:29:26.590561 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:26.590526 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lqdjs" event={"ID":"b54f4131-97b3-4587-82da-b5a6d9c425e9","Type":"ContainerStarted","Data":"0165d4cc81ee5d332873b50891c7eb27d7d64b7f1ff9c2f2c17a9662b45ce31c"} Jul 12 16:29:26.590722 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:26.590633 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lqdjs" Jul 12 16:29:27.595955 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:27.595916 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pxcd" event={"ID":"65f26595-63f4-4127-83b1-ff7d7a09b091","Type":"ContainerStarted","Data":"adc3082b1d829a48158beafc9e1e07dca1631e730e033df802fca35908c24f87"} Jul 12 16:29:27.615459 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:27.615397 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lqdjs" podStartSLOduration=3.009729971 podStartE2EDuration="5.615376538s" totalImagesPullingTime="2.605646567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:29:26.62037937 +0000 UTC m=+333.073767355" watchObservedRunningTime="2026-07-12 16:29:27.615376538 +0000 UTC m=+334.068764526" Jul 12 16:29:27.616225 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:27.616192 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pxcd" podStartSLOduration=2.4135615489999998 podStartE2EDuration="5.616177687s" totalImagesPullingTime="3.202616138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:29:27.615019204 +0000 UTC m=+334.068407202" watchObservedRunningTime="2026-07-12 16:29:27.616177687 +0000 UTC m=+334.069565697" Jul 12 16:29:28.600843 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:28.600814 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pxcd" Jul 12 16:29:57.601135 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:57.601028 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lqdjs" Jul 12 16:29:59.607428 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:29:59.607393 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pxcd" Jul 12 16:30:27.014956 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.014912 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb"] Jul 12 16:30:27.018586 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.018567 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb" Jul 12 16:30:27.021349 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.021321 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 12 16:30:27.021554 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.021540 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-h4rrx\"" Jul 12 16:30:27.022614 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.022591 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 12 16:30:27.027869 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.027844 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb"] Jul 12 16:30:27.052856 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.052819 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b44fcaea-f15c-43b3-9910-de8b1982a9ec-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb\" (UID: \"b44fcaea-f15c-43b3-9910-de8b1982a9ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb" Jul 12 16:30:27.052856 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.052859 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsg8t\" (UniqueName: \"kubernetes.io/projected/b44fcaea-f15c-43b3-9910-de8b1982a9ec-kube-api-access-lsg8t\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb\" (UID: \"b44fcaea-f15c-43b3-9910-de8b1982a9ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb" Jul 12 16:30:27.053053 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.052917 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b44fcaea-f15c-43b3-9910-de8b1982a9ec-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb\" (UID: \"b44fcaea-f15c-43b3-9910-de8b1982a9ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb" Jul 12 16:30:27.154402 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.154350 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b44fcaea-f15c-43b3-9910-de8b1982a9ec-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb\" (UID: \"b44fcaea-f15c-43b3-9910-de8b1982a9ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb" Jul 12 16:30:27.154402 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.154405 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsg8t\" (UniqueName: \"kubernetes.io/projected/b44fcaea-f15c-43b3-9910-de8b1982a9ec-kube-api-access-lsg8t\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb\" (UID: \"b44fcaea-f15c-43b3-9910-de8b1982a9ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb" Jul 12 16:30:27.154660 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.154449 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b44fcaea-f15c-43b3-9910-de8b1982a9ec-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb\" (UID: \"b44fcaea-f15c-43b3-9910-de8b1982a9ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb" Jul 12 16:30:27.154767 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.154726 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b44fcaea-f15c-43b3-9910-de8b1982a9ec-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb\" (UID: \"b44fcaea-f15c-43b3-9910-de8b1982a9ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb" Jul 12 16:30:27.154830 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.154766 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b44fcaea-f15c-43b3-9910-de8b1982a9ec-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb\" (UID: \"b44fcaea-f15c-43b3-9910-de8b1982a9ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb" Jul 12 16:30:27.162935 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.162913 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsg8t\" (UniqueName: \"kubernetes.io/projected/b44fcaea-f15c-43b3-9910-de8b1982a9ec-kube-api-access-lsg8t\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb\" (UID: \"b44fcaea-f15c-43b3-9910-de8b1982a9ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb" Jul 12 16:30:27.329260 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.329177 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb" Jul 12 16:30:27.470141 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.470114 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb"] Jul 12 16:30:27.472839 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:30:27.472811 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb44fcaea_f15c_43b3_9910_de8b1982a9ec.slice/crio-1d561c4e2743820df26a9647c3f1c31b3bef8a1b3dcc7f6765682678d508185b WatchSource:0}: Error finding container 1d561c4e2743820df26a9647c3f1c31b3bef8a1b3dcc7f6765682678d508185b: Status 404 returned error can't find the container with id 1d561c4e2743820df26a9647c3f1c31b3bef8a1b3dcc7f6765682678d508185b Jul 12 16:30:27.611560 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.611532 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9"] Jul 12 16:30:27.614893 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.614875 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9" Jul 12 16:30:27.623283 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.623258 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9"] Jul 12 16:30:27.658710 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.658677 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2ffb\" (UniqueName: \"kubernetes.io/projected/c367ebc9-04f3-402a-ba79-277c627092e8-kube-api-access-f2ffb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9\" (UID: \"c367ebc9-04f3-402a-ba79-277c627092e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9" Jul 12 16:30:27.658859 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.658725 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c367ebc9-04f3-402a-ba79-277c627092e8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9\" (UID: \"c367ebc9-04f3-402a-ba79-277c627092e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9" Jul 12 16:30:27.658859 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.658797 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c367ebc9-04f3-402a-ba79-277c627092e8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9\" (UID: \"c367ebc9-04f3-402a-ba79-277c627092e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9" Jul 12 16:30:27.760256 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.760218 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c367ebc9-04f3-402a-ba79-277c627092e8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9\" (UID: \"c367ebc9-04f3-402a-ba79-277c627092e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9" Jul 12 16:30:27.760444 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.760269 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c367ebc9-04f3-402a-ba79-277c627092e8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9\" (UID: \"c367ebc9-04f3-402a-ba79-277c627092e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9" Jul 12 16:30:27.760444 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.760328 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2ffb\" (UniqueName: \"kubernetes.io/projected/c367ebc9-04f3-402a-ba79-277c627092e8-kube-api-access-f2ffb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9\" (UID: \"c367ebc9-04f3-402a-ba79-277c627092e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9" Jul 12 16:30:27.760682 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.760661 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c367ebc9-04f3-402a-ba79-277c627092e8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9\" (UID: \"c367ebc9-04f3-402a-ba79-277c627092e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9" Jul 12 16:30:27.760756 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.760703 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c367ebc9-04f3-402a-ba79-277c627092e8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9\" (UID: \"c367ebc9-04f3-402a-ba79-277c627092e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9" Jul 12 16:30:27.768513 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.768488 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2ffb\" (UniqueName: \"kubernetes.io/projected/c367ebc9-04f3-402a-ba79-277c627092e8-kube-api-access-f2ffb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9\" (UID: \"c367ebc9-04f3-402a-ba79-277c627092e8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9" Jul 12 16:30:27.881000 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.880921 2559 generic.go:356] "Generic (PLEG): container finished" podID="b44fcaea-f15c-43b3-9910-de8b1982a9ec" containerID="3a8bcd21692ecf32e7f860d7bc1c485f63b0ec1a523ab9a7ce6dfb13a14163f5" exitCode=0 Jul 12 16:30:27.881154 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.881011 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb" event={"ID":"b44fcaea-f15c-43b3-9910-de8b1982a9ec","Type":"ContainerDied","Data":"3a8bcd21692ecf32e7f860d7bc1c485f63b0ec1a523ab9a7ce6dfb13a14163f5"} Jul 12 16:30:27.881154 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.881065 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb" event={"ID":"b44fcaea-f15c-43b3-9910-de8b1982a9ec","Type":"ContainerStarted","Data":"1d561c4e2743820df26a9647c3f1c31b3bef8a1b3dcc7f6765682678d508185b"} Jul 12 16:30:27.951334 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:27.951296 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9" Jul 12 16:30:28.011879 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.011849 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh"] Jul 12 16:30:28.016341 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.016318 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh" Jul 12 16:30:28.022533 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.022509 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh"] Jul 12 16:30:28.062578 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.062548 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnnd7\" (UniqueName: \"kubernetes.io/projected/a7a09d6a-faa8-4439-b3b7-ed96fb76a93f-kube-api-access-cnnd7\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh\" (UID: \"a7a09d6a-faa8-4439-b3b7-ed96fb76a93f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh" Jul 12 16:30:28.062737 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.062673 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7a09d6a-faa8-4439-b3b7-ed96fb76a93f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh\" (UID: \"a7a09d6a-faa8-4439-b3b7-ed96fb76a93f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh" Jul 12 16:30:28.062737 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.062733 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7a09d6a-faa8-4439-b3b7-ed96fb76a93f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh\" (UID: \"a7a09d6a-faa8-4439-b3b7-ed96fb76a93f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh" Jul 12 16:30:28.088327 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.088301 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9"] Jul 12 16:30:28.089510 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:30:28.089483 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc367ebc9_04f3_402a_ba79_277c627092e8.slice/crio-877b91a749b7577eb66e454d753832f6d034b2a8b7a50973662ed7d859772236 WatchSource:0}: Error finding container 877b91a749b7577eb66e454d753832f6d034b2a8b7a50973662ed7d859772236: Status 404 returned error can't find the container with id 877b91a749b7577eb66e454d753832f6d034b2a8b7a50973662ed7d859772236 Jul 12 16:30:28.163313 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.163286 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7a09d6a-faa8-4439-b3b7-ed96fb76a93f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh\" (UID: \"a7a09d6a-faa8-4439-b3b7-ed96fb76a93f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh" Jul 12 16:30:28.163460 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.163340 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7a09d6a-faa8-4439-b3b7-ed96fb76a93f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh\" (UID: \"a7a09d6a-faa8-4439-b3b7-ed96fb76a93f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh" Jul 12 16:30:28.163460 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.163386 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnnd7\" (UniqueName: \"kubernetes.io/projected/a7a09d6a-faa8-4439-b3b7-ed96fb76a93f-kube-api-access-cnnd7\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh\" (UID: \"a7a09d6a-faa8-4439-b3b7-ed96fb76a93f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh" Jul 12 16:30:28.163746 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.163720 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7a09d6a-faa8-4439-b3b7-ed96fb76a93f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh\" (UID: \"a7a09d6a-faa8-4439-b3b7-ed96fb76a93f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh" Jul 12 16:30:28.163828 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.163740 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7a09d6a-faa8-4439-b3b7-ed96fb76a93f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh\" (UID: \"a7a09d6a-faa8-4439-b3b7-ed96fb76a93f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh" Jul 12 16:30:28.171433 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.171357 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnnd7\" (UniqueName: \"kubernetes.io/projected/a7a09d6a-faa8-4439-b3b7-ed96fb76a93f-kube-api-access-cnnd7\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh\" (UID: \"a7a09d6a-faa8-4439-b3b7-ed96fb76a93f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh" Jul 12 16:30:28.327428 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.327394 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh" Jul 12 16:30:28.408478 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.408448 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8"] Jul 12 16:30:28.422138 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.421051 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8" Jul 12 16:30:28.423854 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.422897 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8"] Jul 12 16:30:28.465863 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.465825 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bqxn\" (UniqueName: \"kubernetes.io/projected/9abb5ad0-5a40-49c4-9199-4a4d9be36b65-kube-api-access-2bqxn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8\" (UID: \"9abb5ad0-5a40-49c4-9199-4a4d9be36b65\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8" Jul 12 16:30:28.466214 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.466184 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9abb5ad0-5a40-49c4-9199-4a4d9be36b65-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8\" (UID: \"9abb5ad0-5a40-49c4-9199-4a4d9be36b65\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8" Jul 12 16:30:28.466315 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.466286 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9abb5ad0-5a40-49c4-9199-4a4d9be36b65-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8\" (UID: \"9abb5ad0-5a40-49c4-9199-4a4d9be36b65\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8" Jul 12 16:30:28.468047 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.468022 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh"] Jul 12 16:30:28.469952 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:30:28.469929 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7a09d6a_faa8_4439_b3b7_ed96fb76a93f.slice/crio-7af48bc7cd9c5305d136587c0c27e169ffdd2fad0fd3f9caa7a39409c65db927 WatchSource:0}: Error finding container 7af48bc7cd9c5305d136587c0c27e169ffdd2fad0fd3f9caa7a39409c65db927: Status 404 returned error can't find the container with id 7af48bc7cd9c5305d136587c0c27e169ffdd2fad0fd3f9caa7a39409c65db927 Jul 12 16:30:28.567816 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.567762 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9abb5ad0-5a40-49c4-9199-4a4d9be36b65-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8\" (UID: \"9abb5ad0-5a40-49c4-9199-4a4d9be36b65\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8" Jul 12 16:30:28.567923 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.567882 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9abb5ad0-5a40-49c4-9199-4a4d9be36b65-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8\" (UID: \"9abb5ad0-5a40-49c4-9199-4a4d9be36b65\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8" Jul 12 16:30:28.567964 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.567939 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bqxn\" (UniqueName: \"kubernetes.io/projected/9abb5ad0-5a40-49c4-9199-4a4d9be36b65-kube-api-access-2bqxn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8\" (UID: \"9abb5ad0-5a40-49c4-9199-4a4d9be36b65\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8" Jul 12 16:30:28.568155 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.568138 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9abb5ad0-5a40-49c4-9199-4a4d9be36b65-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8\" (UID: \"9abb5ad0-5a40-49c4-9199-4a4d9be36b65\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8" Jul 12 16:30:28.568200 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.568177 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9abb5ad0-5a40-49c4-9199-4a4d9be36b65-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8\" (UID: \"9abb5ad0-5a40-49c4-9199-4a4d9be36b65\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8" Jul 12 16:30:28.576505 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.576482 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bqxn\" (UniqueName: \"kubernetes.io/projected/9abb5ad0-5a40-49c4-9199-4a4d9be36b65-kube-api-access-2bqxn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8\" (UID: \"9abb5ad0-5a40-49c4-9199-4a4d9be36b65\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8" Jul 12 16:30:28.732987 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.732959 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8" Jul 12 16:30:28.869801 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.869775 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8"] Jul 12 16:30:28.871298 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:30:28.871274 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9abb5ad0_5a40_49c4_9199_4a4d9be36b65.slice/crio-599dfd3a278990992c58bbf82f52c6d3b71a374d34977165a1e597b47922b65c WatchSource:0}: Error finding container 599dfd3a278990992c58bbf82f52c6d3b71a374d34977165a1e597b47922b65c: Status 404 returned error can't find the container with id 599dfd3a278990992c58bbf82f52c6d3b71a374d34977165a1e597b47922b65c Jul 12 16:30:28.888475 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.888438 2559 generic.go:356] "Generic (PLEG): container finished" podID="b44fcaea-f15c-43b3-9910-de8b1982a9ec" containerID="fcf20eecdebf487362bd409535d0a0872d753aa37edb4f9451a6106f12da299e" exitCode=0 Jul 12 16:30:28.888594 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.888523 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb" event={"ID":"b44fcaea-f15c-43b3-9910-de8b1982a9ec","Type":"ContainerDied","Data":"fcf20eecdebf487362bd409535d0a0872d753aa37edb4f9451a6106f12da299e"} Jul 12 16:30:28.889922 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.889890 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8" event={"ID":"9abb5ad0-5a40-49c4-9199-4a4d9be36b65","Type":"ContainerStarted","Data":"599dfd3a278990992c58bbf82f52c6d3b71a374d34977165a1e597b47922b65c"} Jul 12 16:30:28.891607 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.891586 2559 generic.go:356] "Generic (PLEG): container finished" podID="c367ebc9-04f3-402a-ba79-277c627092e8" containerID="810b70acc1b1ba29d0027b20506d828e57c74cfb716ff8238ca5fa09c3e42ec8" exitCode=0 Jul 12 16:30:28.891722 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.891656 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9" event={"ID":"c367ebc9-04f3-402a-ba79-277c627092e8","Type":"ContainerDied","Data":"810b70acc1b1ba29d0027b20506d828e57c74cfb716ff8238ca5fa09c3e42ec8"} Jul 12 16:30:28.891722 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.891716 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9" event={"ID":"c367ebc9-04f3-402a-ba79-277c627092e8","Type":"ContainerStarted","Data":"877b91a749b7577eb66e454d753832f6d034b2a8b7a50973662ed7d859772236"} Jul 12 16:30:28.893571 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.893510 2559 generic.go:356] "Generic (PLEG): container finished" podID="a7a09d6a-faa8-4439-b3b7-ed96fb76a93f" containerID="6cdbedbe949617e0463d182125e9eb64416b5b68a87ef4614f073e4a49ddd39f" exitCode=0 Jul 12 16:30:28.893651 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.893593 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh" event={"ID":"a7a09d6a-faa8-4439-b3b7-ed96fb76a93f","Type":"ContainerDied","Data":"6cdbedbe949617e0463d182125e9eb64416b5b68a87ef4614f073e4a49ddd39f"} Jul 12 16:30:28.893651 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:28.893636 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh" event={"ID":"a7a09d6a-faa8-4439-b3b7-ed96fb76a93f","Type":"ContainerStarted","Data":"7af48bc7cd9c5305d136587c0c27e169ffdd2fad0fd3f9caa7a39409c65db927"} Jul 12 16:30:29.899920 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:29.899889 2559 generic.go:356] "Generic (PLEG): container finished" podID="9abb5ad0-5a40-49c4-9199-4a4d9be36b65" containerID="2ae39053abcf1464bcbf926aff4e1addc407ff014058daa423ce79f72c81d854" exitCode=0 Jul 12 16:30:29.900367 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:29.899965 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8" event={"ID":"9abb5ad0-5a40-49c4-9199-4a4d9be36b65","Type":"ContainerDied","Data":"2ae39053abcf1464bcbf926aff4e1addc407ff014058daa423ce79f72c81d854"} Jul 12 16:30:29.902278 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:29.902242 2559 generic.go:356] "Generic (PLEG): container finished" podID="c367ebc9-04f3-402a-ba79-277c627092e8" containerID="a974f6fb7081eba19d0f3b873ca52df7a373dc1d88c6048ff9078735eed510b9" exitCode=0 Jul 12 16:30:29.902380 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:29.902319 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9" event={"ID":"c367ebc9-04f3-402a-ba79-277c627092e8","Type":"ContainerDied","Data":"a974f6fb7081eba19d0f3b873ca52df7a373dc1d88c6048ff9078735eed510b9"} Jul 12 16:30:29.904738 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:29.904716 2559 generic.go:356] "Generic (PLEG): container finished" podID="b44fcaea-f15c-43b3-9910-de8b1982a9ec" containerID="73196680220dea05d1446ba266c62154af8d720e97b71f77ad33267bd9709690" exitCode=0 Jul 12 16:30:29.904827 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:29.904773 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb" event={"ID":"b44fcaea-f15c-43b3-9910-de8b1982a9ec","Type":"ContainerDied","Data":"73196680220dea05d1446ba266c62154af8d720e97b71f77ad33267bd9709690"} Jul 12 16:30:30.911155 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:30.911120 2559 generic.go:356] "Generic (PLEG): container finished" podID="9abb5ad0-5a40-49c4-9199-4a4d9be36b65" containerID="f4051e36f18379f0c9978474bc2b324cf77e57287b54290b0ebb35cd67f40fd8" exitCode=0 Jul 12 16:30:30.911570 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:30.911156 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8" event={"ID":"9abb5ad0-5a40-49c4-9199-4a4d9be36b65","Type":"ContainerDied","Data":"f4051e36f18379f0c9978474bc2b324cf77e57287b54290b0ebb35cd67f40fd8"} Jul 12 16:30:30.913509 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:30.913487 2559 generic.go:356] "Generic (PLEG): container finished" podID="c367ebc9-04f3-402a-ba79-277c627092e8" containerID="4d49df037f088ac051ac2d45cb73c85d7ebf4bcbd794963b7d97c3d61a5e8c1c" exitCode=0 Jul 12 16:30:30.913594 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:30.913567 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9" event={"ID":"c367ebc9-04f3-402a-ba79-277c627092e8","Type":"ContainerDied","Data":"4d49df037f088ac051ac2d45cb73c85d7ebf4bcbd794963b7d97c3d61a5e8c1c"} Jul 12 16:30:30.915322 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:30.915303 2559 generic.go:356] "Generic (PLEG): container finished" podID="a7a09d6a-faa8-4439-b3b7-ed96fb76a93f" containerID="72432fb1d0090d5fc5904079abf21de18d434733c3a95225a4e816e66016ea4a" exitCode=0 Jul 12 16:30:30.915408 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:30.915375 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh" event={"ID":"a7a09d6a-faa8-4439-b3b7-ed96fb76a93f","Type":"ContainerDied","Data":"72432fb1d0090d5fc5904079abf21de18d434733c3a95225a4e816e66016ea4a"} Jul 12 16:30:31.073754 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:31.073724 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb" Jul 12 16:30:31.191869 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:31.191786 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsg8t\" (UniqueName: \"kubernetes.io/projected/b44fcaea-f15c-43b3-9910-de8b1982a9ec-kube-api-access-lsg8t\") pod \"b44fcaea-f15c-43b3-9910-de8b1982a9ec\" (UID: \"b44fcaea-f15c-43b3-9910-de8b1982a9ec\") " Jul 12 16:30:31.192000 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:31.191872 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b44fcaea-f15c-43b3-9910-de8b1982a9ec-util\") pod \"b44fcaea-f15c-43b3-9910-de8b1982a9ec\" (UID: \"b44fcaea-f15c-43b3-9910-de8b1982a9ec\") " Jul 12 16:30:31.192000 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:31.191909 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b44fcaea-f15c-43b3-9910-de8b1982a9ec-bundle\") pod \"b44fcaea-f15c-43b3-9910-de8b1982a9ec\" (UID: \"b44fcaea-f15c-43b3-9910-de8b1982a9ec\") " Jul 12 16:30:31.192454 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:31.192424 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b44fcaea-f15c-43b3-9910-de8b1982a9ec-bundle" (OuterVolumeSpecName: "bundle") pod "b44fcaea-f15c-43b3-9910-de8b1982a9ec" (UID: "b44fcaea-f15c-43b3-9910-de8b1982a9ec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:30:31.194218 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:31.194193 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b44fcaea-f15c-43b3-9910-de8b1982a9ec-kube-api-access-lsg8t" (OuterVolumeSpecName: "kube-api-access-lsg8t") pod "b44fcaea-f15c-43b3-9910-de8b1982a9ec" (UID: "b44fcaea-f15c-43b3-9910-de8b1982a9ec"). InnerVolumeSpecName "kube-api-access-lsg8t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 16:30:31.197663 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:31.197634 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b44fcaea-f15c-43b3-9910-de8b1982a9ec-util" (OuterVolumeSpecName: "util") pod "b44fcaea-f15c-43b3-9910-de8b1982a9ec" (UID: "b44fcaea-f15c-43b3-9910-de8b1982a9ec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:30:31.292983 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:31.292951 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b44fcaea-f15c-43b3-9910-de8b1982a9ec-util\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:30:31.292983 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:31.292977 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b44fcaea-f15c-43b3-9910-de8b1982a9ec-bundle\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:30:31.292983 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:31.292986 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsg8t\" (UniqueName: \"kubernetes.io/projected/b44fcaea-f15c-43b3-9910-de8b1982a9ec-kube-api-access-lsg8t\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:30:31.922662 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:31.922627 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb" Jul 12 16:30:31.922662 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:31.922656 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb" event={"ID":"b44fcaea-f15c-43b3-9910-de8b1982a9ec","Type":"ContainerDied","Data":"1d561c4e2743820df26a9647c3f1c31b3bef8a1b3dcc7f6765682678d508185b"} Jul 12 16:30:31.923134 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:31.922707 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d561c4e2743820df26a9647c3f1c31b3bef8a1b3dcc7f6765682678d508185b" Jul 12 16:30:31.931033 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:31.931005 2559 generic.go:356] "Generic (PLEG): container finished" podID="9abb5ad0-5a40-49c4-9199-4a4d9be36b65" containerID="6de120daeb55e46008c376ced1a379731539ed72c411d3fa6eef0d5983f918f0" exitCode=0 Jul 12 16:30:31.931204 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:31.931043 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8" event={"ID":"9abb5ad0-5a40-49c4-9199-4a4d9be36b65","Type":"ContainerDied","Data":"6de120daeb55e46008c376ced1a379731539ed72c411d3fa6eef0d5983f918f0"} Jul 12 16:30:31.933526 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:31.933489 2559 generic.go:356] "Generic (PLEG): container finished" podID="a7a09d6a-faa8-4439-b3b7-ed96fb76a93f" containerID="0272eb824eebc26f655eb1a618ae3fc8c797f2ae14e19b8fe3636df2b7b5dc3c" exitCode=0 Jul 12 16:30:31.933526 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:31.933516 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh" event={"ID":"a7a09d6a-faa8-4439-b3b7-ed96fb76a93f","Type":"ContainerDied","Data":"0272eb824eebc26f655eb1a618ae3fc8c797f2ae14e19b8fe3636df2b7b5dc3c"} Jul 12 16:30:32.069719 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:32.069692 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9" Jul 12 16:30:32.200209 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:32.200121 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c367ebc9-04f3-402a-ba79-277c627092e8-bundle\") pod \"c367ebc9-04f3-402a-ba79-277c627092e8\" (UID: \"c367ebc9-04f3-402a-ba79-277c627092e8\") " Jul 12 16:30:32.200209 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:32.200164 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2ffb\" (UniqueName: \"kubernetes.io/projected/c367ebc9-04f3-402a-ba79-277c627092e8-kube-api-access-f2ffb\") pod \"c367ebc9-04f3-402a-ba79-277c627092e8\" (UID: \"c367ebc9-04f3-402a-ba79-277c627092e8\") " Jul 12 16:30:32.200535 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:32.200222 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c367ebc9-04f3-402a-ba79-277c627092e8-util\") pod \"c367ebc9-04f3-402a-ba79-277c627092e8\" (UID: \"c367ebc9-04f3-402a-ba79-277c627092e8\") " Jul 12 16:30:32.200643 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:32.200622 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c367ebc9-04f3-402a-ba79-277c627092e8-bundle" (OuterVolumeSpecName: "bundle") pod "c367ebc9-04f3-402a-ba79-277c627092e8" (UID: "c367ebc9-04f3-402a-ba79-277c627092e8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:30:32.202499 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:32.202469 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c367ebc9-04f3-402a-ba79-277c627092e8-kube-api-access-f2ffb" (OuterVolumeSpecName: "kube-api-access-f2ffb") pod "c367ebc9-04f3-402a-ba79-277c627092e8" (UID: "c367ebc9-04f3-402a-ba79-277c627092e8"). InnerVolumeSpecName "kube-api-access-f2ffb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 16:30:32.205888 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:32.205858 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c367ebc9-04f3-402a-ba79-277c627092e8-util" (OuterVolumeSpecName: "util") pod "c367ebc9-04f3-402a-ba79-277c627092e8" (UID: "c367ebc9-04f3-402a-ba79-277c627092e8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:30:32.300855 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:32.300820 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c367ebc9-04f3-402a-ba79-277c627092e8-bundle\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:30:32.300855 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:32.300853 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2ffb\" (UniqueName: \"kubernetes.io/projected/c367ebc9-04f3-402a-ba79-277c627092e8-kube-api-access-f2ffb\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:30:32.300855 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:32.300862 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c367ebc9-04f3-402a-ba79-277c627092e8-util\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:30:32.940268 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:32.940241 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9" Jul 12 16:30:32.940640 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:32.940267 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9" event={"ID":"c367ebc9-04f3-402a-ba79-277c627092e8","Type":"ContainerDied","Data":"877b91a749b7577eb66e454d753832f6d034b2a8b7a50973662ed7d859772236"} Jul 12 16:30:32.940640 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:32.940322 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="877b91a749b7577eb66e454d753832f6d034b2a8b7a50973662ed7d859772236" Jul 12 16:30:33.101903 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.101882 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8" Jul 12 16:30:33.103935 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.103917 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh" Jul 12 16:30:33.210765 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.210692 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9abb5ad0-5a40-49c4-9199-4a4d9be36b65-bundle\") pod \"9abb5ad0-5a40-49c4-9199-4a4d9be36b65\" (UID: \"9abb5ad0-5a40-49c4-9199-4a4d9be36b65\") " Jul 12 16:30:33.210765 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.210750 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bqxn\" (UniqueName: \"kubernetes.io/projected/9abb5ad0-5a40-49c4-9199-4a4d9be36b65-kube-api-access-2bqxn\") pod \"9abb5ad0-5a40-49c4-9199-4a4d9be36b65\" (UID: \"9abb5ad0-5a40-49c4-9199-4a4d9be36b65\") " Jul 12 16:30:33.210929 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.210777 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7a09d6a-faa8-4439-b3b7-ed96fb76a93f-bundle\") pod \"a7a09d6a-faa8-4439-b3b7-ed96fb76a93f\" (UID: \"a7a09d6a-faa8-4439-b3b7-ed96fb76a93f\") " Jul 12 16:30:33.210929 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.210832 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9abb5ad0-5a40-49c4-9199-4a4d9be36b65-util\") pod \"9abb5ad0-5a40-49c4-9199-4a4d9be36b65\" (UID: \"9abb5ad0-5a40-49c4-9199-4a4d9be36b65\") " Jul 12 16:30:33.210929 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.210855 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7a09d6a-faa8-4439-b3b7-ed96fb76a93f-util\") pod \"a7a09d6a-faa8-4439-b3b7-ed96fb76a93f\" (UID: \"a7a09d6a-faa8-4439-b3b7-ed96fb76a93f\") " Jul 12 16:30:33.210929 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.210893 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnnd7\" (UniqueName: \"kubernetes.io/projected/a7a09d6a-faa8-4439-b3b7-ed96fb76a93f-kube-api-access-cnnd7\") pod \"a7a09d6a-faa8-4439-b3b7-ed96fb76a93f\" (UID: \"a7a09d6a-faa8-4439-b3b7-ed96fb76a93f\") " Jul 12 16:30:33.211409 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.211381 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7a09d6a-faa8-4439-b3b7-ed96fb76a93f-bundle" (OuterVolumeSpecName: "bundle") pod "a7a09d6a-faa8-4439-b3b7-ed96fb76a93f" (UID: "a7a09d6a-faa8-4439-b3b7-ed96fb76a93f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:30:33.211536 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.211448 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9abb5ad0-5a40-49c4-9199-4a4d9be36b65-bundle" (OuterVolumeSpecName: "bundle") pod "9abb5ad0-5a40-49c4-9199-4a4d9be36b65" (UID: "9abb5ad0-5a40-49c4-9199-4a4d9be36b65"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:30:33.213380 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.213352 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7a09d6a-faa8-4439-b3b7-ed96fb76a93f-kube-api-access-cnnd7" (OuterVolumeSpecName: "kube-api-access-cnnd7") pod "a7a09d6a-faa8-4439-b3b7-ed96fb76a93f" (UID: "a7a09d6a-faa8-4439-b3b7-ed96fb76a93f"). InnerVolumeSpecName "kube-api-access-cnnd7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 16:30:33.213476 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.213430 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9abb5ad0-5a40-49c4-9199-4a4d9be36b65-kube-api-access-2bqxn" (OuterVolumeSpecName: "kube-api-access-2bqxn") pod "9abb5ad0-5a40-49c4-9199-4a4d9be36b65" (UID: "9abb5ad0-5a40-49c4-9199-4a4d9be36b65"). InnerVolumeSpecName "kube-api-access-2bqxn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 16:30:33.216316 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.216298 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9abb5ad0-5a40-49c4-9199-4a4d9be36b65-util" (OuterVolumeSpecName: "util") pod "9abb5ad0-5a40-49c4-9199-4a4d9be36b65" (UID: "9abb5ad0-5a40-49c4-9199-4a4d9be36b65"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:30:33.217405 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.217387 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7a09d6a-faa8-4439-b3b7-ed96fb76a93f-util" (OuterVolumeSpecName: "util") pod "a7a09d6a-faa8-4439-b3b7-ed96fb76a93f" (UID: "a7a09d6a-faa8-4439-b3b7-ed96fb76a93f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:30:33.312369 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.312331 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnnd7\" (UniqueName: \"kubernetes.io/projected/a7a09d6a-faa8-4439-b3b7-ed96fb76a93f-kube-api-access-cnnd7\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:30:33.312369 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.312362 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9abb5ad0-5a40-49c4-9199-4a4d9be36b65-bundle\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:30:33.312369 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.312374 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bqxn\" (UniqueName: \"kubernetes.io/projected/9abb5ad0-5a40-49c4-9199-4a4d9be36b65-kube-api-access-2bqxn\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:30:33.312612 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.312386 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7a09d6a-faa8-4439-b3b7-ed96fb76a93f-bundle\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:30:33.312612 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.312397 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9abb5ad0-5a40-49c4-9199-4a4d9be36b65-util\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:30:33.312612 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.312408 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7a09d6a-faa8-4439-b3b7-ed96fb76a93f-util\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:30:33.946988 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.946950 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8" Jul 12 16:30:33.946988 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.946973 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8" event={"ID":"9abb5ad0-5a40-49c4-9199-4a4d9be36b65","Type":"ContainerDied","Data":"599dfd3a278990992c58bbf82f52c6d3b71a374d34977165a1e597b47922b65c"} Jul 12 16:30:33.947463 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.947031 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="599dfd3a278990992c58bbf82f52c6d3b71a374d34977165a1e597b47922b65c" Jul 12 16:30:33.948800 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.948777 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh" Jul 12 16:30:33.948903 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.948774 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh" event={"ID":"a7a09d6a-faa8-4439-b3b7-ed96fb76a93f","Type":"ContainerDied","Data":"7af48bc7cd9c5305d136587c0c27e169ffdd2fad0fd3f9caa7a39409c65db927"} Jul 12 16:30:33.948903 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:33.948899 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7af48bc7cd9c5305d136587c0c27e169ffdd2fad0fd3f9caa7a39409c65db927" Jul 12 16:30:52.521889 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.521855 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rt7lv"] Jul 12 16:30:52.522293 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522194 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9abb5ad0-5a40-49c4-9199-4a4d9be36b65" containerName="pull" Jul 12 16:30:52.522293 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522207 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9abb5ad0-5a40-49c4-9199-4a4d9be36b65" containerName="pull" Jul 12 16:30:52.522293 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522214 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9abb5ad0-5a40-49c4-9199-4a4d9be36b65" containerName="extract" Jul 12 16:30:52.522293 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522220 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9abb5ad0-5a40-49c4-9199-4a4d9be36b65" containerName="extract" Jul 12 16:30:52.522293 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522231 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7a09d6a-faa8-4439-b3b7-ed96fb76a93f" containerName="pull" Jul 12 16:30:52.522293 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522236 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7a09d6a-faa8-4439-b3b7-ed96fb76a93f" containerName="pull" Jul 12 16:30:52.522293 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522244 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c367ebc9-04f3-402a-ba79-277c627092e8" containerName="util" Jul 12 16:30:52.522293 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522248 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c367ebc9-04f3-402a-ba79-277c627092e8" containerName="util" Jul 12 16:30:52.522293 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522258 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b44fcaea-f15c-43b3-9910-de8b1982a9ec" containerName="pull" Jul 12 16:30:52.522293 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522264 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b44fcaea-f15c-43b3-9910-de8b1982a9ec" containerName="pull" Jul 12 16:30:52.522293 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522270 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b44fcaea-f15c-43b3-9910-de8b1982a9ec" containerName="extract" Jul 12 16:30:52.522293 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522275 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b44fcaea-f15c-43b3-9910-de8b1982a9ec" containerName="extract" Jul 12 16:30:52.522293 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522283 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7a09d6a-faa8-4439-b3b7-ed96fb76a93f" containerName="extract" Jul 12 16:30:52.522293 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522288 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7a09d6a-faa8-4439-b3b7-ed96fb76a93f" containerName="extract" Jul 12 16:30:52.522293 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522296 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7a09d6a-faa8-4439-b3b7-ed96fb76a93f" containerName="util" Jul 12 16:30:52.522293 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522301 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7a09d6a-faa8-4439-b3b7-ed96fb76a93f" containerName="util" Jul 12 16:30:52.522777 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522311 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c367ebc9-04f3-402a-ba79-277c627092e8" containerName="extract" Jul 12 16:30:52.522777 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522316 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c367ebc9-04f3-402a-ba79-277c627092e8" containerName="extract" Jul 12 16:30:52.522777 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522323 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9abb5ad0-5a40-49c4-9199-4a4d9be36b65" containerName="util" Jul 12 16:30:52.522777 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522327 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9abb5ad0-5a40-49c4-9199-4a4d9be36b65" containerName="util" Jul 12 16:30:52.522777 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522333 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c367ebc9-04f3-402a-ba79-277c627092e8" containerName="pull" Jul 12 16:30:52.522777 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522337 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c367ebc9-04f3-402a-ba79-277c627092e8" containerName="pull" Jul 12 16:30:52.522777 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522344 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b44fcaea-f15c-43b3-9910-de8b1982a9ec" containerName="util" Jul 12 16:30:52.522777 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522349 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b44fcaea-f15c-43b3-9910-de8b1982a9ec" containerName="util" Jul 12 16:30:52.522777 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522409 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9abb5ad0-5a40-49c4-9199-4a4d9be36b65" containerName="extract" Jul 12 16:30:52.522777 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522420 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c367ebc9-04f3-402a-ba79-277c627092e8" containerName="extract" Jul 12 16:30:52.522777 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522427 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b44fcaea-f15c-43b3-9910-de8b1982a9ec" containerName="extract" Jul 12 16:30:52.522777 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.522438 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7a09d6a-faa8-4439-b3b7-ed96fb76a93f" containerName="extract" Jul 12 16:30:52.527380 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.527362 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rt7lv" Jul 12 16:30:52.530336 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.530312 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 12 16:30:52.531314 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.531295 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-ljc29\"" Jul 12 16:30:52.531396 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.531304 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 12 16:30:52.541141 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.541120 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rt7lv"] Jul 12 16:30:52.672682 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.672648 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjjjg\" (UniqueName: \"kubernetes.io/projected/f488b89f-f121-4857-80f5-49d6654e45aa-kube-api-access-sjjjg\") pod \"limitador-operator-controller-manager-859d7b78bd-rt7lv\" (UID: \"f488b89f-f121-4857-80f5-49d6654e45aa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rt7lv" Jul 12 16:30:52.773590 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.773501 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjjjg\" (UniqueName: \"kubernetes.io/projected/f488b89f-f121-4857-80f5-49d6654e45aa-kube-api-access-sjjjg\") pod \"limitador-operator-controller-manager-859d7b78bd-rt7lv\" (UID: \"f488b89f-f121-4857-80f5-49d6654e45aa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rt7lv" Jul 12 16:30:52.782189 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.782153 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjjjg\" (UniqueName: \"kubernetes.io/projected/f488b89f-f121-4857-80f5-49d6654e45aa-kube-api-access-sjjjg\") pod \"limitador-operator-controller-manager-859d7b78bd-rt7lv\" (UID: \"f488b89f-f121-4857-80f5-49d6654e45aa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rt7lv" Jul 12 16:30:52.838187 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.838131 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rt7lv" Jul 12 16:30:52.983639 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:52.983613 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rt7lv"] Jul 12 16:30:52.985112 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:30:52.985069 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf488b89f_f121_4857_80f5_49d6654e45aa.slice/crio-ff2e15e57545dcd26d3584e978e030983ca4ad451cbaaf259693af73c2371424 WatchSource:0}: Error finding container ff2e15e57545dcd26d3584e978e030983ca4ad451cbaaf259693af73c2371424: Status 404 returned error can't find the container with id ff2e15e57545dcd26d3584e978e030983ca4ad451cbaaf259693af73c2371424 Jul 12 16:30:53.045256 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:53.045171 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rt7lv" event={"ID":"f488b89f-f121-4857-80f5-49d6654e45aa","Type":"ContainerStarted","Data":"ff2e15e57545dcd26d3584e978e030983ca4ad451cbaaf259693af73c2371424"} Jul 12 16:30:55.057898 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:55.057854 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rt7lv" event={"ID":"f488b89f-f121-4857-80f5-49d6654e45aa","Type":"ContainerStarted","Data":"7609f66baab52f09110598af398ce45da38abcc89a2daa069cef283022993715"} Jul 12 16:30:55.058272 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:55.058031 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rt7lv" Jul 12 16:30:55.077422 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:30:55.077374 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rt7lv" podStartSLOduration=1.16876644 podStartE2EDuration="3.077358414s" totalImagesPullingTime="1.908591974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:30:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:30:55.07481431 +0000 UTC m=+421.528202320" watchObservedRunningTime="2026-07-12 16:30:55.077358414 +0000 UTC m=+421.530746400" Jul 12 16:31:06.064700 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:06.064666 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rt7lv" Jul 12 16:31:07.745989 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:07.745950 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-869464ddbd-2gzdk"] Jul 12 16:31:11.232587 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:11.232540 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rt7lv"] Jul 12 16:31:11.233008 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:11.232754 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rt7lv" podUID="f488b89f-f121-4857-80f5-49d6654e45aa" containerName="manager" containerID="cri-o://7609f66baab52f09110598af398ce45da38abcc89a2daa069cef283022993715" gracePeriod=2 Jul 12 16:31:11.236676 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:31:11.236627 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rt7lv\" is forbidden: User \"system:node:ip-10-0-130-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-204.ec2.internal' and this object" podUID="f488b89f-f121-4857-80f5-49d6654e45aa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rt7lv" Jul 12 16:31:11.239142 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:11.239047 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rt7lv"] Jul 12 16:31:11.289676 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:11.289641 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pwm8t"] Jul 12 16:31:11.290209 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:11.290190 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f488b89f-f121-4857-80f5-49d6654e45aa" containerName="manager" Jul 12 16:31:11.290259 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:11.290213 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f488b89f-f121-4857-80f5-49d6654e45aa" containerName="manager" Jul 12 16:31:11.290316 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:11.290303 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f488b89f-f121-4857-80f5-49d6654e45aa" containerName="manager" Jul 12 16:31:11.293559 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:11.293536 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pwm8t" Jul 12 16:31:11.298016 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:31:11.297983 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rt7lv\" is forbidden: User \"system:node:ip-10-0-130-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-204.ec2.internal' and this object" podUID="f488b89f-f121-4857-80f5-49d6654e45aa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rt7lv" Jul 12 16:31:11.310491 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:11.310463 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pwm8t"] Jul 12 16:31:11.331358 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:11.331334 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56qmq\" (UniqueName: \"kubernetes.io/projected/686928c6-d394-48d2-aa80-1f05c644a8c2-kube-api-access-56qmq\") pod \"limitador-operator-controller-manager-859d7b78bd-pwm8t\" (UID: \"686928c6-d394-48d2-aa80-1f05c644a8c2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pwm8t" Jul 12 16:31:11.431679 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:11.431645 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56qmq\" (UniqueName: \"kubernetes.io/projected/686928c6-d394-48d2-aa80-1f05c644a8c2-kube-api-access-56qmq\") pod \"limitador-operator-controller-manager-859d7b78bd-pwm8t\" (UID: \"686928c6-d394-48d2-aa80-1f05c644a8c2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pwm8t" Jul 12 16:31:11.445043 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:11.445013 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56qmq\" (UniqueName: \"kubernetes.io/projected/686928c6-d394-48d2-aa80-1f05c644a8c2-kube-api-access-56qmq\") pod \"limitador-operator-controller-manager-859d7b78bd-pwm8t\" (UID: \"686928c6-d394-48d2-aa80-1f05c644a8c2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pwm8t" Jul 12 16:31:11.481812 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:11.481785 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rt7lv" Jul 12 16:31:11.484373 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:31:11.484317 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rt7lv\" is forbidden: User \"system:node:ip-10-0-130-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-204.ec2.internal' and this object" podUID="f488b89f-f121-4857-80f5-49d6654e45aa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rt7lv" Jul 12 16:31:11.532736 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:11.532697 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjjjg\" (UniqueName: \"kubernetes.io/projected/f488b89f-f121-4857-80f5-49d6654e45aa-kube-api-access-sjjjg\") pod \"f488b89f-f121-4857-80f5-49d6654e45aa\" (UID: \"f488b89f-f121-4857-80f5-49d6654e45aa\") " Jul 12 16:31:11.534870 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:11.534834 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f488b89f-f121-4857-80f5-49d6654e45aa-kube-api-access-sjjjg" (OuterVolumeSpecName: "kube-api-access-sjjjg") pod "f488b89f-f121-4857-80f5-49d6654e45aa" (UID: "f488b89f-f121-4857-80f5-49d6654e45aa"). InnerVolumeSpecName "kube-api-access-sjjjg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 16:31:11.624792 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:11.624762 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pwm8t" Jul 12 16:31:11.634019 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:11.633989 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjjjg\" (UniqueName: \"kubernetes.io/projected/f488b89f-f121-4857-80f5-49d6654e45aa-kube-api-access-sjjjg\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:31:11.774180 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:11.774155 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pwm8t"] Jul 12 16:31:11.775991 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:31:11.775966 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod686928c6_d394_48d2_aa80_1f05c644a8c2.slice/crio-f550c7ff24456295c5bfc95786f9b77508f1516836aff07468c2d487dba5dedf WatchSource:0}: Error finding container f550c7ff24456295c5bfc95786f9b77508f1516836aff07468c2d487dba5dedf: Status 404 returned error can't find the container with id f550c7ff24456295c5bfc95786f9b77508f1516836aff07468c2d487dba5dedf Jul 12 16:31:12.060150 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:12.060063 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f488b89f-f121-4857-80f5-49d6654e45aa" path="/var/lib/kubelet/pods/f488b89f-f121-4857-80f5-49d6654e45aa/volumes" Jul 12 16:31:12.144964 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:12.144932 2559 generic.go:356] "Generic (PLEG): container finished" podID="f488b89f-f121-4857-80f5-49d6654e45aa" containerID="7609f66baab52f09110598af398ce45da38abcc89a2daa069cef283022993715" exitCode=0 Jul 12 16:31:12.145211 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:12.144972 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rt7lv" Jul 12 16:31:12.145211 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:12.145029 2559 scope.go:117] "RemoveContainer" containerID="7609f66baab52f09110598af398ce45da38abcc89a2daa069cef283022993715" Jul 12 16:31:12.147150 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:12.147114 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pwm8t" event={"ID":"686928c6-d394-48d2-aa80-1f05c644a8c2","Type":"ContainerStarted","Data":"a1dd3f772a0f08f562e95fff5b75efa12afb613d4ad94e3c7eab696f915d1889"} Jul 12 16:31:12.147326 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:12.147168 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pwm8t" event={"ID":"686928c6-d394-48d2-aa80-1f05c644a8c2","Type":"ContainerStarted","Data":"f550c7ff24456295c5bfc95786f9b77508f1516836aff07468c2d487dba5dedf"} Jul 12 16:31:12.147447 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:12.147353 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pwm8t" Jul 12 16:31:12.154268 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:12.154245 2559 scope.go:117] "RemoveContainer" containerID="7609f66baab52f09110598af398ce45da38abcc89a2daa069cef283022993715" Jul 12 16:31:12.154535 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:31:12.154517 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7609f66baab52f09110598af398ce45da38abcc89a2daa069cef283022993715\": container with ID starting with 7609f66baab52f09110598af398ce45da38abcc89a2daa069cef283022993715 not found: ID does not exist" containerID="7609f66baab52f09110598af398ce45da38abcc89a2daa069cef283022993715" Jul 12 16:31:12.154575 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:12.154545 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7609f66baab52f09110598af398ce45da38abcc89a2daa069cef283022993715"} err="failed to get container status \"7609f66baab52f09110598af398ce45da38abcc89a2daa069cef283022993715\": rpc error: code = NotFound desc = could not find container \"7609f66baab52f09110598af398ce45da38abcc89a2daa069cef283022993715\": container with ID starting with 7609f66baab52f09110598af398ce45da38abcc89a2daa069cef283022993715 not found: ID does not exist" Jul 12 16:31:12.178435 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:12.178386 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pwm8t" podStartSLOduration=1.178371826 podStartE2EDuration="1.178371826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:31:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:31:12.176408662 +0000 UTC m=+438.629796648" watchObservedRunningTime="2026-07-12 16:31:12.178371826 +0000 UTC m=+438.631759811" Jul 12 16:31:23.156208 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:23.156131 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pwm8t" Jul 12 16:31:32.769069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:32.768998 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-869464ddbd-2gzdk" podUID="54c71635-7f1d-4024-a9af-2b23a917030e" containerName="console" containerID="cri-o://f1b3db886cd129ac8e854f4f014bf01d7c807ea59e31db2ec30af66555fdc27d" gracePeriod=15 Jul 12 16:31:33.017964 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.017939 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:31:33.112835 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.112746 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54c71635-7f1d-4024-a9af-2b23a917030e-console-config\") pod \"54c71635-7f1d-4024-a9af-2b23a917030e\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " Jul 12 16:31:33.112835 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.112800 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c71635-7f1d-4024-a9af-2b23a917030e-trusted-ca-bundle\") pod \"54c71635-7f1d-4024-a9af-2b23a917030e\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " Jul 12 16:31:33.113063 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.112841 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54c71635-7f1d-4024-a9af-2b23a917030e-console-oauth-config\") pod \"54c71635-7f1d-4024-a9af-2b23a917030e\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " Jul 12 16:31:33.113063 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.112858 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llbcx\" (UniqueName: \"kubernetes.io/projected/54c71635-7f1d-4024-a9af-2b23a917030e-kube-api-access-llbcx\") pod \"54c71635-7f1d-4024-a9af-2b23a917030e\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " Jul 12 16:31:33.113063 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.112880 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54c71635-7f1d-4024-a9af-2b23a917030e-oauth-serving-cert\") pod \"54c71635-7f1d-4024-a9af-2b23a917030e\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " Jul 12 16:31:33.113063 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.112902 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54c71635-7f1d-4024-a9af-2b23a917030e-service-ca\") pod \"54c71635-7f1d-4024-a9af-2b23a917030e\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " Jul 12 16:31:33.113063 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.112947 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54c71635-7f1d-4024-a9af-2b23a917030e-console-serving-cert\") pod \"54c71635-7f1d-4024-a9af-2b23a917030e\" (UID: \"54c71635-7f1d-4024-a9af-2b23a917030e\") " Jul 12 16:31:33.113329 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.113307 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54c71635-7f1d-4024-a9af-2b23a917030e-console-config" (OuterVolumeSpecName: "console-config") pod "54c71635-7f1d-4024-a9af-2b23a917030e" (UID: "54c71635-7f1d-4024-a9af-2b23a917030e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 16:31:33.113380 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.113350 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54c71635-7f1d-4024-a9af-2b23a917030e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "54c71635-7f1d-4024-a9af-2b23a917030e" (UID: "54c71635-7f1d-4024-a9af-2b23a917030e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 16:31:33.113466 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.113373 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54c71635-7f1d-4024-a9af-2b23a917030e-service-ca" (OuterVolumeSpecName: "service-ca") pod "54c71635-7f1d-4024-a9af-2b23a917030e" (UID: "54c71635-7f1d-4024-a9af-2b23a917030e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 16:31:33.113466 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.113382 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54c71635-7f1d-4024-a9af-2b23a917030e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "54c71635-7f1d-4024-a9af-2b23a917030e" (UID: "54c71635-7f1d-4024-a9af-2b23a917030e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 16:31:33.115278 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.115250 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54c71635-7f1d-4024-a9af-2b23a917030e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "54c71635-7f1d-4024-a9af-2b23a917030e" (UID: "54c71635-7f1d-4024-a9af-2b23a917030e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 16:31:33.115278 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.115267 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54c71635-7f1d-4024-a9af-2b23a917030e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "54c71635-7f1d-4024-a9af-2b23a917030e" (UID: "54c71635-7f1d-4024-a9af-2b23a917030e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 16:31:33.115412 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.115347 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54c71635-7f1d-4024-a9af-2b23a917030e-kube-api-access-llbcx" (OuterVolumeSpecName: "kube-api-access-llbcx") pod "54c71635-7f1d-4024-a9af-2b23a917030e" (UID: "54c71635-7f1d-4024-a9af-2b23a917030e"). InnerVolumeSpecName "kube-api-access-llbcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 16:31:33.214022 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.213986 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c71635-7f1d-4024-a9af-2b23a917030e-trusted-ca-bundle\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:31:33.214022 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.214015 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54c71635-7f1d-4024-a9af-2b23a917030e-console-oauth-config\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:31:33.214022 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.214025 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llbcx\" (UniqueName: \"kubernetes.io/projected/54c71635-7f1d-4024-a9af-2b23a917030e-kube-api-access-llbcx\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:31:33.214260 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.214036 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54c71635-7f1d-4024-a9af-2b23a917030e-oauth-serving-cert\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:31:33.214260 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.214045 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54c71635-7f1d-4024-a9af-2b23a917030e-service-ca\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:31:33.214260 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.214052 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54c71635-7f1d-4024-a9af-2b23a917030e-console-serving-cert\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:31:33.214260 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.214061 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54c71635-7f1d-4024-a9af-2b23a917030e-console-config\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:31:33.261346 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.261307 2559 generic.go:356] "Generic (PLEG): container finished" podID="54c71635-7f1d-4024-a9af-2b23a917030e" containerID="f1b3db886cd129ac8e854f4f014bf01d7c807ea59e31db2ec30af66555fdc27d" exitCode=0 Jul 12 16:31:33.261500 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.261369 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869464ddbd-2gzdk" Jul 12 16:31:33.261500 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.261380 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869464ddbd-2gzdk" event={"ID":"54c71635-7f1d-4024-a9af-2b23a917030e","Type":"ContainerDied","Data":"f1b3db886cd129ac8e854f4f014bf01d7c807ea59e31db2ec30af66555fdc27d"} Jul 12 16:31:33.261500 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.261455 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869464ddbd-2gzdk" event={"ID":"54c71635-7f1d-4024-a9af-2b23a917030e","Type":"ContainerDied","Data":"c11928849b04f210186cb3e36921535ba7c97fd7bf67181775ead1ef964f6a13"} Jul 12 16:31:33.261500 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.261475 2559 scope.go:117] "RemoveContainer" containerID="f1b3db886cd129ac8e854f4f014bf01d7c807ea59e31db2ec30af66555fdc27d" Jul 12 16:31:33.273955 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.273933 2559 scope.go:117] "RemoveContainer" containerID="f1b3db886cd129ac8e854f4f014bf01d7c807ea59e31db2ec30af66555fdc27d" Jul 12 16:31:33.274292 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:31:33.274263 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1b3db886cd129ac8e854f4f014bf01d7c807ea59e31db2ec30af66555fdc27d\": container with ID starting with f1b3db886cd129ac8e854f4f014bf01d7c807ea59e31db2ec30af66555fdc27d not found: ID does not exist" containerID="f1b3db886cd129ac8e854f4f014bf01d7c807ea59e31db2ec30af66555fdc27d" Jul 12 16:31:33.274367 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.274300 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1b3db886cd129ac8e854f4f014bf01d7c807ea59e31db2ec30af66555fdc27d"} err="failed to get container status \"f1b3db886cd129ac8e854f4f014bf01d7c807ea59e31db2ec30af66555fdc27d\": rpc error: code = NotFound desc = could not find container \"f1b3db886cd129ac8e854f4f014bf01d7c807ea59e31db2ec30af66555fdc27d\": container with ID starting with f1b3db886cd129ac8e854f4f014bf01d7c807ea59e31db2ec30af66555fdc27d not found: ID does not exist" Jul 12 16:31:33.291306 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.291283 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-869464ddbd-2gzdk"] Jul 12 16:31:33.293078 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:33.293059 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-869464ddbd-2gzdk"] Jul 12 16:31:34.060475 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:34.060444 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54c71635-7f1d-4024-a9af-2b23a917030e" path="/var/lib/kubelet/pods/54c71635-7f1d-4024-a9af-2b23a917030e/volumes" Jul 12 16:31:40.871934 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:40.871896 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl"] Jul 12 16:31:40.872395 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:40.872323 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54c71635-7f1d-4024-a9af-2b23a917030e" containerName="console" Jul 12 16:31:40.872395 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:40.872341 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="54c71635-7f1d-4024-a9af-2b23a917030e" containerName="console" Jul 12 16:31:40.872464 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:40.872426 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="54c71635-7f1d-4024-a9af-2b23a917030e" containerName="console" Jul 12 16:31:40.877142 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:40.877123 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:40.879959 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:40.879939 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-7rxqm\"" Jul 12 16:31:40.887963 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:40.887940 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl"] Jul 12 16:31:40.980298 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:40.980267 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5142047-88e7-4c30-96b2-a59c93bd81fa-workload-certs\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:40.980298 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:40.980300 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5142047-88e7-4c30-96b2-a59c93bd81fa-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:40.980488 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:40.980334 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5142047-88e7-4c30-96b2-a59c93bd81fa-istio-token\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:40.980488 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:40.980405 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5142047-88e7-4c30-96b2-a59c93bd81fa-workload-socket\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:40.980488 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:40.980449 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksv44\" (UniqueName: \"kubernetes.io/projected/f5142047-88e7-4c30-96b2-a59c93bd81fa-kube-api-access-ksv44\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:40.980488 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:40.980470 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5142047-88e7-4c30-96b2-a59c93bd81fa-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:40.980664 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:40.980520 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5142047-88e7-4c30-96b2-a59c93bd81fa-istio-data\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:40.980664 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:40.980572 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5142047-88e7-4c30-96b2-a59c93bd81fa-credential-socket\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:40.980664 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:40.980588 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5142047-88e7-4c30-96b2-a59c93bd81fa-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:41.080938 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:41.080894 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5142047-88e7-4c30-96b2-a59c93bd81fa-workload-socket\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:41.081176 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:41.080957 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksv44\" (UniqueName: \"kubernetes.io/projected/f5142047-88e7-4c30-96b2-a59c93bd81fa-kube-api-access-ksv44\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:41.081176 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:41.080992 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5142047-88e7-4c30-96b2-a59c93bd81fa-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:41.081176 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:41.081015 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5142047-88e7-4c30-96b2-a59c93bd81fa-istio-data\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:41.081176 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:41.081046 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5142047-88e7-4c30-96b2-a59c93bd81fa-credential-socket\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:41.081176 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:41.081067 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5142047-88e7-4c30-96b2-a59c93bd81fa-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:41.081176 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:41.081125 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5142047-88e7-4c30-96b2-a59c93bd81fa-workload-certs\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:41.081176 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:41.081147 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5142047-88e7-4c30-96b2-a59c93bd81fa-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:41.081531 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:41.081186 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5142047-88e7-4c30-96b2-a59c93bd81fa-istio-token\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:41.081531 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:41.081471 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5142047-88e7-4c30-96b2-a59c93bd81fa-istio-data\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:41.081531 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:41.081504 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5142047-88e7-4c30-96b2-a59c93bd81fa-credential-socket\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:41.081630 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:41.081543 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5142047-88e7-4c30-96b2-a59c93bd81fa-workload-certs\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:41.081689 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:41.081669 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5142047-88e7-4c30-96b2-a59c93bd81fa-workload-socket\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:41.082168 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:41.082143 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5142047-88e7-4c30-96b2-a59c93bd81fa-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:41.083519 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:41.083489 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5142047-88e7-4c30-96b2-a59c93bd81fa-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:41.083820 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:41.083798 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5142047-88e7-4c30-96b2-a59c93bd81fa-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:41.090187 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:41.090155 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5142047-88e7-4c30-96b2-a59c93bd81fa-istio-token\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:41.090289 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:41.090263 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksv44\" (UniqueName: \"kubernetes.io/projected/f5142047-88e7-4c30-96b2-a59c93bd81fa-kube-api-access-ksv44\") pod \"maas-default-gateway-openshift-default-5df9b4f89-mczpl\" (UID: \"f5142047-88e7-4c30-96b2-a59c93bd81fa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:41.188766 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:41.188731 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:41.332029 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:41.332003 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl"] Jul 12 16:31:41.333330 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:31:41.333292 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5142047_88e7_4c30_96b2_a59c93bd81fa.slice/crio-51cf22dc9e05e7c5b01878e8814708299b3f31661a0362bcf8badd07af56f297 WatchSource:0}: Error finding container 51cf22dc9e05e7c5b01878e8814708299b3f31661a0362bcf8badd07af56f297: Status 404 returned error can't find the container with id 51cf22dc9e05e7c5b01878e8814708299b3f31661a0362bcf8badd07af56f297 Jul 12 16:31:41.335824 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:41.335792 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 16:31:41.335913 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:41.335871 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 16:31:41.335980 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:41.335917 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 16:31:42.315785 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:42.315750 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" event={"ID":"f5142047-88e7-4c30-96b2-a59c93bd81fa","Type":"ContainerStarted","Data":"3e4bd7ca3e36ead961146c69bca425632afaa0a0a5d3ac668a11273b5459db1b"} Jul 12 16:31:42.316185 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:42.315805 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" event={"ID":"f5142047-88e7-4c30-96b2-a59c93bd81fa","Type":"ContainerStarted","Data":"51cf22dc9e05e7c5b01878e8814708299b3f31661a0362bcf8badd07af56f297"} Jul 12 16:31:42.340355 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:42.340308 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" podStartSLOduration=2.340290294 podStartE2EDuration="2.340290294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:31:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:31:42.337991125 +0000 UTC m=+468.791379112" watchObservedRunningTime="2026-07-12 16:31:42.340290294 +0000 UTC m=+468.793678279" Jul 12 16:31:43.189017 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:43.188970 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:43.193979 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:43.193953 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:43.324116 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:43.323549 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:43.324571 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:43.324509 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:31:44.238699 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:44.238669 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-5mzgf"] Jul 12 16:31:44.242220 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:44.242201 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5mzgf" Jul 12 16:31:44.244905 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:44.244884 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jqdhz\"" Jul 12 16:31:44.249727 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:44.249701 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-5mzgf"] Jul 12 16:31:44.308261 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:44.308219 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55js8\" (UniqueName: \"kubernetes.io/projected/1379313e-983f-4207-bee0-86cd48b522dc-kube-api-access-55js8\") pod \"authorino-58cd955675-5mzgf\" (UID: \"1379313e-983f-4207-bee0-86cd48b522dc\") " pod="kuadrant-system/authorino-58cd955675-5mzgf" Jul 12 16:31:44.409192 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:44.409148 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55js8\" (UniqueName: \"kubernetes.io/projected/1379313e-983f-4207-bee0-86cd48b522dc-kube-api-access-55js8\") pod \"authorino-58cd955675-5mzgf\" (UID: \"1379313e-983f-4207-bee0-86cd48b522dc\") " pod="kuadrant-system/authorino-58cd955675-5mzgf" Jul 12 16:31:44.417608 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:44.417581 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55js8\" (UniqueName: \"kubernetes.io/projected/1379313e-983f-4207-bee0-86cd48b522dc-kube-api-access-55js8\") pod \"authorino-58cd955675-5mzgf\" (UID: \"1379313e-983f-4207-bee0-86cd48b522dc\") " pod="kuadrant-system/authorino-58cd955675-5mzgf" Jul 12 16:31:44.553269 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:44.553181 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5mzgf" Jul 12 16:31:44.690108 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:44.690068 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-5mzgf"] Jul 12 16:31:44.691970 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:31:44.691942 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1379313e_983f_4207_bee0_86cd48b522dc.slice/crio-adfd0976a295ed5b45ad23bd713b0f3c07a30c761e97f20af96c3462f1a6fd8f WatchSource:0}: Error finding container adfd0976a295ed5b45ad23bd713b0f3c07a30c761e97f20af96c3462f1a6fd8f: Status 404 returned error can't find the container with id adfd0976a295ed5b45ad23bd713b0f3c07a30c761e97f20af96c3462f1a6fd8f Jul 12 16:31:45.338980 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:45.338925 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5mzgf" event={"ID":"1379313e-983f-4207-bee0-86cd48b522dc","Type":"ContainerStarted","Data":"adfd0976a295ed5b45ad23bd713b0f3c07a30c761e97f20af96c3462f1a6fd8f"} Jul 12 16:31:48.358220 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:48.358182 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5mzgf" event={"ID":"1379313e-983f-4207-bee0-86cd48b522dc","Type":"ContainerStarted","Data":"a0ea01ac4c6eed9b8c972ddfcea3a477202df01fbfb49513c30bff9dfaf9c345"} Jul 12 16:31:48.373979 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:48.373929 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-5mzgf" podStartSLOduration=1.222818692 podStartE2EDuration="4.373911329s" totalImagesPullingTime="3.151092637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:31:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:31:48.372515254 +0000 UTC m=+474.825903241" watchObservedRunningTime="2026-07-12 16:31:48.373911329 +0000 UTC m=+474.827299315" Jul 12 16:31:49.962177 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:49.962142 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-5mzgf"] Jul 12 16:31:50.368281 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:50.368185 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-5mzgf" podUID="1379313e-983f-4207-bee0-86cd48b522dc" containerName="authorino" containerID="cri-o://a0ea01ac4c6eed9b8c972ddfcea3a477202df01fbfb49513c30bff9dfaf9c345" gracePeriod=30 Jul 12 16:31:50.621808 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:50.621738 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5mzgf" Jul 12 16:31:50.763902 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:50.763868 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55js8\" (UniqueName: \"kubernetes.io/projected/1379313e-983f-4207-bee0-86cd48b522dc-kube-api-access-55js8\") pod \"1379313e-983f-4207-bee0-86cd48b522dc\" (UID: \"1379313e-983f-4207-bee0-86cd48b522dc\") " Jul 12 16:31:50.766135 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:50.766107 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1379313e-983f-4207-bee0-86cd48b522dc-kube-api-access-55js8" (OuterVolumeSpecName: "kube-api-access-55js8") pod "1379313e-983f-4207-bee0-86cd48b522dc" (UID: "1379313e-983f-4207-bee0-86cd48b522dc"). InnerVolumeSpecName "kube-api-access-55js8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 16:31:50.865175 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:50.865138 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55js8\" (UniqueName: \"kubernetes.io/projected/1379313e-983f-4207-bee0-86cd48b522dc-kube-api-access-55js8\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:31:51.373949 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:51.373913 2559 generic.go:356] "Generic (PLEG): container finished" podID="1379313e-983f-4207-bee0-86cd48b522dc" containerID="a0ea01ac4c6eed9b8c972ddfcea3a477202df01fbfb49513c30bff9dfaf9c345" exitCode=0 Jul 12 16:31:51.373949 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:51.373949 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5mzgf" Jul 12 16:31:51.374415 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:51.373990 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5mzgf" event={"ID":"1379313e-983f-4207-bee0-86cd48b522dc","Type":"ContainerDied","Data":"a0ea01ac4c6eed9b8c972ddfcea3a477202df01fbfb49513c30bff9dfaf9c345"} Jul 12 16:31:51.374415 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:51.374031 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5mzgf" event={"ID":"1379313e-983f-4207-bee0-86cd48b522dc","Type":"ContainerDied","Data":"adfd0976a295ed5b45ad23bd713b0f3c07a30c761e97f20af96c3462f1a6fd8f"} Jul 12 16:31:51.374415 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:51.374049 2559 scope.go:117] "RemoveContainer" containerID="a0ea01ac4c6eed9b8c972ddfcea3a477202df01fbfb49513c30bff9dfaf9c345" Jul 12 16:31:51.385947 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:51.385914 2559 scope.go:117] "RemoveContainer" containerID="a0ea01ac4c6eed9b8c972ddfcea3a477202df01fbfb49513c30bff9dfaf9c345" Jul 12 16:31:51.386484 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:31:51.386457 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0ea01ac4c6eed9b8c972ddfcea3a477202df01fbfb49513c30bff9dfaf9c345\": container with ID starting with a0ea01ac4c6eed9b8c972ddfcea3a477202df01fbfb49513c30bff9dfaf9c345 not found: ID does not exist" containerID="a0ea01ac4c6eed9b8c972ddfcea3a477202df01fbfb49513c30bff9dfaf9c345" Jul 12 16:31:51.386580 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:51.386498 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0ea01ac4c6eed9b8c972ddfcea3a477202df01fbfb49513c30bff9dfaf9c345"} err="failed to get container status \"a0ea01ac4c6eed9b8c972ddfcea3a477202df01fbfb49513c30bff9dfaf9c345\": rpc error: code = NotFound desc = could not find container \"a0ea01ac4c6eed9b8c972ddfcea3a477202df01fbfb49513c30bff9dfaf9c345\": container with ID starting with a0ea01ac4c6eed9b8c972ddfcea3a477202df01fbfb49513c30bff9dfaf9c345 not found: ID does not exist" Jul 12 16:31:51.396601 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:51.396576 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-5mzgf"] Jul 12 16:31:51.401664 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:51.401642 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-5mzgf"] Jul 12 16:31:51.413421 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:31:51.413397 2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1379313e_983f_4207_bee0_86cd48b522dc.slice\": RecentStats: unable to find data in memory cache]" Jul 12 16:31:52.059805 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:31:52.059772 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1379313e-983f-4207-bee0-86cd48b522dc" path="/var/lib/kubelet/pods/1379313e-983f-4207-bee0-86cd48b522dc/volumes" Jul 12 16:32:23.299291 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.299255 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f586fdfd-4wlcw"] Jul 12 16:32:23.299727 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.299566 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1379313e-983f-4207-bee0-86cd48b522dc" containerName="authorino" Jul 12 16:32:23.299727 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.299578 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1379313e-983f-4207-bee0-86cd48b522dc" containerName="authorino" Jul 12 16:32:23.299727 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.299645 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1379313e-983f-4207-bee0-86cd48b522dc" containerName="authorino" Jul 12 16:32:23.303394 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.303375 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f586fdfd-4wlcw" Jul 12 16:32:23.307381 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.307360 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 12 16:32:23.307552 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.307532 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wp7sn\"" Jul 12 16:32:23.308289 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.308272 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 12 16:32:23.314567 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.314545 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f586fdfd-4wlcw"] Jul 12 16:32:23.343938 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.343896 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae01b585-6299-4e13-b35e-64493001400c-webhook-cert\") pod \"maas-controller-7f586fdfd-4wlcw\" (UID: \"ae01b585-6299-4e13-b35e-64493001400c\") " pod="opendatahub/maas-controller-7f586fdfd-4wlcw" Jul 12 16:32:23.344116 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.343955 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khr25\" (UniqueName: \"kubernetes.io/projected/ae01b585-6299-4e13-b35e-64493001400c-kube-api-access-khr25\") pod \"maas-controller-7f586fdfd-4wlcw\" (UID: \"ae01b585-6299-4e13-b35e-64493001400c\") " pod="opendatahub/maas-controller-7f586fdfd-4wlcw" Jul 12 16:32:23.445411 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.445376 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khr25\" (UniqueName: \"kubernetes.io/projected/ae01b585-6299-4e13-b35e-64493001400c-kube-api-access-khr25\") pod \"maas-controller-7f586fdfd-4wlcw\" (UID: \"ae01b585-6299-4e13-b35e-64493001400c\") " pod="opendatahub/maas-controller-7f586fdfd-4wlcw" Jul 12 16:32:23.445578 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.445475 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae01b585-6299-4e13-b35e-64493001400c-webhook-cert\") pod \"maas-controller-7f586fdfd-4wlcw\" (UID: \"ae01b585-6299-4e13-b35e-64493001400c\") " pod="opendatahub/maas-controller-7f586fdfd-4wlcw" Jul 12 16:32:23.447964 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.447940 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae01b585-6299-4e13-b35e-64493001400c-webhook-cert\") pod \"maas-controller-7f586fdfd-4wlcw\" (UID: \"ae01b585-6299-4e13-b35e-64493001400c\") " pod="opendatahub/maas-controller-7f586fdfd-4wlcw" Jul 12 16:32:23.457553 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.457526 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khr25\" (UniqueName: \"kubernetes.io/projected/ae01b585-6299-4e13-b35e-64493001400c-kube-api-access-khr25\") pod \"maas-controller-7f586fdfd-4wlcw\" (UID: \"ae01b585-6299-4e13-b35e-64493001400c\") " pod="opendatahub/maas-controller-7f586fdfd-4wlcw" Jul 12 16:32:23.484143 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.484114 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9cffbc554-zlrfg"] Jul 12 16:32:23.487102 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.487075 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9cffbc554-zlrfg" Jul 12 16:32:23.498017 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.497991 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9cffbc554-zlrfg"] Jul 12 16:32:23.545850 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.545818 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5d3d3b4f-b02c-4835-8849-10edfd7fa822-webhook-cert\") pod \"maas-controller-9cffbc554-zlrfg\" (UID: \"5d3d3b4f-b02c-4835-8849-10edfd7fa822\") " pod="opendatahub/maas-controller-9cffbc554-zlrfg" Jul 12 16:32:23.546006 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.545858 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lth9s\" (UniqueName: \"kubernetes.io/projected/5d3d3b4f-b02c-4835-8849-10edfd7fa822-kube-api-access-lth9s\") pod \"maas-controller-9cffbc554-zlrfg\" (UID: \"5d3d3b4f-b02c-4835-8849-10edfd7fa822\") " pod="opendatahub/maas-controller-9cffbc554-zlrfg" Jul 12 16:32:23.614014 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.613928 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f586fdfd-4wlcw" Jul 12 16:32:23.646955 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.646924 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5d3d3b4f-b02c-4835-8849-10edfd7fa822-webhook-cert\") pod \"maas-controller-9cffbc554-zlrfg\" (UID: \"5d3d3b4f-b02c-4835-8849-10edfd7fa822\") " pod="opendatahub/maas-controller-9cffbc554-zlrfg" Jul 12 16:32:23.647120 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.646973 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lth9s\" (UniqueName: \"kubernetes.io/projected/5d3d3b4f-b02c-4835-8849-10edfd7fa822-kube-api-access-lth9s\") pod \"maas-controller-9cffbc554-zlrfg\" (UID: \"5d3d3b4f-b02c-4835-8849-10edfd7fa822\") " pod="opendatahub/maas-controller-9cffbc554-zlrfg" Jul 12 16:32:23.649496 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.649468 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5d3d3b4f-b02c-4835-8849-10edfd7fa822-webhook-cert\") pod \"maas-controller-9cffbc554-zlrfg\" (UID: \"5d3d3b4f-b02c-4835-8849-10edfd7fa822\") " pod="opendatahub/maas-controller-9cffbc554-zlrfg" Jul 12 16:32:23.656449 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.656392 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lth9s\" (UniqueName: \"kubernetes.io/projected/5d3d3b4f-b02c-4835-8849-10edfd7fa822-kube-api-access-lth9s\") pod \"maas-controller-9cffbc554-zlrfg\" (UID: \"5d3d3b4f-b02c-4835-8849-10edfd7fa822\") " pod="opendatahub/maas-controller-9cffbc554-zlrfg" Jul 12 16:32:23.775416 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.775392 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f586fdfd-4wlcw"] Jul 12 16:32:23.776714 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:32:23.776685 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae01b585_6299_4e13_b35e_64493001400c.slice/crio-47f6fcd2970ba4060b0d9e54417592f7751fa7228f429a18231575f86beb4e14 WatchSource:0}: Error finding container 47f6fcd2970ba4060b0d9e54417592f7751fa7228f429a18231575f86beb4e14: Status 404 returned error can't find the container with id 47f6fcd2970ba4060b0d9e54417592f7751fa7228f429a18231575f86beb4e14 Jul 12 16:32:23.799645 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.799616 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9cffbc554-zlrfg" Jul 12 16:32:23.936835 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:23.936809 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9cffbc554-zlrfg"] Jul 12 16:32:23.937508 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:32:23.937476 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d3d3b4f_b02c_4835_8849_10edfd7fa822.slice/crio-e5234e064ca0e0f1baec372e6f32c176321bae0b9ef257d58eaa8d7e86cc3bf9 WatchSource:0}: Error finding container e5234e064ca0e0f1baec372e6f32c176321bae0b9ef257d58eaa8d7e86cc3bf9: Status 404 returned error can't find the container with id e5234e064ca0e0f1baec372e6f32c176321bae0b9ef257d58eaa8d7e86cc3bf9 Jul 12 16:32:24.538276 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:24.538233 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f586fdfd-4wlcw" event={"ID":"ae01b585-6299-4e13-b35e-64493001400c","Type":"ContainerStarted","Data":"47f6fcd2970ba4060b0d9e54417592f7751fa7228f429a18231575f86beb4e14"} Jul 12 16:32:24.540487 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:24.540450 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9cffbc554-zlrfg" event={"ID":"5d3d3b4f-b02c-4835-8849-10edfd7fa822","Type":"ContainerStarted","Data":"e5234e064ca0e0f1baec372e6f32c176321bae0b9ef257d58eaa8d7e86cc3bf9"} Jul 12 16:32:26.553340 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:26.553291 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9cffbc554-zlrfg" event={"ID":"5d3d3b4f-b02c-4835-8849-10edfd7fa822","Type":"ContainerStarted","Data":"248ee40453dd458ce16216b17ebbfe6fba9881556c8e681db13307e6990f4746"} Jul 12 16:32:26.553794 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:26.553366 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9cffbc554-zlrfg" Jul 12 16:32:26.554880 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:26.554851 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f586fdfd-4wlcw" event={"ID":"ae01b585-6299-4e13-b35e-64493001400c","Type":"ContainerStarted","Data":"d67fd985e8fd32eb2262b7905b9cf49897172e3cd838710c3943c97cdce5a033"} Jul 12 16:32:26.555006 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:26.554923 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f586fdfd-4wlcw" Jul 12 16:32:26.571021 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:26.570960 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9cffbc554-zlrfg" podStartSLOduration=1.669123401 podStartE2EDuration="3.570943971s" totalImagesPullingTime="1.90182057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:32:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:32:26.57031715 +0000 UTC m=+513.023705148" watchObservedRunningTime="2026-07-12 16:32:26.570943971 +0000 UTC m=+513.024331987" Jul 12 16:32:26.588893 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:26.588841 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f586fdfd-4wlcw" podStartSLOduration=1.536846799 podStartE2EDuration="3.588826314s" totalImagesPullingTime="2.051979515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:32:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:32:26.586596699 +0000 UTC m=+513.039984686" watchObservedRunningTime="2026-07-12 16:32:26.588826314 +0000 UTC m=+513.042214301" Jul 12 16:32:37.567702 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:37.567672 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9cffbc554-zlrfg" Jul 12 16:32:37.568173 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:37.567757 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f586fdfd-4wlcw" Jul 12 16:32:37.638233 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:37.638199 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f586fdfd-4wlcw"] Jul 12 16:32:37.638421 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:37.638393 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7f586fdfd-4wlcw" podUID="ae01b585-6299-4e13-b35e-64493001400c" containerName="manager" containerID="cri-o://d67fd985e8fd32eb2262b7905b9cf49897172e3cd838710c3943c97cdce5a033" gracePeriod=30 Jul 12 16:32:37.888434 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:37.888410 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f586fdfd-4wlcw" Jul 12 16:32:37.971015 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:37.970981 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khr25\" (UniqueName: \"kubernetes.io/projected/ae01b585-6299-4e13-b35e-64493001400c-kube-api-access-khr25\") pod \"ae01b585-6299-4e13-b35e-64493001400c\" (UID: \"ae01b585-6299-4e13-b35e-64493001400c\") " Jul 12 16:32:37.971225 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:37.971153 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae01b585-6299-4e13-b35e-64493001400c-webhook-cert\") pod \"ae01b585-6299-4e13-b35e-64493001400c\" (UID: \"ae01b585-6299-4e13-b35e-64493001400c\") " Jul 12 16:32:37.973419 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:37.973385 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae01b585-6299-4e13-b35e-64493001400c-kube-api-access-khr25" (OuterVolumeSpecName: "kube-api-access-khr25") pod "ae01b585-6299-4e13-b35e-64493001400c" (UID: "ae01b585-6299-4e13-b35e-64493001400c"). InnerVolumeSpecName "kube-api-access-khr25". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 16:32:37.973527 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:37.973463 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae01b585-6299-4e13-b35e-64493001400c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ae01b585-6299-4e13-b35e-64493001400c" (UID: "ae01b585-6299-4e13-b35e-64493001400c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 16:32:38.072180 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:38.072153 2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae01b585-6299-4e13-b35e-64493001400c-webhook-cert\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:32:38.072180 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:38.072180 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khr25\" (UniqueName: \"kubernetes.io/projected/ae01b585-6299-4e13-b35e-64493001400c-kube-api-access-khr25\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:32:38.618647 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:38.618609 2559 generic.go:356] "Generic (PLEG): container finished" podID="ae01b585-6299-4e13-b35e-64493001400c" containerID="d67fd985e8fd32eb2262b7905b9cf49897172e3cd838710c3943c97cdce5a033" exitCode=0 Jul 12 16:32:38.618647 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:38.618651 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f586fdfd-4wlcw" Jul 12 16:32:38.619148 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:38.618662 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f586fdfd-4wlcw" event={"ID":"ae01b585-6299-4e13-b35e-64493001400c","Type":"ContainerDied","Data":"d67fd985e8fd32eb2262b7905b9cf49897172e3cd838710c3943c97cdce5a033"} Jul 12 16:32:38.619148 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:38.618716 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f586fdfd-4wlcw" event={"ID":"ae01b585-6299-4e13-b35e-64493001400c","Type":"ContainerDied","Data":"47f6fcd2970ba4060b0d9e54417592f7751fa7228f429a18231575f86beb4e14"} Jul 12 16:32:38.619148 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:38.618746 2559 scope.go:117] "RemoveContainer" containerID="d67fd985e8fd32eb2262b7905b9cf49897172e3cd838710c3943c97cdce5a033" Jul 12 16:32:38.627527 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:38.627510 2559 scope.go:117] "RemoveContainer" containerID="d67fd985e8fd32eb2262b7905b9cf49897172e3cd838710c3943c97cdce5a033" Jul 12 16:32:38.627838 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:32:38.627817 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d67fd985e8fd32eb2262b7905b9cf49897172e3cd838710c3943c97cdce5a033\": container with ID starting with d67fd985e8fd32eb2262b7905b9cf49897172e3cd838710c3943c97cdce5a033 not found: ID does not exist" containerID="d67fd985e8fd32eb2262b7905b9cf49897172e3cd838710c3943c97cdce5a033" Jul 12 16:32:38.627889 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:38.627847 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d67fd985e8fd32eb2262b7905b9cf49897172e3cd838710c3943c97cdce5a033"} err="failed to get container status \"d67fd985e8fd32eb2262b7905b9cf49897172e3cd838710c3943c97cdce5a033\": rpc error: code = NotFound desc = could not find container \"d67fd985e8fd32eb2262b7905b9cf49897172e3cd838710c3943c97cdce5a033\": container with ID starting with d67fd985e8fd32eb2262b7905b9cf49897172e3cd838710c3943c97cdce5a033 not found: ID does not exist" Jul 12 16:32:38.640185 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:38.640160 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f586fdfd-4wlcw"] Jul 12 16:32:38.644737 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:38.644715 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f586fdfd-4wlcw"] Jul 12 16:32:40.058981 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:32:40.058947 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae01b585-6299-4e13-b35e-64493001400c" path="/var/lib/kubelet/pods/ae01b585-6299-4e13-b35e-64493001400c/volumes" Jul 12 16:33:01.076763 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.076728 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-65ccc6b695-shh9n"] Jul 12 16:33:01.077244 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.077081 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae01b585-6299-4e13-b35e-64493001400c" containerName="manager" Jul 12 16:33:01.077244 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.077107 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae01b585-6299-4e13-b35e-64493001400c" containerName="manager" Jul 12 16:33:01.077244 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.077170 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae01b585-6299-4e13-b35e-64493001400c" containerName="manager" Jul 12 16:33:01.083375 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.083358 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65ccc6b695-shh9n" Jul 12 16:33:01.087257 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.087225 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-xgftl\"" Jul 12 16:33:01.087386 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.087367 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 12 16:33:01.088331 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.088316 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 12 16:33:01.088331 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.088328 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 12 16:33:01.098571 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.098543 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-65ccc6b695-shh9n"] Jul 12 16:33:01.164928 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.164892 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a10ffb6b-86ff-457a-8d16-5b56522ba338-maas-api-tls\") pod \"maas-api-65ccc6b695-shh9n\" (UID: \"a10ffb6b-86ff-457a-8d16-5b56522ba338\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-shh9n" Jul 12 16:33:01.164928 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.164927 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfphb\" (UniqueName: \"kubernetes.io/projected/a10ffb6b-86ff-457a-8d16-5b56522ba338-kube-api-access-wfphb\") pod \"maas-api-65ccc6b695-shh9n\" (UID: \"a10ffb6b-86ff-457a-8d16-5b56522ba338\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-shh9n" Jul 12 16:33:01.165187 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.164956 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a10ffb6b-86ff-457a-8d16-5b56522ba338-openshift-service-ca\") pod \"maas-api-65ccc6b695-shh9n\" (UID: \"a10ffb6b-86ff-457a-8d16-5b56522ba338\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-shh9n" Jul 12 16:33:01.265568 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.265529 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a10ffb6b-86ff-457a-8d16-5b56522ba338-maas-api-tls\") pod \"maas-api-65ccc6b695-shh9n\" (UID: \"a10ffb6b-86ff-457a-8d16-5b56522ba338\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-shh9n" Jul 12 16:33:01.265568 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.265572 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfphb\" (UniqueName: \"kubernetes.io/projected/a10ffb6b-86ff-457a-8d16-5b56522ba338-kube-api-access-wfphb\") pod \"maas-api-65ccc6b695-shh9n\" (UID: \"a10ffb6b-86ff-457a-8d16-5b56522ba338\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-shh9n" Jul 12 16:33:01.265847 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.265615 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a10ffb6b-86ff-457a-8d16-5b56522ba338-openshift-service-ca\") pod \"maas-api-65ccc6b695-shh9n\" (UID: \"a10ffb6b-86ff-457a-8d16-5b56522ba338\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-shh9n" Jul 12 16:33:01.266370 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.266344 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a10ffb6b-86ff-457a-8d16-5b56522ba338-openshift-service-ca\") pod \"maas-api-65ccc6b695-shh9n\" (UID: \"a10ffb6b-86ff-457a-8d16-5b56522ba338\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-shh9n" Jul 12 16:33:01.268072 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.268050 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a10ffb6b-86ff-457a-8d16-5b56522ba338-maas-api-tls\") pod \"maas-api-65ccc6b695-shh9n\" (UID: \"a10ffb6b-86ff-457a-8d16-5b56522ba338\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-shh9n" Jul 12 16:33:01.274731 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.274704 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfphb\" (UniqueName: \"kubernetes.io/projected/a10ffb6b-86ff-457a-8d16-5b56522ba338-kube-api-access-wfphb\") pod \"maas-api-65ccc6b695-shh9n\" (UID: \"a10ffb6b-86ff-457a-8d16-5b56522ba338\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-shh9n" Jul 12 16:33:01.393990 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.393897 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65ccc6b695-shh9n" Jul 12 16:33:01.549000 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.548970 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-65ccc6b695-shh9n"] Jul 12 16:33:01.550670 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:33:01.550633 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda10ffb6b_86ff_457a_8d16_5b56522ba338.slice/crio-cf4249fc11568fcc7621e433fd976d8731f43c134bc3eed56e6a76746af5d861 WatchSource:0}: Error finding container cf4249fc11568fcc7621e433fd976d8731f43c134bc3eed56e6a76746af5d861: Status 404 returned error can't find the container with id cf4249fc11568fcc7621e433fd976d8731f43c134bc3eed56e6a76746af5d861 Jul 12 16:33:01.674374 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.674342 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-7lmp2"] Jul 12 16:33:01.680244 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.680226 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-7lmp2" Jul 12 16:33:01.683103 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.683051 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 12 16:33:01.683217 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.683155 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-mkzch\"" Jul 12 16:33:01.688891 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.688861 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-7lmp2"] Jul 12 16:33:01.740634 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.740591 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65ccc6b695-shh9n" event={"ID":"a10ffb6b-86ff-457a-8d16-5b56522ba338","Type":"ContainerStarted","Data":"cf4249fc11568fcc7621e433fd976d8731f43c134bc3eed56e6a76746af5d861"} Jul 12 16:33:01.770015 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.769974 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npzhw\" (UniqueName: \"kubernetes.io/projected/5cd5c9dc-62b6-47ae-a56b-48cfdc8887e7-kube-api-access-npzhw\") pod \"payload-pre-processing-7964457696-7lmp2\" (UID: \"5cd5c9dc-62b6-47ae-a56b-48cfdc8887e7\") " pod="openshift-ingress/payload-pre-processing-7964457696-7lmp2" Jul 12 16:33:01.770226 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.770039 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5cd5c9dc-62b6-47ae-a56b-48cfdc8887e7-plugins-config-volume\") pod \"payload-pre-processing-7964457696-7lmp2\" (UID: \"5cd5c9dc-62b6-47ae-a56b-48cfdc8887e7\") " pod="openshift-ingress/payload-pre-processing-7964457696-7lmp2" Jul 12 16:33:01.870679 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.870641 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npzhw\" (UniqueName: \"kubernetes.io/projected/5cd5c9dc-62b6-47ae-a56b-48cfdc8887e7-kube-api-access-npzhw\") pod \"payload-pre-processing-7964457696-7lmp2\" (UID: \"5cd5c9dc-62b6-47ae-a56b-48cfdc8887e7\") " pod="openshift-ingress/payload-pre-processing-7964457696-7lmp2" Jul 12 16:33:01.870847 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.870751 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5cd5c9dc-62b6-47ae-a56b-48cfdc8887e7-plugins-config-volume\") pod \"payload-pre-processing-7964457696-7lmp2\" (UID: \"5cd5c9dc-62b6-47ae-a56b-48cfdc8887e7\") " pod="openshift-ingress/payload-pre-processing-7964457696-7lmp2" Jul 12 16:33:01.871542 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.871514 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5cd5c9dc-62b6-47ae-a56b-48cfdc8887e7-plugins-config-volume\") pod \"payload-pre-processing-7964457696-7lmp2\" (UID: \"5cd5c9dc-62b6-47ae-a56b-48cfdc8887e7\") " pod="openshift-ingress/payload-pre-processing-7964457696-7lmp2" Jul 12 16:33:01.880458 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.880427 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npzhw\" (UniqueName: \"kubernetes.io/projected/5cd5c9dc-62b6-47ae-a56b-48cfdc8887e7-kube-api-access-npzhw\") pod \"payload-pre-processing-7964457696-7lmp2\" (UID: \"5cd5c9dc-62b6-47ae-a56b-48cfdc8887e7\") " pod="openshift-ingress/payload-pre-processing-7964457696-7lmp2" Jul 12 16:33:01.992970 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:01.992880 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-7lmp2" Jul 12 16:33:02.135745 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:02.135716 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-7lmp2"] Jul 12 16:33:02.138299 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:33:02.138271 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cd5c9dc_62b6_47ae_a56b_48cfdc8887e7.slice/crio-68337cd5f6a162c2ecada84ee80b0b54b074e048b411c1d3f922b88ab4ee576c WatchSource:0}: Error finding container 68337cd5f6a162c2ecada84ee80b0b54b074e048b411c1d3f922b88ab4ee576c: Status 404 returned error can't find the container with id 68337cd5f6a162c2ecada84ee80b0b54b074e048b411c1d3f922b88ab4ee576c Jul 12 16:33:02.747171 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:02.747127 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-7lmp2" event={"ID":"5cd5c9dc-62b6-47ae-a56b-48cfdc8887e7","Type":"ContainerStarted","Data":"68337cd5f6a162c2ecada84ee80b0b54b074e048b411c1d3f922b88ab4ee576c"} Jul 12 16:33:04.759616 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:04.759569 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65ccc6b695-shh9n" event={"ID":"a10ffb6b-86ff-457a-8d16-5b56522ba338","Type":"ContainerStarted","Data":"4c68f6603ec865d61407a8d8162766a23658e53f56dbb5882e4b15e63833d746"} Jul 12 16:33:04.760082 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:04.759643 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-65ccc6b695-shh9n" Jul 12 16:33:04.761211 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:04.761177 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-7lmp2" event={"ID":"5cd5c9dc-62b6-47ae-a56b-48cfdc8887e7","Type":"ContainerStarted","Data":"cbabce6d09c46f9ffcb01cf2b146d2e971c7e80421eba8f279a090d1591fbeb6"} Jul 12 16:33:04.761332 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:04.761240 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-7lmp2" Jul 12 16:33:04.778148 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:04.778065 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-65ccc6b695-shh9n" podStartSLOduration=1.432212171 podStartE2EDuration="3.778046993s" totalImagesPullingTime="2.345834822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:33:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:33:04.776907655 +0000 UTC m=+551.230295646" watchObservedRunningTime="2026-07-12 16:33:04.778046993 +0000 UTC m=+551.231434979" Jul 12 16:33:04.795002 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:04.794951 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-7lmp2" podStartSLOduration=2.034893842 podStartE2EDuration="3.794930904s" totalImagesPullingTime="1.760037062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:33:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:33:04.793326589 +0000 UTC m=+551.246714575" watchObservedRunningTime="2026-07-12 16:33:04.794930904 +0000 UTC m=+551.248318891" Jul 12 16:33:09.789849 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:09.789814 2559 generic.go:356] "Generic (PLEG): container finished" podID="f5142047-88e7-4c30-96b2-a59c93bd81fa" containerID="3e4bd7ca3e36ead961146c69bca425632afaa0a0a5d3ac668a11273b5459db1b" exitCode=0 Jul 12 16:33:09.790288 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:09.789889 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" event={"ID":"f5142047-88e7-4c30-96b2-a59c93bd81fa","Type":"ContainerDied","Data":"3e4bd7ca3e36ead961146c69bca425632afaa0a0a5d3ac668a11273b5459db1b"} Jul 12 16:33:09.790332 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:09.790304 2559 scope.go:117] "RemoveContainer" containerID="3e4bd7ca3e36ead961146c69bca425632afaa0a0a5d3ac668a11273b5459db1b" Jul 12 16:33:09.791305 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:09.791277 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 16:33:09.791412 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:09.791356 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 16:33:09.791412 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:09.791402 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 16:33:10.771494 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:10.771465 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-65ccc6b695-shh9n" Jul 12 16:33:10.797432 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:10.797393 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" event={"ID":"f5142047-88e7-4c30-96b2-a59c93bd81fa","Type":"ContainerStarted","Data":"cbda6fda1fc89c170cc1681ab2d03a6e4a1b8dc0b622c4ee8371693c080ccc68"} Jul 12 16:33:11.189865 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:11.189828 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:33:11.191026 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:11.191004 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5df9b4f89-mczpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 12 16:33:11.191158 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:11.191044 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" podUID="f5142047-88e7-4c30-96b2-a59c93bd81fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 12 16:33:12.190075 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:12.190038 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5df9b4f89-mczpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 12 16:33:12.190493 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:12.190125 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" podUID="f5142047-88e7-4c30-96b2-a59c93bd81fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 12 16:33:13.189494 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:13.189452 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5df9b4f89-mczpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 12 16:33:13.189688 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:13.189520 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" podUID="f5142047-88e7-4c30-96b2-a59c93bd81fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 12 16:33:13.323830 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:13.323777 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:33:14.189110 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:14.189047 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5df9b4f89-mczpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 12 16:33:14.189309 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:14.189121 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" podUID="f5142047-88e7-4c30-96b2-a59c93bd81fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 12 16:33:15.194333 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:15.194297 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:33:15.195461 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:15.195441 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-mczpl" Jul 12 16:33:15.768524 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:15.768487 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-7lmp2" Jul 12 16:33:38.872359 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:38.872328 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph"] Jul 12 16:33:38.879392 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:38.879371 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" Jul 12 16:33:38.883389 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:38.883359 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 12 16:33:38.883510 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:38.883436 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 12 16:33:38.883510 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:38.883440 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jkx7v\"" Jul 12 16:33:38.883625 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:38.883442 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 12 16:33:38.890873 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:38.890852 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph"] Jul 12 16:33:38.896455 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:38.896429 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e806ad38-8406-4eae-b432-89cb6c4319f2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bkvph\" (UID: \"e806ad38-8406-4eae-b432-89cb6c4319f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" Jul 12 16:33:38.896565 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:38.896498 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e806ad38-8406-4eae-b432-89cb6c4319f2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bkvph\" (UID: \"e806ad38-8406-4eae-b432-89cb6c4319f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" Jul 12 16:33:38.896565 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:38.896542 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q95qm\" (UniqueName: \"kubernetes.io/projected/e806ad38-8406-4eae-b432-89cb6c4319f2-kube-api-access-q95qm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bkvph\" (UID: \"e806ad38-8406-4eae-b432-89cb6c4319f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" Jul 12 16:33:38.896658 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:38.896623 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e806ad38-8406-4eae-b432-89cb6c4319f2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bkvph\" (UID: \"e806ad38-8406-4eae-b432-89cb6c4319f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" Jul 12 16:33:38.896711 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:38.896696 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e806ad38-8406-4eae-b432-89cb6c4319f2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bkvph\" (UID: \"e806ad38-8406-4eae-b432-89cb6c4319f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" Jul 12 16:33:38.896758 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:38.896737 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e806ad38-8406-4eae-b432-89cb6c4319f2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bkvph\" (UID: \"e806ad38-8406-4eae-b432-89cb6c4319f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" Jul 12 16:33:38.997608 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:38.997572 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e806ad38-8406-4eae-b432-89cb6c4319f2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bkvph\" (UID: \"e806ad38-8406-4eae-b432-89cb6c4319f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" Jul 12 16:33:38.997772 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:38.997618 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e806ad38-8406-4eae-b432-89cb6c4319f2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bkvph\" (UID: \"e806ad38-8406-4eae-b432-89cb6c4319f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" Jul 12 16:33:38.997772 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:38.997641 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e806ad38-8406-4eae-b432-89cb6c4319f2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bkvph\" (UID: \"e806ad38-8406-4eae-b432-89cb6c4319f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" Jul 12 16:33:38.997772 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:38.997675 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e806ad38-8406-4eae-b432-89cb6c4319f2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bkvph\" (UID: \"e806ad38-8406-4eae-b432-89cb6c4319f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" Jul 12 16:33:38.997772 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:38.997693 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q95qm\" (UniqueName: \"kubernetes.io/projected/e806ad38-8406-4eae-b432-89cb6c4319f2-kube-api-access-q95qm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bkvph\" (UID: \"e806ad38-8406-4eae-b432-89cb6c4319f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" Jul 12 16:33:38.997772 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:38.997718 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e806ad38-8406-4eae-b432-89cb6c4319f2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bkvph\" (UID: \"e806ad38-8406-4eae-b432-89cb6c4319f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" Jul 12 16:33:38.998027 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:38.997997 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e806ad38-8406-4eae-b432-89cb6c4319f2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bkvph\" (UID: \"e806ad38-8406-4eae-b432-89cb6c4319f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" Jul 12 16:33:38.998081 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:38.998059 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e806ad38-8406-4eae-b432-89cb6c4319f2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bkvph\" (UID: \"e806ad38-8406-4eae-b432-89cb6c4319f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" Jul 12 16:33:38.998373 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:38.998078 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e806ad38-8406-4eae-b432-89cb6c4319f2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bkvph\" (UID: \"e806ad38-8406-4eae-b432-89cb6c4319f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" Jul 12 16:33:39.000144 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:39.000120 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e806ad38-8406-4eae-b432-89cb6c4319f2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bkvph\" (UID: \"e806ad38-8406-4eae-b432-89cb6c4319f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" Jul 12 16:33:39.000340 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:39.000320 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e806ad38-8406-4eae-b432-89cb6c4319f2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bkvph\" (UID: \"e806ad38-8406-4eae-b432-89cb6c4319f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" Jul 12 16:33:39.007732 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:39.007711 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q95qm\" (UniqueName: \"kubernetes.io/projected/e806ad38-8406-4eae-b432-89cb6c4319f2-kube-api-access-q95qm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bkvph\" (UID: \"e806ad38-8406-4eae-b432-89cb6c4319f2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" Jul 12 16:33:39.189945 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:39.189912 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" Jul 12 16:33:39.329884 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:39.329855 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph"] Jul 12 16:33:39.332194 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:33:39.332163 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode806ad38_8406_4eae_b432_89cb6c4319f2.slice/crio-3a58532ffccdd11c30fde31916b166a572a2747c147aa8fdbc6f7fad309a6294 WatchSource:0}: Error finding container 3a58532ffccdd11c30fde31916b166a572a2747c147aa8fdbc6f7fad309a6294: Status 404 returned error can't find the container with id 3a58532ffccdd11c30fde31916b166a572a2747c147aa8fdbc6f7fad309a6294 Jul 12 16:33:39.952897 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:39.952862 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" event={"ID":"e806ad38-8406-4eae-b432-89cb6c4319f2","Type":"ContainerStarted","Data":"3a58532ffccdd11c30fde31916b166a572a2747c147aa8fdbc6f7fad309a6294"} Jul 12 16:33:40.960135 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:40.960073 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" event={"ID":"e806ad38-8406-4eae-b432-89cb6c4319f2","Type":"ContainerStarted","Data":"399b05d5a9e8d0e1cf86ab14a79b12dee5d0bb33cbf6e57670e2ae1df2f60924"} Jul 12 16:33:40.978172 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:40.978122 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" podStartSLOduration=1.9594738189999998 podStartE2EDuration="2.978102358s" totalImagesPullingTime="1.018628539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:33:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:33:40.977465954 +0000 UTC m=+587.430853939" watchObservedRunningTime="2026-07-12 16:33:40.978102358 +0000 UTC m=+587.431490335" Jul 12 16:33:49.190701 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:49.190658 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" Jul 12 16:33:49.191114 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:49.190738 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" Jul 12 16:33:49.203273 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:49.203254 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" Jul 12 16:33:49.880836 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:49.880803 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr"] Jul 12 16:33:49.884747 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:49.884722 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" Jul 12 16:33:49.887803 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:49.887784 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 12 16:33:49.895601 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:49.895579 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr"] Jul 12 16:33:49.994714 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:49.994672 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fsjjr\" (UID: \"bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" Jul 12 16:33:49.994912 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:49.994729 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fsjjr\" (UID: \"bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" Jul 12 16:33:49.994912 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:49.994796 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fsjjr\" (UID: \"bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" Jul 12 16:33:49.994912 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:49.994852 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fsjjr\" (UID: \"bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" Jul 12 16:33:49.994912 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:49.994882 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5pzt\" (UniqueName: \"kubernetes.io/projected/bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2-kube-api-access-p5pzt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fsjjr\" (UID: \"bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" Jul 12 16:33:49.995061 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:49.994913 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fsjjr\" (UID: \"bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" Jul 12 16:33:50.018198 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:50.018162 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bkvph" Jul 12 16:33:50.095419 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:50.095381 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fsjjr\" (UID: \"bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" Jul 12 16:33:50.095575 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:50.095542 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fsjjr\" (UID: \"bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" Jul 12 16:33:50.095627 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:50.095579 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5pzt\" (UniqueName: \"kubernetes.io/projected/bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2-kube-api-access-p5pzt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fsjjr\" (UID: \"bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" Jul 12 16:33:50.095666 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:50.095630 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fsjjr\" (UID: \"bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" Jul 12 16:33:50.095843 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:50.095805 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fsjjr\" (UID: \"bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" Jul 12 16:33:50.095843 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:50.095827 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fsjjr\" (UID: \"bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" Jul 12 16:33:50.096050 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:50.095885 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fsjjr\" (UID: \"bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" Jul 12 16:33:50.096050 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:50.096005 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fsjjr\" (UID: \"bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" Jul 12 16:33:50.096179 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:50.096163 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fsjjr\" (UID: \"bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" Jul 12 16:33:50.097970 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:50.097949 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fsjjr\" (UID: \"bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" Jul 12 16:33:50.098072 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:50.098053 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fsjjr\" (UID: \"bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" Jul 12 16:33:50.103968 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:50.103946 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5pzt\" (UniqueName: \"kubernetes.io/projected/bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2-kube-api-access-p5pzt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fsjjr\" (UID: \"bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" Jul 12 16:33:50.197526 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:50.197496 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" Jul 12 16:33:50.349060 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:50.348831 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr"] Jul 12 16:33:51.013061 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:51.013023 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" event={"ID":"bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2","Type":"ContainerStarted","Data":"d344cb8aec92bdaee48f5640fbad4460d339934c1029e861f9ce8f9497315d45"} Jul 12 16:33:51.013302 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:51.013077 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" event={"ID":"bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2","Type":"ContainerStarted","Data":"0938e2723d1e5f762a91aefffcbc73c0c53b4cbe1d553edfd7a6f2091a3eb599"} Jul 12 16:33:51.033186 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:51.033137 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" podStartSLOduration=1.857149811 podStartE2EDuration="2.033120999s" totalImagesPullingTime="175.971188ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:33:51.031364408 +0000 UTC m=+597.484752394" watchObservedRunningTime="2026-07-12 16:33:51.033120999 +0000 UTC m=+597.486508984" Jul 12 16:33:54.797765 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:54.797737 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/2.log" Jul 12 16:33:54.798213 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:54.797786 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/2.log" Jul 12 16:33:54.805257 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:54.805233 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4zm_b89054d2-a85b-40ac-aa21-69eefa2ed9e8/ovn-acl-logging/0.log" Jul 12 16:33:54.805393 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:33:54.805262 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4zm_b89054d2-a85b-40ac-aa21-69eefa2ed9e8/ovn-acl-logging/0.log" Jul 12 16:34:00.198557 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:00.198516 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" Jul 12 16:34:00.198943 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:00.198587 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" Jul 12 16:34:00.211221 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:00.211199 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" Jul 12 16:34:01.075774 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:01.075749 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fsjjr" Jul 12 16:34:17.959006 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:17.958916 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw"] Jul 12 16:34:17.962737 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:17.962707 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" Jul 12 16:34:17.965574 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:17.965552 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 12 16:34:17.971657 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:17.971635 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw"] Jul 12 16:34:18.152685 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:18.152653 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf8e0d16-aad8-4d3b-b15a-94dc2696e41c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw\" (UID: \"bf8e0d16-aad8-4d3b-b15a-94dc2696e41c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" Jul 12 16:34:18.152685 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:18.152686 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf8e0d16-aad8-4d3b-b15a-94dc2696e41c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw\" (UID: \"bf8e0d16-aad8-4d3b-b15a-94dc2696e41c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" Jul 12 16:34:18.152949 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:18.152727 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf8e0d16-aad8-4d3b-b15a-94dc2696e41c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw\" (UID: \"bf8e0d16-aad8-4d3b-b15a-94dc2696e41c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" Jul 12 16:34:18.152949 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:18.152817 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrzk9\" (UniqueName: \"kubernetes.io/projected/bf8e0d16-aad8-4d3b-b15a-94dc2696e41c-kube-api-access-nrzk9\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw\" (UID: \"bf8e0d16-aad8-4d3b-b15a-94dc2696e41c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" Jul 12 16:34:18.152949 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:18.152878 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf8e0d16-aad8-4d3b-b15a-94dc2696e41c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw\" (UID: \"bf8e0d16-aad8-4d3b-b15a-94dc2696e41c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" Jul 12 16:34:18.152949 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:18.152932 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf8e0d16-aad8-4d3b-b15a-94dc2696e41c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw\" (UID: \"bf8e0d16-aad8-4d3b-b15a-94dc2696e41c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" Jul 12 16:34:18.254372 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:18.254289 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrzk9\" (UniqueName: \"kubernetes.io/projected/bf8e0d16-aad8-4d3b-b15a-94dc2696e41c-kube-api-access-nrzk9\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw\" (UID: \"bf8e0d16-aad8-4d3b-b15a-94dc2696e41c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" Jul 12 16:34:18.254372 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:18.254344 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf8e0d16-aad8-4d3b-b15a-94dc2696e41c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw\" (UID: \"bf8e0d16-aad8-4d3b-b15a-94dc2696e41c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" Jul 12 16:34:18.254372 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:18.254374 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf8e0d16-aad8-4d3b-b15a-94dc2696e41c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw\" (UID: \"bf8e0d16-aad8-4d3b-b15a-94dc2696e41c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" Jul 12 16:34:18.254621 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:18.254403 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf8e0d16-aad8-4d3b-b15a-94dc2696e41c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw\" (UID: \"bf8e0d16-aad8-4d3b-b15a-94dc2696e41c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" Jul 12 16:34:18.254621 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:18.254421 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf8e0d16-aad8-4d3b-b15a-94dc2696e41c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw\" (UID: \"bf8e0d16-aad8-4d3b-b15a-94dc2696e41c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" Jul 12 16:34:18.254621 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:18.254471 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf8e0d16-aad8-4d3b-b15a-94dc2696e41c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw\" (UID: \"bf8e0d16-aad8-4d3b-b15a-94dc2696e41c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" Jul 12 16:34:18.257292 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:18.255301 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf8e0d16-aad8-4d3b-b15a-94dc2696e41c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw\" (UID: \"bf8e0d16-aad8-4d3b-b15a-94dc2696e41c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" Jul 12 16:34:18.257292 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:18.255344 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf8e0d16-aad8-4d3b-b15a-94dc2696e41c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw\" (UID: \"bf8e0d16-aad8-4d3b-b15a-94dc2696e41c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" Jul 12 16:34:18.257292 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:18.255383 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf8e0d16-aad8-4d3b-b15a-94dc2696e41c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw\" (UID: \"bf8e0d16-aad8-4d3b-b15a-94dc2696e41c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" Jul 12 16:34:18.257547 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:18.257455 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf8e0d16-aad8-4d3b-b15a-94dc2696e41c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw\" (UID: \"bf8e0d16-aad8-4d3b-b15a-94dc2696e41c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" Jul 12 16:34:18.258055 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:18.258028 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf8e0d16-aad8-4d3b-b15a-94dc2696e41c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw\" (UID: \"bf8e0d16-aad8-4d3b-b15a-94dc2696e41c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" Jul 12 16:34:18.265125 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:18.265063 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrzk9\" (UniqueName: \"kubernetes.io/projected/bf8e0d16-aad8-4d3b-b15a-94dc2696e41c-kube-api-access-nrzk9\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw\" (UID: \"bf8e0d16-aad8-4d3b-b15a-94dc2696e41c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" Jul 12 16:34:18.273694 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:18.273663 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" Jul 12 16:34:18.413719 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:18.413687 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw"] Jul 12 16:34:18.415562 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:34:18.415536 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf8e0d16_aad8_4d3b_b15a_94dc2696e41c.slice/crio-9a8aee444759db4c16ceb5395af92741cbb99ff0b36970492490297963b2f4a8 WatchSource:0}: Error finding container 9a8aee444759db4c16ceb5395af92741cbb99ff0b36970492490297963b2f4a8: Status 404 returned error can't find the container with id 9a8aee444759db4c16ceb5395af92741cbb99ff0b36970492490297963b2f4a8 Jul 12 16:34:18.417110 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:18.417065 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 16:34:19.158552 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:19.158514 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" event={"ID":"bf8e0d16-aad8-4d3b-b15a-94dc2696e41c","Type":"ContainerStarted","Data":"94fac59d1d670e8c6d25df5ba8002eb46162a23bd3c72278957040c7f6c0cd5a"} Jul 12 16:34:19.158552 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:19.158560 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" event={"ID":"bf8e0d16-aad8-4d3b-b15a-94dc2696e41c","Type":"ContainerStarted","Data":"9a8aee444759db4c16ceb5395af92741cbb99ff0b36970492490297963b2f4a8"} Jul 12 16:34:19.179732 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:19.179678 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" podStartSLOduration=2.003800077 podStartE2EDuration="2.179660942s" totalImagesPullingTime="175.860865ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:34:19.178871109 +0000 UTC m=+625.632259097" watchObservedRunningTime="2026-07-12 16:34:19.179660942 +0000 UTC m=+625.633048927" Jul 12 16:34:28.274483 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:28.274442 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" Jul 12 16:34:28.274902 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:28.274509 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" Jul 12 16:34:28.286902 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:28.286877 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" Jul 12 16:34:29.222336 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:34:29.222305 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw" Jul 12 16:35:12.854284 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:35:12.854241 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-86df89688d-jsbkm"] Jul 12 16:35:12.858044 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:35:12.858019 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86df89688d-jsbkm" Jul 12 16:35:12.861661 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:35:12.861632 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 12 16:35:12.861856 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:35:12.861642 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jqdhz\"" Jul 12 16:35:12.865504 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:35:12.865232 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86df89688d-jsbkm"] Jul 12 16:35:13.046362 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:35:13.046325 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdj6t\" (UniqueName: \"kubernetes.io/projected/ec1dcdad-c214-43a0-993b-25e829965f39-kube-api-access-wdj6t\") pod \"authorino-86df89688d-jsbkm\" (UID: \"ec1dcdad-c214-43a0-993b-25e829965f39\") " pod="kuadrant-system/authorino-86df89688d-jsbkm" Jul 12 16:35:13.046536 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:35:13.046429 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec1dcdad-c214-43a0-993b-25e829965f39-tls-cert\") pod \"authorino-86df89688d-jsbkm\" (UID: \"ec1dcdad-c214-43a0-993b-25e829965f39\") " pod="kuadrant-system/authorino-86df89688d-jsbkm" Jul 12 16:35:13.147934 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:35:13.147845 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdj6t\" (UniqueName: \"kubernetes.io/projected/ec1dcdad-c214-43a0-993b-25e829965f39-kube-api-access-wdj6t\") pod \"authorino-86df89688d-jsbkm\" (UID: \"ec1dcdad-c214-43a0-993b-25e829965f39\") " pod="kuadrant-system/authorino-86df89688d-jsbkm" Jul 12 16:35:13.148078 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:35:13.147961 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec1dcdad-c214-43a0-993b-25e829965f39-tls-cert\") pod \"authorino-86df89688d-jsbkm\" (UID: \"ec1dcdad-c214-43a0-993b-25e829965f39\") " pod="kuadrant-system/authorino-86df89688d-jsbkm" Jul 12 16:35:13.150641 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:35:13.150618 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec1dcdad-c214-43a0-993b-25e829965f39-tls-cert\") pod \"authorino-86df89688d-jsbkm\" (UID: \"ec1dcdad-c214-43a0-993b-25e829965f39\") " pod="kuadrant-system/authorino-86df89688d-jsbkm" Jul 12 16:35:13.156323 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:35:13.156290 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdj6t\" (UniqueName: \"kubernetes.io/projected/ec1dcdad-c214-43a0-993b-25e829965f39-kube-api-access-wdj6t\") pod \"authorino-86df89688d-jsbkm\" (UID: \"ec1dcdad-c214-43a0-993b-25e829965f39\") " pod="kuadrant-system/authorino-86df89688d-jsbkm" Jul 12 16:35:13.167767 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:35:13.167744 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86df89688d-jsbkm" Jul 12 16:35:13.304116 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:35:13.304062 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86df89688d-jsbkm"] Jul 12 16:35:13.304839 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:35:13.304813 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec1dcdad_c214_43a0_993b_25e829965f39.slice/crio-0fe17567946c61a1535ea6a63eb2ea861f3440c1f9d5239cf8366444c18ad8ea WatchSource:0}: Error finding container 0fe17567946c61a1535ea6a63eb2ea861f3440c1f9d5239cf8366444c18ad8ea: Status 404 returned error can't find the container with id 0fe17567946c61a1535ea6a63eb2ea861f3440c1f9d5239cf8366444c18ad8ea Jul 12 16:35:13.443581 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:35:13.443537 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86df89688d-jsbkm" event={"ID":"ec1dcdad-c214-43a0-993b-25e829965f39","Type":"ContainerStarted","Data":"0fe17567946c61a1535ea6a63eb2ea861f3440c1f9d5239cf8366444c18ad8ea"} Jul 12 16:35:14.451172 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:35:14.451133 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86df89688d-jsbkm" event={"ID":"ec1dcdad-c214-43a0-993b-25e829965f39","Type":"ContainerStarted","Data":"721f711f8e0ded4f4fe3ebb103a522443c80005145a092fdba538d0d8f676575"} Jul 12 16:35:14.470043 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:35:14.469993 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-86df89688d-jsbkm" podStartSLOduration=2.035063823 podStartE2EDuration="2.469974537s" totalImagesPullingTime="434.910714ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:35:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:35:14.46826671 +0000 UTC m=+680.921654697" watchObservedRunningTime="2026-07-12 16:35:14.469974537 +0000 UTC m=+680.923362522" Jul 12 16:36:30.263706 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:30.263671 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9cffbc554-zlrfg"] Jul 12 16:36:30.264312 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:30.263891 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-9cffbc554-zlrfg" podUID="5d3d3b4f-b02c-4835-8849-10edfd7fa822" containerName="manager" containerID="cri-o://248ee40453dd458ce16216b17ebbfe6fba9881556c8e681db13307e6990f4746" gracePeriod=30 Jul 12 16:36:30.524080 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:30.524016 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9cffbc554-zlrfg" Jul 12 16:36:30.627843 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:30.627806 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5d3d3b4f-b02c-4835-8849-10edfd7fa822-webhook-cert\") pod \"5d3d3b4f-b02c-4835-8849-10edfd7fa822\" (UID: \"5d3d3b4f-b02c-4835-8849-10edfd7fa822\") " Jul 12 16:36:30.628048 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:30.627914 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lth9s\" (UniqueName: \"kubernetes.io/projected/5d3d3b4f-b02c-4835-8849-10edfd7fa822-kube-api-access-lth9s\") pod \"5d3d3b4f-b02c-4835-8849-10edfd7fa822\" (UID: \"5d3d3b4f-b02c-4835-8849-10edfd7fa822\") " Jul 12 16:36:30.630157 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:30.630127 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d3d3b4f-b02c-4835-8849-10edfd7fa822-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5d3d3b4f-b02c-4835-8849-10edfd7fa822" (UID: "5d3d3b4f-b02c-4835-8849-10edfd7fa822"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 16:36:30.630255 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:30.630208 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d3d3b4f-b02c-4835-8849-10edfd7fa822-kube-api-access-lth9s" (OuterVolumeSpecName: "kube-api-access-lth9s") pod "5d3d3b4f-b02c-4835-8849-10edfd7fa822" (UID: "5d3d3b4f-b02c-4835-8849-10edfd7fa822"). InnerVolumeSpecName "kube-api-access-lth9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 16:36:30.728690 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:30.728640 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lth9s\" (UniqueName: \"kubernetes.io/projected/5d3d3b4f-b02c-4835-8849-10edfd7fa822-kube-api-access-lth9s\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:36:30.728690 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:30.728685 2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5d3d3b4f-b02c-4835-8849-10edfd7fa822-webhook-cert\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:36:30.877758 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:30.877663 2559 generic.go:356] "Generic (PLEG): container finished" podID="5d3d3b4f-b02c-4835-8849-10edfd7fa822" containerID="248ee40453dd458ce16216b17ebbfe6fba9881556c8e681db13307e6990f4746" exitCode=0 Jul 12 16:36:30.877758 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:30.877714 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9cffbc554-zlrfg" Jul 12 16:36:30.877993 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:30.877757 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9cffbc554-zlrfg" event={"ID":"5d3d3b4f-b02c-4835-8849-10edfd7fa822","Type":"ContainerDied","Data":"248ee40453dd458ce16216b17ebbfe6fba9881556c8e681db13307e6990f4746"} Jul 12 16:36:30.877993 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:30.877813 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9cffbc554-zlrfg" event={"ID":"5d3d3b4f-b02c-4835-8849-10edfd7fa822","Type":"ContainerDied","Data":"e5234e064ca0e0f1baec372e6f32c176321bae0b9ef257d58eaa8d7e86cc3bf9"} Jul 12 16:36:30.877993 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:30.877866 2559 scope.go:117] "RemoveContainer" containerID="248ee40453dd458ce16216b17ebbfe6fba9881556c8e681db13307e6990f4746" Jul 12 16:36:30.887533 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:30.887510 2559 scope.go:117] "RemoveContainer" containerID="248ee40453dd458ce16216b17ebbfe6fba9881556c8e681db13307e6990f4746" Jul 12 16:36:30.887823 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:36:30.887798 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"248ee40453dd458ce16216b17ebbfe6fba9881556c8e681db13307e6990f4746\": container with ID starting with 248ee40453dd458ce16216b17ebbfe6fba9881556c8e681db13307e6990f4746 not found: ID does not exist" containerID="248ee40453dd458ce16216b17ebbfe6fba9881556c8e681db13307e6990f4746" Jul 12 16:36:30.887887 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:30.887833 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"248ee40453dd458ce16216b17ebbfe6fba9881556c8e681db13307e6990f4746"} err="failed to get container status \"248ee40453dd458ce16216b17ebbfe6fba9881556c8e681db13307e6990f4746\": rpc error: code = NotFound desc = could not find container \"248ee40453dd458ce16216b17ebbfe6fba9881556c8e681db13307e6990f4746\": container with ID starting with 248ee40453dd458ce16216b17ebbfe6fba9881556c8e681db13307e6990f4746 not found: ID does not exist" Jul 12 16:36:30.899387 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:30.899363 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9cffbc554-zlrfg"] Jul 12 16:36:30.903248 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:30.903226 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-9cffbc554-zlrfg"] Jul 12 16:36:31.651902 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:31.651864 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9cffbc554-mgjnn"] Jul 12 16:36:31.652333 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:31.652286 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d3d3b4f-b02c-4835-8849-10edfd7fa822" containerName="manager" Jul 12 16:36:31.652333 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:31.652299 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d3d3b4f-b02c-4835-8849-10edfd7fa822" containerName="manager" Jul 12 16:36:31.652415 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:31.652386 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d3d3b4f-b02c-4835-8849-10edfd7fa822" containerName="manager" Jul 12 16:36:31.656717 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:31.656699 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9cffbc554-mgjnn" Jul 12 16:36:31.659317 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:31.659297 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 12 16:36:31.660490 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:31.660470 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 12 16:36:31.660560 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:31.660521 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wp7sn\"" Jul 12 16:36:31.666053 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:31.666027 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9cffbc554-mgjnn"] Jul 12 16:36:31.737890 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:31.737857 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c089a73f-c78f-49c6-b800-02da87be1f50-webhook-cert\") pod \"maas-controller-9cffbc554-mgjnn\" (UID: \"c089a73f-c78f-49c6-b800-02da87be1f50\") " pod="opendatahub/maas-controller-9cffbc554-mgjnn" Jul 12 16:36:31.738127 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:31.737917 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtx6s\" (UniqueName: \"kubernetes.io/projected/c089a73f-c78f-49c6-b800-02da87be1f50-kube-api-access-rtx6s\") pod \"maas-controller-9cffbc554-mgjnn\" (UID: \"c089a73f-c78f-49c6-b800-02da87be1f50\") " pod="opendatahub/maas-controller-9cffbc554-mgjnn" Jul 12 16:36:31.839044 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:31.839007 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c089a73f-c78f-49c6-b800-02da87be1f50-webhook-cert\") pod \"maas-controller-9cffbc554-mgjnn\" (UID: \"c089a73f-c78f-49c6-b800-02da87be1f50\") " pod="opendatahub/maas-controller-9cffbc554-mgjnn" Jul 12 16:36:31.839243 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:31.839070 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtx6s\" (UniqueName: \"kubernetes.io/projected/c089a73f-c78f-49c6-b800-02da87be1f50-kube-api-access-rtx6s\") pod \"maas-controller-9cffbc554-mgjnn\" (UID: \"c089a73f-c78f-49c6-b800-02da87be1f50\") " pod="opendatahub/maas-controller-9cffbc554-mgjnn" Jul 12 16:36:31.841720 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:31.841699 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c089a73f-c78f-49c6-b800-02da87be1f50-webhook-cert\") pod \"maas-controller-9cffbc554-mgjnn\" (UID: \"c089a73f-c78f-49c6-b800-02da87be1f50\") " pod="opendatahub/maas-controller-9cffbc554-mgjnn" Jul 12 16:36:31.847171 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:31.847142 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtx6s\" (UniqueName: \"kubernetes.io/projected/c089a73f-c78f-49c6-b800-02da87be1f50-kube-api-access-rtx6s\") pod \"maas-controller-9cffbc554-mgjnn\" (UID: \"c089a73f-c78f-49c6-b800-02da87be1f50\") " pod="opendatahub/maas-controller-9cffbc554-mgjnn" Jul 12 16:36:31.968224 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:31.968190 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9cffbc554-mgjnn" Jul 12 16:36:32.061835 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:32.061802 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d3d3b4f-b02c-4835-8849-10edfd7fa822" path="/var/lib/kubelet/pods/5d3d3b4f-b02c-4835-8849-10edfd7fa822/volumes" Jul 12 16:36:32.106176 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:32.106152 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9cffbc554-mgjnn"] Jul 12 16:36:32.107658 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:36:32.107623 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc089a73f_c78f_49c6_b800_02da87be1f50.slice/crio-724db43d1050fb804c6256430b0c0e973e544cc8a0ea77044014ba79eaf7c35f WatchSource:0}: Error finding container 724db43d1050fb804c6256430b0c0e973e544cc8a0ea77044014ba79eaf7c35f: Status 404 returned error can't find the container with id 724db43d1050fb804c6256430b0c0e973e544cc8a0ea77044014ba79eaf7c35f Jul 12 16:36:32.892367 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:32.892281 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9cffbc554-mgjnn" event={"ID":"c089a73f-c78f-49c6-b800-02da87be1f50","Type":"ContainerStarted","Data":"9ecafa7cf040b88a7074bd6bfe33f954164c51bb10fc65d423510cbf082b3ebc"} Jul 12 16:36:32.892367 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:32.892331 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9cffbc554-mgjnn" event={"ID":"c089a73f-c78f-49c6-b800-02da87be1f50","Type":"ContainerStarted","Data":"724db43d1050fb804c6256430b0c0e973e544cc8a0ea77044014ba79eaf7c35f"} Jul 12 16:36:32.892757 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:32.892367 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9cffbc554-mgjnn" Jul 12 16:36:32.909018 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:32.908968 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9cffbc554-mgjnn" podStartSLOduration=1.37815175 podStartE2EDuration="1.908952018s" totalImagesPullingTime="530.800268ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:36:32.907821943 +0000 UTC m=+759.361209930" watchObservedRunningTime="2026-07-12 16:36:32.908952018 +0000 UTC m=+759.362340003" Jul 12 16:36:43.906788 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:36:43.906758 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9cffbc554-mgjnn" Jul 12 16:38:54.831604 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:38:54.831515 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/2.log" Jul 12 16:38:54.833505 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:38:54.833483 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/2.log" Jul 12 16:38:54.839053 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:38:54.839031 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4zm_b89054d2-a85b-40ac-aa21-69eefa2ed9e8/ovn-acl-logging/0.log" Jul 12 16:38:54.840544 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:38:54.840527 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4zm_b89054d2-a85b-40ac-aa21-69eefa2ed9e8/ovn-acl-logging/0.log" Jul 12 16:43:54.865741 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:43:54.865713 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/2.log" Jul 12 16:43:54.868983 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:43:54.868961 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/2.log" Jul 12 16:43:54.873407 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:43:54.873387 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4zm_b89054d2-a85b-40ac-aa21-69eefa2ed9e8/ovn-acl-logging/0.log" Jul 12 16:43:54.876503 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:43:54.876484 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4zm_b89054d2-a85b-40ac-aa21-69eefa2ed9e8/ovn-acl-logging/0.log" Jul 12 16:48:54.900435 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:48:54.900403 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/2.log" Jul 12 16:48:54.906894 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:48:54.906866 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/2.log" Jul 12 16:48:54.908159 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:48:54.908140 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4zm_b89054d2-a85b-40ac-aa21-69eefa2ed9e8/ovn-acl-logging/0.log" Jul 12 16:48:54.913973 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:48:54.913954 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4zm_b89054d2-a85b-40ac-aa21-69eefa2ed9e8/ovn-acl-logging/0.log" Jul 12 16:53:54.935422 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:53:54.935389 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/2.log" Jul 12 16:53:54.942551 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:53:54.942525 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/2.log" Jul 12 16:53:54.942856 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:53:54.942836 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4zm_b89054d2-a85b-40ac-aa21-69eefa2ed9e8/ovn-acl-logging/0.log" Jul 12 16:53:54.949738 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:53:54.949717 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4zm_b89054d2-a85b-40ac-aa21-69eefa2ed9e8/ovn-acl-logging/0.log" Jul 12 16:54:53.024798 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.024764 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v"] Jul 12 16:54:53.028343 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.028322 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.031173 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.031150 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-933ab66f-openshift-default-dockercfg-mww6v\"" Jul 12 16:54:53.050323 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.050298 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v"] Jul 12 16:54:53.065848 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.065821 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istiod-ca-cert\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.066010 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.065855 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-credential-socket\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.066010 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.065873 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istio-envoy\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.066010 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.065903 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4t8l\" (UniqueName: \"kubernetes.io/projected/fb7ab5d1-dd33-4c71-826f-dd841d24289a-kube-api-access-f4t8l\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.066010 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.065946 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istio-data\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.066173 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.066009 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-workload-socket\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.066173 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.066034 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-workload-certs\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.066173 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.066050 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istio-podinfo\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.066173 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.066084 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istio-token\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.166907 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.166872 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-credential-socket\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.166907 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.166908 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istio-envoy\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.167210 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.166925 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4t8l\" (UniqueName: \"kubernetes.io/projected/fb7ab5d1-dd33-4c71-826f-dd841d24289a-kube-api-access-f4t8l\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.167210 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.166945 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istio-data\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.167210 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.166970 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-workload-socket\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.167210 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.166996 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-workload-certs\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.167210 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.167020 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istio-podinfo\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.167210 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.167059 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istio-token\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.167210 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.167196 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istiod-ca-cert\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.167567 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.167435 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-workload-socket\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.167567 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.167471 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-workload-certs\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.167567 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.167557 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-credential-socket\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.167727 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.167589 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istio-data\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.167873 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.167856 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istiod-ca-cert\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.169746 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.169718 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istio-envoy\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.169877 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.169847 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istio-podinfo\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.174902 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.174873 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istio-token\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.175045 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.175029 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4t8l\" (UniqueName: \"kubernetes.io/projected/fb7ab5d1-dd33-4c71-826f-dd841d24289a-kube-api-access-f4t8l\") pod \"e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.342024 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.341937 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:53.489590 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.489562 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v"] Jul 12 16:54:53.491168 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:54:53.491141 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb7ab5d1_dd33_4c71_826f_dd841d24289a.slice/crio-95e9d217052f99d2d7a6fece7cdf45d57fa12109c45e22c49b06dc8a751ce918 WatchSource:0}: Error finding container 95e9d217052f99d2d7a6fece7cdf45d57fa12109c45e22c49b06dc8a751ce918: Status 404 returned error can't find the container with id 95e9d217052f99d2d7a6fece7cdf45d57fa12109c45e22c49b06dc8a751ce918 Jul 12 16:54:53.493326 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.493297 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 16:54:53.493395 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.493362 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 16:54:53.493446 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.493391 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 16:54:53.895485 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.895443 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" event={"ID":"fb7ab5d1-dd33-4c71-826f-dd841d24289a","Type":"ContainerStarted","Data":"80e5d6684c1ff14faef9c7c5ea6c063bde8ab25f41f7fb82e346378161116b4a"} Jul 12 16:54:53.895662 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.895500 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" event={"ID":"fb7ab5d1-dd33-4c71-826f-dd841d24289a","Type":"ContainerStarted","Data":"95e9d217052f99d2d7a6fece7cdf45d57fa12109c45e22c49b06dc8a751ce918"} Jul 12 16:54:53.918246 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:53.918195 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" podStartSLOduration=0.918178236 podStartE2EDuration="918.178236ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:54:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:54:53.916478528 +0000 UTC m=+1860.369866551" watchObservedRunningTime="2026-07-12 16:54:53.918178236 +0000 UTC m=+1860.371566222" Jul 12 16:54:54.342178 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:54.342137 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:54.347421 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:54.347396 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:54.901105 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:54.901053 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:54.902077 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:54.902061 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:54:59.385913 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:59.385869 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v"] Jul 12 16:54:59.386410 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:54:59.386140 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" podUID="fb7ab5d1-dd33-4c71-826f-dd841d24289a" containerName="istio-proxy" containerID="cri-o://80e5d6684c1ff14faef9c7c5ea6c063bde8ab25f41f7fb82e346378161116b4a" gracePeriod=30 Jul 12 16:55:04.644277 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.644223 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:55:04.772541 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.772504 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-workload-certs\") pod \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " Jul 12 16:55:04.772751 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.772557 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4t8l\" (UniqueName: \"kubernetes.io/projected/fb7ab5d1-dd33-4c71-826f-dd841d24289a-kube-api-access-f4t8l\") pod \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " Jul 12 16:55:04.772751 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.772629 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istiod-ca-cert\") pod \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " Jul 12 16:55:04.772751 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.772650 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istio-envoy\") pod \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " Jul 12 16:55:04.772751 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.772723 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istio-podinfo\") pod \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " Jul 12 16:55:04.772968 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.772762 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-credential-socket\") pod \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " Jul 12 16:55:04.772968 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.772798 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istio-data\") pod \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " Jul 12 16:55:04.772968 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.772849 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-workload-socket\") pod \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " Jul 12 16:55:04.772968 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.772861 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fb7ab5d1-dd33-4c71-826f-dd841d24289a" (UID: "fb7ab5d1-dd33-4c71-826f-dd841d24289a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:55:04.772968 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.772881 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istio-token\") pod \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\" (UID: \"fb7ab5d1-dd33-4c71-826f-dd841d24289a\") " Jul 12 16:55:04.773696 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.773110 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fb7ab5d1-dd33-4c71-826f-dd841d24289a" (UID: "fb7ab5d1-dd33-4c71-826f-dd841d24289a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:55:04.773696 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.773171 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istio-data" (OuterVolumeSpecName: "istio-data") pod "fb7ab5d1-dd33-4c71-826f-dd841d24289a" (UID: "fb7ab5d1-dd33-4c71-826f-dd841d24289a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:55:04.773696 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.773202 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fb7ab5d1-dd33-4c71-826f-dd841d24289a" (UID: "fb7ab5d1-dd33-4c71-826f-dd841d24289a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 16:55:04.773696 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.773228 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-credential-socket\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:55:04.773696 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.773225 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fb7ab5d1-dd33-4c71-826f-dd841d24289a" (UID: "fb7ab5d1-dd33-4c71-826f-dd841d24289a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:55:04.773696 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.773248 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-workload-certs\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:55:04.775516 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.775483 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istio-token" (OuterVolumeSpecName: "istio-token") pod "fb7ab5d1-dd33-4c71-826f-dd841d24289a" (UID: "fb7ab5d1-dd33-4c71-826f-dd841d24289a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 16:55:04.775516 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.775497 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fb7ab5d1-dd33-4c71-826f-dd841d24289a" (UID: "fb7ab5d1-dd33-4c71-826f-dd841d24289a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 12 16:55:04.775666 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.775612 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb7ab5d1-dd33-4c71-826f-dd841d24289a-kube-api-access-f4t8l" (OuterVolumeSpecName: "kube-api-access-f4t8l") pod "fb7ab5d1-dd33-4c71-826f-dd841d24289a" (UID: "fb7ab5d1-dd33-4c71-826f-dd841d24289a"). InnerVolumeSpecName "kube-api-access-f4t8l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 16:55:04.775666 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.775612 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fb7ab5d1-dd33-4c71-826f-dd841d24289a" (UID: "fb7ab5d1-dd33-4c71-826f-dd841d24289a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:55:04.874390 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.874356 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4t8l\" (UniqueName: \"kubernetes.io/projected/fb7ab5d1-dd33-4c71-826f-dd841d24289a-kube-api-access-f4t8l\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:55:04.874390 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.874388 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istiod-ca-cert\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:55:04.874390 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.874398 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istio-envoy\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:55:04.874632 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.874406 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istio-podinfo\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:55:04.874632 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.874414 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istio-data\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:55:04.874632 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.874425 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7ab5d1-dd33-4c71-826f-dd841d24289a-workload-socket\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:55:04.874632 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.874433 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb7ab5d1-dd33-4c71-826f-dd841d24289a-istio-token\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:55:04.955544 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.955511 2559 generic.go:356] "Generic (PLEG): container finished" podID="fb7ab5d1-dd33-4c71-826f-dd841d24289a" containerID="80e5d6684c1ff14faef9c7c5ea6c063bde8ab25f41f7fb82e346378161116b4a" exitCode=0 Jul 12 16:55:04.955721 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.955561 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" Jul 12 16:55:04.955721 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.955567 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" event={"ID":"fb7ab5d1-dd33-4c71-826f-dd841d24289a","Type":"ContainerDied","Data":"80e5d6684c1ff14faef9c7c5ea6c063bde8ab25f41f7fb82e346378161116b4a"} Jul 12 16:55:04.955721 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.955614 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v" event={"ID":"fb7ab5d1-dd33-4c71-826f-dd841d24289a","Type":"ContainerDied","Data":"95e9d217052f99d2d7a6fece7cdf45d57fa12109c45e22c49b06dc8a751ce918"} Jul 12 16:55:04.955721 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.955636 2559 scope.go:117] "RemoveContainer" containerID="80e5d6684c1ff14faef9c7c5ea6c063bde8ab25f41f7fb82e346378161116b4a" Jul 12 16:55:04.965336 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.965308 2559 scope.go:117] "RemoveContainer" containerID="80e5d6684c1ff14faef9c7c5ea6c063bde8ab25f41f7fb82e346378161116b4a" Jul 12 16:55:04.965618 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:55:04.965597 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80e5d6684c1ff14faef9c7c5ea6c063bde8ab25f41f7fb82e346378161116b4a\": container with ID starting with 80e5d6684c1ff14faef9c7c5ea6c063bde8ab25f41f7fb82e346378161116b4a not found: ID does not exist" containerID="80e5d6684c1ff14faef9c7c5ea6c063bde8ab25f41f7fb82e346378161116b4a" Jul 12 16:55:04.965682 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.965630 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80e5d6684c1ff14faef9c7c5ea6c063bde8ab25f41f7fb82e346378161116b4a"} err="failed to get container status \"80e5d6684c1ff14faef9c7c5ea6c063bde8ab25f41f7fb82e346378161116b4a\": rpc error: code = NotFound desc = could not find container \"80e5d6684c1ff14faef9c7c5ea6c063bde8ab25f41f7fb82e346378161116b4a\": container with ID starting with 80e5d6684c1ff14faef9c7c5ea6c063bde8ab25f41f7fb82e346378161116b4a not found: ID does not exist" Jul 12 16:55:04.977425 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.977400 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v"] Jul 12 16:55:04.981117 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:04.981078 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-933ab66f-openshift-default-7947cdf7b7-p7w9v"] Jul 12 16:55:05.562600 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.562565 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb"] Jul 12 16:55:05.563003 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.562983 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb7ab5d1-dd33-4c71-826f-dd841d24289a" containerName="istio-proxy" Jul 12 16:55:05.563003 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.563000 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb7ab5d1-dd33-4c71-826f-dd841d24289a" containerName="istio-proxy" Jul 12 16:55:05.563240 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.563109 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb7ab5d1-dd33-4c71-826f-dd841d24289a" containerName="istio-proxy" Jul 12 16:55:05.567580 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.567554 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.570640 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.570617 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-34002a00-openshift-default-dockercfg-r2tzf\"" Jul 12 16:55:05.580478 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.580450 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb"] Jul 12 16:55:05.682675 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.682633 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-workload-socket\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.682675 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.682672 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/542f5846-5128-40e5-a7cb-be45eca7ef69-istio-token\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.683246 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.682687 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzklt\" (UniqueName: \"kubernetes.io/projected/542f5846-5128-40e5-a7cb-be45eca7ef69-kube-api-access-dzklt\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.683246 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.682706 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-credential-socket\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.683246 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.682759 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-istio-envoy\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.683246 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.682779 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/542f5846-5128-40e5-a7cb-be45eca7ef69-istio-podinfo\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.683246 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.682812 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-workload-certs\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.683246 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.682838 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-istio-data\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.683246 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.683003 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/542f5846-5128-40e5-a7cb-be45eca7ef69-istiod-ca-cert\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.784112 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.784049 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/542f5846-5128-40e5-a7cb-be45eca7ef69-istiod-ca-cert\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.784284 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.784148 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-workload-socket\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.784284 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.784176 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/542f5846-5128-40e5-a7cb-be45eca7ef69-istio-token\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.784284 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.784197 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzklt\" (UniqueName: \"kubernetes.io/projected/542f5846-5128-40e5-a7cb-be45eca7ef69-kube-api-access-dzklt\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.784487 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.784299 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-credential-socket\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.784487 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.784331 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-istio-envoy\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.784487 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.784355 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/542f5846-5128-40e5-a7cb-be45eca7ef69-istio-podinfo\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.784487 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.784384 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-workload-certs\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.784487 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.784447 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-istio-data\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.784805 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.784633 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-workload-socket\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.784805 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.784729 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-credential-socket\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.784805 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.784795 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-istio-data\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.784952 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.784874 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-workload-certs\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.785154 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.785134 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/542f5846-5128-40e5-a7cb-be45eca7ef69-istiod-ca-cert\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.786742 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.786718 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-istio-envoy\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.786951 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.786933 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/542f5846-5128-40e5-a7cb-be45eca7ef69-istio-podinfo\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.792681 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.792651 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/542f5846-5128-40e5-a7cb-be45eca7ef69-istio-token\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.792878 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.792854 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzklt\" (UniqueName: \"kubernetes.io/projected/542f5846-5128-40e5-a7cb-be45eca7ef69-kube-api-access-dzklt\") pod \"e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:05.880248 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:05.880151 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:06.032463 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:06.032419 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb"] Jul 12 16:55:06.033813 ip-10-0-130-204 kubenswrapper[2559]: W0712 16:55:06.033784 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod542f5846_5128_40e5_a7cb_be45eca7ef69.slice/crio-b286f5e40841a38f5aece2d6128bc738e6fcfdc8167278be7cb8d35a8d99ee79 WatchSource:0}: Error finding container b286f5e40841a38f5aece2d6128bc738e6fcfdc8167278be7cb8d35a8d99ee79: Status 404 returned error can't find the container with id b286f5e40841a38f5aece2d6128bc738e6fcfdc8167278be7cb8d35a8d99ee79 Jul 12 16:55:06.035997 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:06.035969 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 16:55:06.036068 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:06.036034 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 16:55:06.036068 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:06.036062 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 12 16:55:06.060258 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:06.060234 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb7ab5d1-dd33-4c71-826f-dd841d24289a" path="/var/lib/kubelet/pods/fb7ab5d1-dd33-4c71-826f-dd841d24289a/volumes" Jul 12 16:55:06.976833 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:06.976796 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" event={"ID":"542f5846-5128-40e5-a7cb-be45eca7ef69","Type":"ContainerStarted","Data":"5274fc942a5ccd8eb70f4eb266dd1a8e025904bd909f8f0e503602df72f8d855"} Jul 12 16:55:06.977259 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:06.976878 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" event={"ID":"542f5846-5128-40e5-a7cb-be45eca7ef69","Type":"ContainerStarted","Data":"b286f5e40841a38f5aece2d6128bc738e6fcfdc8167278be7cb8d35a8d99ee79"} Jul 12 16:55:06.998563 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:06.998513 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" podStartSLOduration=1.998498594 podStartE2EDuration="1.998498594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:55:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:55:06.997664995 +0000 UTC m=+1873.451052981" watchObservedRunningTime="2026-07-12 16:55:06.998498594 +0000 UTC m=+1873.451886615" Jul 12 16:55:07.880973 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:07.880936 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:07.885927 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:07.885901 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:07.982899 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:07.982872 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:07.983902 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:07.983882 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:12.698422 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:12.698375 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb"] Jul 12 16:55:12.698817 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:12.698575 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" podUID="542f5846-5128-40e5-a7cb-be45eca7ef69" containerName="istio-proxy" containerID="cri-o://5274fc942a5ccd8eb70f4eb266dd1a8e025904bd909f8f0e503602df72f8d855" gracePeriod=30 Jul 12 16:55:17.961460 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:17.961395 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:18.035693 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.035658 2559 generic.go:356] "Generic (PLEG): container finished" podID="542f5846-5128-40e5-a7cb-be45eca7ef69" containerID="5274fc942a5ccd8eb70f4eb266dd1a8e025904bd909f8f0e503602df72f8d855" exitCode=0 Jul 12 16:55:18.035867 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.035715 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" Jul 12 16:55:18.035867 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.035749 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" event={"ID":"542f5846-5128-40e5-a7cb-be45eca7ef69","Type":"ContainerDied","Data":"5274fc942a5ccd8eb70f4eb266dd1a8e025904bd909f8f0e503602df72f8d855"} Jul 12 16:55:18.035867 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.035810 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb" event={"ID":"542f5846-5128-40e5-a7cb-be45eca7ef69","Type":"ContainerDied","Data":"b286f5e40841a38f5aece2d6128bc738e6fcfdc8167278be7cb8d35a8d99ee79"} Jul 12 16:55:18.035867 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.035835 2559 scope.go:117] "RemoveContainer" containerID="5274fc942a5ccd8eb70f4eb266dd1a8e025904bd909f8f0e503602df72f8d855" Jul 12 16:55:18.045260 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.045237 2559 scope.go:117] "RemoveContainer" containerID="5274fc942a5ccd8eb70f4eb266dd1a8e025904bd909f8f0e503602df72f8d855" Jul 12 16:55:18.045559 ip-10-0-130-204 kubenswrapper[2559]: E0712 16:55:18.045539 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5274fc942a5ccd8eb70f4eb266dd1a8e025904bd909f8f0e503602df72f8d855\": container with ID starting with 5274fc942a5ccd8eb70f4eb266dd1a8e025904bd909f8f0e503602df72f8d855 not found: ID does not exist" containerID="5274fc942a5ccd8eb70f4eb266dd1a8e025904bd909f8f0e503602df72f8d855" Jul 12 16:55:18.045604 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.045571 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5274fc942a5ccd8eb70f4eb266dd1a8e025904bd909f8f0e503602df72f8d855"} err="failed to get container status \"5274fc942a5ccd8eb70f4eb266dd1a8e025904bd909f8f0e503602df72f8d855\": rpc error: code = NotFound desc = could not find container \"5274fc942a5ccd8eb70f4eb266dd1a8e025904bd909f8f0e503602df72f8d855\": container with ID starting with 5274fc942a5ccd8eb70f4eb266dd1a8e025904bd909f8f0e503602df72f8d855 not found: ID does not exist" Jul 12 16:55:18.105323 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.105278 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-istio-envoy\") pod \"542f5846-5128-40e5-a7cb-be45eca7ef69\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " Jul 12 16:55:18.105323 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.105325 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-istio-data\") pod \"542f5846-5128-40e5-a7cb-be45eca7ef69\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " Jul 12 16:55:18.105572 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.105361 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/542f5846-5128-40e5-a7cb-be45eca7ef69-istiod-ca-cert\") pod \"542f5846-5128-40e5-a7cb-be45eca7ef69\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " Jul 12 16:55:18.105572 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.105389 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzklt\" (UniqueName: \"kubernetes.io/projected/542f5846-5128-40e5-a7cb-be45eca7ef69-kube-api-access-dzklt\") pod \"542f5846-5128-40e5-a7cb-be45eca7ef69\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " Jul 12 16:55:18.105572 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.105423 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/542f5846-5128-40e5-a7cb-be45eca7ef69-istio-token\") pod \"542f5846-5128-40e5-a7cb-be45eca7ef69\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " Jul 12 16:55:18.105572 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.105478 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-workload-certs\") pod \"542f5846-5128-40e5-a7cb-be45eca7ef69\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " Jul 12 16:55:18.105572 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.105519 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/542f5846-5128-40e5-a7cb-be45eca7ef69-istio-podinfo\") pod \"542f5846-5128-40e5-a7cb-be45eca7ef69\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " Jul 12 16:55:18.105834 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.105579 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-workload-socket\") pod \"542f5846-5128-40e5-a7cb-be45eca7ef69\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " Jul 12 16:55:18.105834 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.105617 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-credential-socket\") pod \"542f5846-5128-40e5-a7cb-be45eca7ef69\" (UID: \"542f5846-5128-40e5-a7cb-be45eca7ef69\") " Jul 12 16:55:18.105834 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.105628 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-istio-data" (OuterVolumeSpecName: "istio-data") pod "542f5846-5128-40e5-a7cb-be45eca7ef69" (UID: "542f5846-5128-40e5-a7cb-be45eca7ef69"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:55:18.105992 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.105831 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "542f5846-5128-40e5-a7cb-be45eca7ef69" (UID: "542f5846-5128-40e5-a7cb-be45eca7ef69"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:55:18.105992 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.105850 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "542f5846-5128-40e5-a7cb-be45eca7ef69" (UID: "542f5846-5128-40e5-a7cb-be45eca7ef69"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:55:18.105992 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.105897 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/542f5846-5128-40e5-a7cb-be45eca7ef69-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "542f5846-5128-40e5-a7cb-be45eca7ef69" (UID: "542f5846-5128-40e5-a7cb-be45eca7ef69"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 16:55:18.106190 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.106013 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "542f5846-5128-40e5-a7cb-be45eca7ef69" (UID: "542f5846-5128-40e5-a7cb-be45eca7ef69"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:55:18.106190 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.106084 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-workload-socket\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:55:18.106190 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.106138 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-credential-socket\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:55:18.106190 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.106156 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-istio-data\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:55:18.106563 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.106226 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/542f5846-5128-40e5-a7cb-be45eca7ef69-istiod-ca-cert\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:55:18.106563 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.106327 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-workload-certs\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:55:18.107810 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.107781 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/542f5846-5128-40e5-a7cb-be45eca7ef69-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "542f5846-5128-40e5-a7cb-be45eca7ef69" (UID: "542f5846-5128-40e5-a7cb-be45eca7ef69"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 12 16:55:18.107937 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.107867 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/542f5846-5128-40e5-a7cb-be45eca7ef69-kube-api-access-dzklt" (OuterVolumeSpecName: "kube-api-access-dzklt") pod "542f5846-5128-40e5-a7cb-be45eca7ef69" (UID: "542f5846-5128-40e5-a7cb-be45eca7ef69"). InnerVolumeSpecName "kube-api-access-dzklt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 16:55:18.107937 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.107884 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "542f5846-5128-40e5-a7cb-be45eca7ef69" (UID: "542f5846-5128-40e5-a7cb-be45eca7ef69"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 16:55:18.107937 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.107894 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/542f5846-5128-40e5-a7cb-be45eca7ef69-istio-token" (OuterVolumeSpecName: "istio-token") pod "542f5846-5128-40e5-a7cb-be45eca7ef69" (UID: "542f5846-5128-40e5-a7cb-be45eca7ef69"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 16:55:18.207227 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.207191 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/542f5846-5128-40e5-a7cb-be45eca7ef69-istio-podinfo\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:55:18.207227 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.207221 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/542f5846-5128-40e5-a7cb-be45eca7ef69-istio-envoy\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:55:18.207227 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.207234 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzklt\" (UniqueName: \"kubernetes.io/projected/542f5846-5128-40e5-a7cb-be45eca7ef69-kube-api-access-dzklt\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:55:18.207522 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.207247 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/542f5846-5128-40e5-a7cb-be45eca7ef69-istio-token\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 16:55:18.359321 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.359285 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb"] Jul 12 16:55:18.365206 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:18.365173 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-34002a00-openshift-default-95cf7595f-zdnnb"] Jul 12 16:55:20.067039 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:55:20.067005 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="542f5846-5128-40e5-a7cb-be45eca7ef69" path="/var/lib/kubelet/pods/542f5846-5128-40e5-a7cb-be45eca7ef69/volumes" Jul 12 16:58:54.974150 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:58:54.974032 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/2.log" Jul 12 16:58:54.981664 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:58:54.981647 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4zm_b89054d2-a85b-40ac-aa21-69eefa2ed9e8/ovn-acl-logging/0.log" Jul 12 16:58:54.982069 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:58:54.982052 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/2.log" Jul 12 16:58:54.989307 ip-10-0-130-204 kubenswrapper[2559]: I0712 16:58:54.989291 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4zm_b89054d2-a85b-40ac-aa21-69eefa2ed9e8/ovn-acl-logging/0.log" Jul 12 17:01:02.267064 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.267034 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz"] Jul 12 17:01:02.267567 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.267438 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="542f5846-5128-40e5-a7cb-be45eca7ef69" containerName="istio-proxy" Jul 12 17:01:02.267567 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.267450 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="542f5846-5128-40e5-a7cb-be45eca7ef69" containerName="istio-proxy" Jul 12 17:01:02.267567 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.267506 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="542f5846-5128-40e5-a7cb-be45eca7ef69" containerName="istio-proxy" Jul 12 17:01:02.270537 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.270518 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:02.274460 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.274426 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-cc36e007\"/\"kube-root-ca.crt\"" Jul 12 17:01:02.274460 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.274438 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-cc36e007\"/\"default-dockercfg-6xbbr\"" Jul 12 17:01:02.274460 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.274438 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-cc36e007\"/\"openshift-service-ca.crt\"" Jul 12 17:01:02.274677 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.274495 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-cc36e007\"/\"e2e-lifecycle-model-cc36e007-kserve-self-signed-certs\"" Jul 12 17:01:02.278588 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.278552 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz"] Jul 12 17:01:02.361268 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.361220 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aae7f502-04dd-407c-8800-f4d078c582f3-tmp-dir\") pod \"e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz\" (UID: \"aae7f502-04dd-407c-8800-f4d078c582f3\") " pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:02.361268 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.361262 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aae7f502-04dd-407c-8800-f4d078c582f3-tls-certs\") pod \"e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz\" (UID: \"aae7f502-04dd-407c-8800-f4d078c582f3\") " pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:02.361520 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.361292 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmk4k\" (UniqueName: \"kubernetes.io/projected/aae7f502-04dd-407c-8800-f4d078c582f3-kube-api-access-hmk4k\") pod \"e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz\" (UID: \"aae7f502-04dd-407c-8800-f4d078c582f3\") " pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:02.361520 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.361356 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aae7f502-04dd-407c-8800-f4d078c582f3-dshm\") pod \"e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz\" (UID: \"aae7f502-04dd-407c-8800-f4d078c582f3\") " pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:02.361520 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.361446 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aae7f502-04dd-407c-8800-f4d078c582f3-home\") pod \"e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz\" (UID: \"aae7f502-04dd-407c-8800-f4d078c582f3\") " pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:02.361520 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.361481 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aae7f502-04dd-407c-8800-f4d078c582f3-model-cache\") pod \"e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz\" (UID: \"aae7f502-04dd-407c-8800-f4d078c582f3\") " pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:02.462753 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.462711 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aae7f502-04dd-407c-8800-f4d078c582f3-tls-certs\") pod \"e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz\" (UID: \"aae7f502-04dd-407c-8800-f4d078c582f3\") " pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:02.462944 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.462766 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmk4k\" (UniqueName: \"kubernetes.io/projected/aae7f502-04dd-407c-8800-f4d078c582f3-kube-api-access-hmk4k\") pod \"e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz\" (UID: \"aae7f502-04dd-407c-8800-f4d078c582f3\") " pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:02.462944 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.462820 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aae7f502-04dd-407c-8800-f4d078c582f3-dshm\") pod \"e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz\" (UID: \"aae7f502-04dd-407c-8800-f4d078c582f3\") " pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:02.462944 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.462860 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aae7f502-04dd-407c-8800-f4d078c582f3-home\") pod \"e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz\" (UID: \"aae7f502-04dd-407c-8800-f4d078c582f3\") " pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:02.462944 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.462885 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aae7f502-04dd-407c-8800-f4d078c582f3-model-cache\") pod \"e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz\" (UID: \"aae7f502-04dd-407c-8800-f4d078c582f3\") " pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:02.463213 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.462950 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aae7f502-04dd-407c-8800-f4d078c582f3-tmp-dir\") pod \"e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz\" (UID: \"aae7f502-04dd-407c-8800-f4d078c582f3\") " pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:02.463424 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.463363 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aae7f502-04dd-407c-8800-f4d078c582f3-model-cache\") pod \"e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz\" (UID: \"aae7f502-04dd-407c-8800-f4d078c582f3\") " pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:02.463424 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.463391 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aae7f502-04dd-407c-8800-f4d078c582f3-home\") pod \"e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz\" (UID: \"aae7f502-04dd-407c-8800-f4d078c582f3\") " pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:02.463619 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.463600 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aae7f502-04dd-407c-8800-f4d078c582f3-tmp-dir\") pod \"e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz\" (UID: \"aae7f502-04dd-407c-8800-f4d078c582f3\") " pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:02.465565 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.465534 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aae7f502-04dd-407c-8800-f4d078c582f3-tls-certs\") pod \"e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz\" (UID: \"aae7f502-04dd-407c-8800-f4d078c582f3\") " pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:02.465843 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.465820 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aae7f502-04dd-407c-8800-f4d078c582f3-dshm\") pod \"e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz\" (UID: \"aae7f502-04dd-407c-8800-f4d078c582f3\") " pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:02.470985 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.470954 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmk4k\" (UniqueName: \"kubernetes.io/projected/aae7f502-04dd-407c-8800-f4d078c582f3-kube-api-access-hmk4k\") pod \"e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz\" (UID: \"aae7f502-04dd-407c-8800-f4d078c582f3\") " pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:02.580358 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.580263 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:02.719337 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.719304 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz"] Jul 12 17:01:02.720480 ip-10-0-130-204 kubenswrapper[2559]: W0712 17:01:02.720453 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaae7f502_04dd_407c_8800_f4d078c582f3.slice/crio-8a9286196bde5abbaaaafd6dd4321708e86c0d87fa0811a3cf1fa7560fb9cefa WatchSource:0}: Error finding container 8a9286196bde5abbaaaafd6dd4321708e86c0d87fa0811a3cf1fa7560fb9cefa: Status 404 returned error can't find the container with id 8a9286196bde5abbaaaafd6dd4321708e86c0d87fa0811a3cf1fa7560fb9cefa Jul 12 17:01:02.907898 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.907860 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" event={"ID":"aae7f502-04dd-407c-8800-f4d078c582f3","Type":"ContainerStarted","Data":"e94e6473dd0c830f2f7275df98b7e3dff546d310cfd5db557b0d4232b58fac6a"} Jul 12 17:01:02.908077 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.907907 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" event={"ID":"aae7f502-04dd-407c-8800-f4d078c582f3","Type":"ContainerStarted","Data":"8a9286196bde5abbaaaafd6dd4321708e86c0d87fa0811a3cf1fa7560fb9cefa"} Jul 12 17:01:02.927673 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:02.927611 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" podStartSLOduration=0.92759422 podStartE2EDuration="927.59422ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:01:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:01:02.926382499 +0000 UTC m=+2229.379770486" watchObservedRunningTime="2026-07-12 17:01:02.92759422 +0000 UTC m=+2229.380982210" Jul 12 17:01:12.580575 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:12.580525 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:12.581163 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:12.580590 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:12.593343 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:12.593319 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:12.975406 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:12.975376 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:34.129345 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:34.129308 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz"] Jul 12 17:01:49.150501 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:49.150454 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" podUID="aae7f502-04dd-407c-8800-f4d078c582f3" containerName="main" containerID="cri-o://e94e6473dd0c830f2f7275df98b7e3dff546d310cfd5db557b0d4232b58fac6a" gracePeriod=45 Jul 12 17:01:49.404931 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:49.404907 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:49.594262 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:49.594234 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aae7f502-04dd-407c-8800-f4d078c582f3-tmp-dir\") pod \"aae7f502-04dd-407c-8800-f4d078c582f3\" (UID: \"aae7f502-04dd-407c-8800-f4d078c582f3\") " Jul 12 17:01:49.594426 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:49.594277 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aae7f502-04dd-407c-8800-f4d078c582f3-tls-certs\") pod \"aae7f502-04dd-407c-8800-f4d078c582f3\" (UID: \"aae7f502-04dd-407c-8800-f4d078c582f3\") " Jul 12 17:01:49.594426 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:49.594349 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aae7f502-04dd-407c-8800-f4d078c582f3-dshm\") pod \"aae7f502-04dd-407c-8800-f4d078c582f3\" (UID: \"aae7f502-04dd-407c-8800-f4d078c582f3\") " Jul 12 17:01:49.594426 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:49.594410 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aae7f502-04dd-407c-8800-f4d078c582f3-model-cache\") pod \"aae7f502-04dd-407c-8800-f4d078c582f3\" (UID: \"aae7f502-04dd-407c-8800-f4d078c582f3\") " Jul 12 17:01:49.594581 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:49.594436 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmk4k\" (UniqueName: \"kubernetes.io/projected/aae7f502-04dd-407c-8800-f4d078c582f3-kube-api-access-hmk4k\") pod \"aae7f502-04dd-407c-8800-f4d078c582f3\" (UID: \"aae7f502-04dd-407c-8800-f4d078c582f3\") " Jul 12 17:01:49.594581 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:49.594461 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aae7f502-04dd-407c-8800-f4d078c582f3-home\") pod \"aae7f502-04dd-407c-8800-f4d078c582f3\" (UID: \"aae7f502-04dd-407c-8800-f4d078c582f3\") " Jul 12 17:01:49.594581 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:49.594528 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aae7f502-04dd-407c-8800-f4d078c582f3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "aae7f502-04dd-407c-8800-f4d078c582f3" (UID: "aae7f502-04dd-407c-8800-f4d078c582f3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 17:01:49.594742 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:49.594680 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aae7f502-04dd-407c-8800-f4d078c582f3-model-cache" (OuterVolumeSpecName: "model-cache") pod "aae7f502-04dd-407c-8800-f4d078c582f3" (UID: "aae7f502-04dd-407c-8800-f4d078c582f3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 17:01:49.594802 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:49.594747 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aae7f502-04dd-407c-8800-f4d078c582f3-home" (OuterVolumeSpecName: "home") pod "aae7f502-04dd-407c-8800-f4d078c582f3" (UID: "aae7f502-04dd-407c-8800-f4d078c582f3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 17:01:49.594849 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:49.594819 2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aae7f502-04dd-407c-8800-f4d078c582f3-model-cache\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 17:01:49.594849 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:49.594837 2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aae7f502-04dd-407c-8800-f4d078c582f3-tmp-dir\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 17:01:49.596743 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:49.596717 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aae7f502-04dd-407c-8800-f4d078c582f3-dshm" (OuterVolumeSpecName: "dshm") pod "aae7f502-04dd-407c-8800-f4d078c582f3" (UID: "aae7f502-04dd-407c-8800-f4d078c582f3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 17:01:49.596743 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:49.596730 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aae7f502-04dd-407c-8800-f4d078c582f3-kube-api-access-hmk4k" (OuterVolumeSpecName: "kube-api-access-hmk4k") pod "aae7f502-04dd-407c-8800-f4d078c582f3" (UID: "aae7f502-04dd-407c-8800-f4d078c582f3"). InnerVolumeSpecName "kube-api-access-hmk4k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 17:01:49.596915 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:49.596717 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aae7f502-04dd-407c-8800-f4d078c582f3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "aae7f502-04dd-407c-8800-f4d078c582f3" (UID: "aae7f502-04dd-407c-8800-f4d078c582f3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 17:01:49.695926 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:49.695842 2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aae7f502-04dd-407c-8800-f4d078c582f3-dshm\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 17:01:49.695926 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:49.695871 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmk4k\" (UniqueName: \"kubernetes.io/projected/aae7f502-04dd-407c-8800-f4d078c582f3-kube-api-access-hmk4k\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 17:01:49.695926 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:49.695883 2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aae7f502-04dd-407c-8800-f4d078c582f3-home\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 17:01:49.695926 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:49.695893 2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aae7f502-04dd-407c-8800-f4d078c582f3-tls-certs\") on node \"ip-10-0-130-204.ec2.internal\" DevicePath \"\"" Jul 12 17:01:50.156887 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:50.156846 2559 generic.go:356] "Generic (PLEG): container finished" podID="aae7f502-04dd-407c-8800-f4d078c582f3" containerID="e94e6473dd0c830f2f7275df98b7e3dff546d310cfd5db557b0d4232b58fac6a" exitCode=0 Jul 12 17:01:50.157389 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:50.156894 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" Jul 12 17:01:50.157389 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:50.156932 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" event={"ID":"aae7f502-04dd-407c-8800-f4d078c582f3","Type":"ContainerDied","Data":"e94e6473dd0c830f2f7275df98b7e3dff546d310cfd5db557b0d4232b58fac6a"} Jul 12 17:01:50.157389 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:50.156974 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz" event={"ID":"aae7f502-04dd-407c-8800-f4d078c582f3","Type":"ContainerDied","Data":"8a9286196bde5abbaaaafd6dd4321708e86c0d87fa0811a3cf1fa7560fb9cefa"} Jul 12 17:01:50.157389 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:50.156992 2559 scope.go:117] "RemoveContainer" containerID="e94e6473dd0c830f2f7275df98b7e3dff546d310cfd5db557b0d4232b58fac6a" Jul 12 17:01:50.168214 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:50.168194 2559 scope.go:117] "RemoveContainer" containerID="e94e6473dd0c830f2f7275df98b7e3dff546d310cfd5db557b0d4232b58fac6a" Jul 12 17:01:50.168498 ip-10-0-130-204 kubenswrapper[2559]: E0712 17:01:50.168471 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e94e6473dd0c830f2f7275df98b7e3dff546d310cfd5db557b0d4232b58fac6a\": container with ID starting with e94e6473dd0c830f2f7275df98b7e3dff546d310cfd5db557b0d4232b58fac6a not found: ID does not exist" containerID="e94e6473dd0c830f2f7275df98b7e3dff546d310cfd5db557b0d4232b58fac6a" Jul 12 17:01:50.168571 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:50.168512 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e94e6473dd0c830f2f7275df98b7e3dff546d310cfd5db557b0d4232b58fac6a"} err="failed to get container status \"e94e6473dd0c830f2f7275df98b7e3dff546d310cfd5db557b0d4232b58fac6a\": rpc error: code = NotFound desc = could not find container \"e94e6473dd0c830f2f7275df98b7e3dff546d310cfd5db557b0d4232b58fac6a\": container with ID starting with e94e6473dd0c830f2f7275df98b7e3dff546d310cfd5db557b0d4232b58fac6a not found: ID does not exist" Jul 12 17:01:50.176530 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:50.176503 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz"] Jul 12 17:01:50.179987 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:50.179965 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-cc36e007/e2e-lifecycle-model-cc36e007-kserve-7fdbdc6c55-gkrcz"] Jul 12 17:01:52.060214 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:01:52.060180 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aae7f502-04dd-407c-8800-f4d078c582f3" path="/var/lib/kubelet/pods/aae7f502-04dd-407c-8800-f4d078c582f3/volumes" Jul 12 17:03:55.008583 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:03:55.008475 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/2.log" Jul 12 17:03:55.016353 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:03:55.016335 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4zm_b89054d2-a85b-40ac-aa21-69eefa2ed9e8/ovn-acl-logging/0.log" Jul 12 17:03:55.018657 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:03:55.018640 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/2.log" Jul 12 17:03:55.025468 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:03:55.025450 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4zm_b89054d2-a85b-40ac-aa21-69eefa2ed9e8/ovn-acl-logging/0.log" Jul 12 17:06:31.155070 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:31.155035 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86df89688d-jsbkm_ec1dcdad-c214-43a0-993b-25e829965f39/authorino/0.log" Jul 12 17:06:36.015508 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:36.015475 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-lqdjs_b54f4131-97b3-4587-82da-b5a6d9c425e9/manager/0.log" Jul 12 17:06:36.134299 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:36.134263 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6pxcd_65f26595-63f4-4127-83b1-ff7d7a09b091/manager/0.log" Jul 12 17:06:36.257945 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:36.257911 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9cffbc554-mgjnn_c089a73f-c78f-49c6-b800-02da87be1f50/manager/0.log" Jul 12 17:06:36.379268 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:36.379185 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-4bzdk_af582587-b92c-4b9d-a6f9-ff2de31e0549/server/0.log" Jul 12 17:06:36.742640 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:36.742616 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b9b7cc988-jjtxt_57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8/copy-manifests/0.log" Jul 12 17:06:36.750939 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:36.750915 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b9b7cc988-jjtxt_57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8/manager/0.log" Jul 12 17:06:37.248478 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:37.248444 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-65ccc6b695-shh9n_a10ffb6b-86ff-457a-8d16-5b56522ba338/maas-api/0.log" Jul 12 17:06:38.183421 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:38.183389 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9_c367ebc9-04f3-402a-ba79-277c627092e8/pull/0.log" Jul 12 17:06:38.189868 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:38.189843 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9_c367ebc9-04f3-402a-ba79-277c627092e8/extract/0.log" Jul 12 17:06:38.195892 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:38.195869 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9_c367ebc9-04f3-402a-ba79-277c627092e8/util/0.log" Jul 12 17:06:38.315980 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:38.315952 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb_b44fcaea-f15c-43b3-9910-de8b1982a9ec/util/0.log" Jul 12 17:06:38.322311 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:38.322286 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb_b44fcaea-f15c-43b3-9910-de8b1982a9ec/pull/0.log" Jul 12 17:06:38.328748 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:38.328723 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb_b44fcaea-f15c-43b3-9910-de8b1982a9ec/extract/0.log" Jul 12 17:06:38.445663 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:38.445587 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8_9abb5ad0-5a40-49c4-9199-4a4d9be36b65/util/0.log" Jul 12 17:06:38.452216 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:38.452189 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8_9abb5ad0-5a40-49c4-9199-4a4d9be36b65/pull/0.log" Jul 12 17:06:38.458536 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:38.458512 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8_9abb5ad0-5a40-49c4-9199-4a4d9be36b65/extract/0.log" Jul 12 17:06:38.575387 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:38.575355 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh_a7a09d6a-faa8-4439-b3b7-ed96fb76a93f/extract/0.log" Jul 12 17:06:38.581376 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:38.581349 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh_a7a09d6a-faa8-4439-b3b7-ed96fb76a93f/util/0.log" Jul 12 17:06:38.587664 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:38.587640 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh_a7a09d6a-faa8-4439-b3b7-ed96fb76a93f/pull/0.log" Jul 12 17:06:38.713053 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:38.712964 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86df89688d-jsbkm_ec1dcdad-c214-43a0-993b-25e829965f39/authorino/0.log" Jul 12 17:06:39.569361 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:39.569329 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-pwm8t_686928c6-d394-48d2-aa80-1f05c644a8c2/manager/0.log" Jul 12 17:06:39.942618 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:39.942590 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-695cd9447dv976c_9ada764e-9915-4557-86ae-dc90393975ff/istio-proxy/0.log" Jul 12 17:06:40.424560 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:40.424527 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-mczpl_f5142047-88e7-4c30-96b2-a59c93bd81fa/istio-proxy/1.log" Jul 12 17:06:40.564637 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:40.564606 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-7lmp2_5cd5c9dc-62b6-47ae-a56b-48cfdc8887e7/payload-pre-processing/0.log" Jul 12 17:06:40.813316 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:40.813240 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84d8b6c75b-z8cbq_d7f3297c-6de4-4db9-b1a9-df6b0c61dff4/router/0.log" Jul 12 17:06:41.293835 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:41.293810 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-bkvph_e806ad38-8406-4eae-b432-89cb6c4319f2/main/0.log" Jul 12 17:06:41.407454 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:41.407425 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-fsjjr_bb29d1b7-c4e0-4bf3-8ac6-c0a1b2ff8ff2/main/0.log" Jul 12 17:06:41.758432 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:41.758403 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-72qxw_bf8e0d16-aad8-4d3b-b15a-94dc2696e41c/main/0.log" Jul 12 17:06:48.915921 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:48.915887 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8l4qq_9ef6eef5-8bcb-409b-92c8-8be3c0632ec9/global-pull-secret-syncer/0.log" Jul 12 17:06:49.030593 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:49.030562 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4hxjr_56d25b5a-80b2-4960-94d2-f6aeab700e82/konnectivity-agent/0.log" Jul 12 17:06:49.089845 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:49.089805 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-204.ec2.internal_ec6b92b0a7a5ab3f89d1c8e01ecdb934/haproxy/0.log" Jul 12 17:06:53.582820 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:53.582790 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9_c367ebc9-04f3-402a-ba79-277c627092e8/extract/0.log" Jul 12 17:06:53.607707 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:53.607663 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9_c367ebc9-04f3-402a-ba79-277c627092e8/util/0.log" Jul 12 17:06:53.634356 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:53.634325 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pjld9_c367ebc9-04f3-402a-ba79-277c627092e8/pull/0.log" Jul 12 17:06:53.663805 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:53.663771 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb_b44fcaea-f15c-43b3-9910-de8b1982a9ec/extract/0.log" Jul 12 17:06:53.686569 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:53.686548 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb_b44fcaea-f15c-43b3-9910-de8b1982a9ec/util/0.log" Jul 12 17:06:53.711055 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:53.711029 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lpsvb_b44fcaea-f15c-43b3-9910-de8b1982a9ec/pull/0.log" Jul 12 17:06:53.746151 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:53.746124 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8_9abb5ad0-5a40-49c4-9199-4a4d9be36b65/extract/0.log" Jul 12 17:06:53.767739 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:53.767713 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8_9abb5ad0-5a40-49c4-9199-4a4d9be36b65/util/0.log" Jul 12 17:06:53.788659 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:53.788622 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7369cq8_9abb5ad0-5a40-49c4-9199-4a4d9be36b65/pull/0.log" Jul 12 17:06:53.815253 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:53.815217 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh_a7a09d6a-faa8-4439-b3b7-ed96fb76a93f/extract/0.log" Jul 12 17:06:53.845480 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:53.845451 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh_a7a09d6a-faa8-4439-b3b7-ed96fb76a93f/util/0.log" Jul 12 17:06:53.875565 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:53.875536 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sb5bh_a7a09d6a-faa8-4439-b3b7-ed96fb76a93f/pull/0.log" Jul 12 17:06:54.126192 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:54.126079 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86df89688d-jsbkm_ec1dcdad-c214-43a0-993b-25e829965f39/authorino/0.log" Jul 12 17:06:54.452788 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:54.452751 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-pwm8t_686928c6-d394-48d2-aa80-1f05c644a8c2/manager/0.log" Jul 12 17:06:56.373612 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:56.373569 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-czbmv_3fd322d1-8f09-427d-af0b-21ba0d1c2291/cluster-monitoring-operator/0.log" Jul 12 17:06:56.544008 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:56.543915 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-46c2b_51857d11-273c-4de9-9996-029443eff815/node-exporter/0.log" Jul 12 17:06:56.569108 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:56.569053 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-46c2b_51857d11-273c-4de9-9996-029443eff815/kube-rbac-proxy/0.log" Jul 12 17:06:56.593007 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:56.592972 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-46c2b_51857d11-273c-4de9-9996-029443eff815/init-textfile/0.log" Jul 12 17:06:59.155398 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.155360 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/2.log" Jul 12 17:06:59.160313 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.160276 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rqghp_0deee09d-6830-46ab-b752-083e182d70ed/console-operator/3.log" Jul 12 17:06:59.184382 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.184353 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz"] Jul 12 17:06:59.184742 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.184728 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aae7f502-04dd-407c-8800-f4d078c582f3" containerName="main" Jul 12 17:06:59.184793 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.184743 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aae7f502-04dd-407c-8800-f4d078c582f3" containerName="main" Jul 12 17:06:59.184829 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.184817 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aae7f502-04dd-407c-8800-f4d078c582f3" containerName="main" Jul 12 17:06:59.188042 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.188024 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz" Jul 12 17:06:59.190406 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.190383 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g4l5h\"/\"default-dockercfg-qfd2j\"" Jul 12 17:06:59.190506 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.190421 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g4l5h\"/\"kube-root-ca.crt\"" Jul 12 17:06:59.191529 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.191513 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g4l5h\"/\"openshift-service-ca.crt\"" Jul 12 17:06:59.197787 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.197765 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz"] Jul 12 17:06:59.268220 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.268185 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8c490de-ca9f-4f90-95f3-49fe28722ec0-sys\") pod \"perf-node-gather-daemonset-wdldz\" (UID: \"f8c490de-ca9f-4f90-95f3-49fe28722ec0\") " pod="openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz" Jul 12 17:06:59.268220 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.268233 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8c490de-ca9f-4f90-95f3-49fe28722ec0-lib-modules\") pod \"perf-node-gather-daemonset-wdldz\" (UID: \"f8c490de-ca9f-4f90-95f3-49fe28722ec0\") " pod="openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz" Jul 12 17:06:59.268450 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.268261 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f8c490de-ca9f-4f90-95f3-49fe28722ec0-podres\") pod \"perf-node-gather-daemonset-wdldz\" (UID: \"f8c490de-ca9f-4f90-95f3-49fe28722ec0\") " pod="openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz" Jul 12 17:06:59.268450 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.268283 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lktgz\" (UniqueName: \"kubernetes.io/projected/f8c490de-ca9f-4f90-95f3-49fe28722ec0-kube-api-access-lktgz\") pod \"perf-node-gather-daemonset-wdldz\" (UID: \"f8c490de-ca9f-4f90-95f3-49fe28722ec0\") " pod="openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz" Jul 12 17:06:59.268450 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.268326 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f8c490de-ca9f-4f90-95f3-49fe28722ec0-proc\") pod \"perf-node-gather-daemonset-wdldz\" (UID: \"f8c490de-ca9f-4f90-95f3-49fe28722ec0\") " pod="openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz" Jul 12 17:06:59.369633 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.369596 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f8c490de-ca9f-4f90-95f3-49fe28722ec0-proc\") pod \"perf-node-gather-daemonset-wdldz\" (UID: \"f8c490de-ca9f-4f90-95f3-49fe28722ec0\") " pod="openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz" Jul 12 17:06:59.369836 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.369664 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8c490de-ca9f-4f90-95f3-49fe28722ec0-sys\") pod \"perf-node-gather-daemonset-wdldz\" (UID: \"f8c490de-ca9f-4f90-95f3-49fe28722ec0\") " pod="openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz" Jul 12 17:06:59.369836 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.369696 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8c490de-ca9f-4f90-95f3-49fe28722ec0-lib-modules\") pod \"perf-node-gather-daemonset-wdldz\" (UID: \"f8c490de-ca9f-4f90-95f3-49fe28722ec0\") " pod="openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz" Jul 12 17:06:59.369836 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.369725 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f8c490de-ca9f-4f90-95f3-49fe28722ec0-podres\") pod \"perf-node-gather-daemonset-wdldz\" (UID: \"f8c490de-ca9f-4f90-95f3-49fe28722ec0\") " pod="openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz" Jul 12 17:06:59.369836 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.369732 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f8c490de-ca9f-4f90-95f3-49fe28722ec0-proc\") pod \"perf-node-gather-daemonset-wdldz\" (UID: \"f8c490de-ca9f-4f90-95f3-49fe28722ec0\") " pod="openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz" Jul 12 17:06:59.369836 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.369745 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lktgz\" (UniqueName: \"kubernetes.io/projected/f8c490de-ca9f-4f90-95f3-49fe28722ec0-kube-api-access-lktgz\") pod \"perf-node-gather-daemonset-wdldz\" (UID: \"f8c490de-ca9f-4f90-95f3-49fe28722ec0\") " pod="openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz" Jul 12 17:06:59.369836 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.369824 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8c490de-ca9f-4f90-95f3-49fe28722ec0-sys\") pod \"perf-node-gather-daemonset-wdldz\" (UID: \"f8c490de-ca9f-4f90-95f3-49fe28722ec0\") " pod="openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz" Jul 12 17:06:59.369836 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.369835 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f8c490de-ca9f-4f90-95f3-49fe28722ec0-podres\") pod \"perf-node-gather-daemonset-wdldz\" (UID: \"f8c490de-ca9f-4f90-95f3-49fe28722ec0\") " pod="openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz" Jul 12 17:06:59.370083 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.369891 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8c490de-ca9f-4f90-95f3-49fe28722ec0-lib-modules\") pod \"perf-node-gather-daemonset-wdldz\" (UID: \"f8c490de-ca9f-4f90-95f3-49fe28722ec0\") " pod="openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz" Jul 12 17:06:59.377886 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.377866 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lktgz\" (UniqueName: \"kubernetes.io/projected/f8c490de-ca9f-4f90-95f3-49fe28722ec0-kube-api-access-lktgz\") pod \"perf-node-gather-daemonset-wdldz\" (UID: \"f8c490de-ca9f-4f90-95f3-49fe28722ec0\") " pod="openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz" Jul 12 17:06:59.499963 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.499873 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz" Jul 12 17:06:59.635397 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.635367 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz"] Jul 12 17:06:59.636765 ip-10-0-130-204 kubenswrapper[2559]: W0712 17:06:59.636737 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf8c490de_ca9f_4f90_95f3_49fe28722ec0.slice/crio-bcaf0a9299721dc478b1379abd3667a41fb7af8c125b5650a8480dd8991134c3 WatchSource:0}: Error finding container bcaf0a9299721dc478b1379abd3667a41fb7af8c125b5650a8480dd8991134c3: Status 404 returned error can't find the container with id bcaf0a9299721dc478b1379abd3667a41fb7af8c125b5650a8480dd8991134c3 Jul 12 17:06:59.813563 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.813469 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz" event={"ID":"f8c490de-ca9f-4f90-95f3-49fe28722ec0","Type":"ContainerStarted","Data":"5f40d0cdfa6d18019c460945999dfa002a70898dc85c71da4797a38b065d8fb8"} Jul 12 17:06:59.813563 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.813525 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz" event={"ID":"f8c490de-ca9f-4f90-95f3-49fe28722ec0","Type":"ContainerStarted","Data":"bcaf0a9299721dc478b1379abd3667a41fb7af8c125b5650a8480dd8991134c3"} Jul 12 17:06:59.813794 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.813576 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz" Jul 12 17:06:59.828689 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:06:59.828634 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz" podStartSLOduration=0.828619656 podStartE2EDuration="828.619656ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 17:06:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:06:59.827739873 +0000 UTC m=+2586.281127859" watchObservedRunningTime="2026-07-12 17:06:59.828619656 +0000 UTC m=+2586.282007643" Jul 12 17:07:00.335404 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:00.335377 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-msnlw_24ec1189-1069-45cb-b2de-11141419b010/volume-data-source-validator/0.log" Jul 12 17:07:01.401138 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:01.401103 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cmxw4_858081cc-8c94-4852-a450-c2e699e9b42d/dns/0.log" Jul 12 17:07:01.424587 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:01.424560 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cmxw4_858081cc-8c94-4852-a450-c2e699e9b42d/kube-rbac-proxy/0.log" Jul 12 17:07:01.545297 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:01.545262 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-trttp_08851e67-2ac0-483b-b958-00384bf7a112/dns-node-resolver/0.log" Jul 12 17:07:02.155349 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:02.155318 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ng9tv_2698e055-6034-4dad-9f91-fa9dd870b375/node-ca/0.log" Jul 12 17:07:03.063180 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:03.063140 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-695cd9447dv976c_9ada764e-9915-4557-86ae-dc90393975ff/istio-proxy/0.log" Jul 12 17:07:03.205680 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:03.205646 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-mczpl_f5142047-88e7-4c30-96b2-a59c93bd81fa/istio-proxy/0.log" Jul 12 17:07:03.234963 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:03.234926 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-mczpl_f5142047-88e7-4c30-96b2-a59c93bd81fa/istio-proxy/1.log" Jul 12 17:07:03.264177 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:03.264149 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-7lmp2_5cd5c9dc-62b6-47ae-a56b-48cfdc8887e7/payload-pre-processing/0.log" Jul 12 17:07:03.330794 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:03.330712 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84d8b6c75b-z8cbq_d7f3297c-6de4-4db9-b1a9-df6b0c61dff4/router/0.log" Jul 12 17:07:03.967364 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:03.967331 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bfd2h_39d81524-c036-4b18-a3ec-74f2e318fd2e/serve-healthcheck-canary/0.log" Jul 12 17:07:04.465679 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:04.465650 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-6fzkl_f8a4983d-64c5-4bf8-92fd-383dab1323ba/insights-operator/0.log" Jul 12 17:07:04.487018 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:04.486992 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cts6x_cbf613d9-055b-406e-a242-575ebd6c8456/kube-rbac-proxy/0.log" Jul 12 17:07:04.508401 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:04.508366 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cts6x_cbf613d9-055b-406e-a242-575ebd6c8456/exporter/0.log" Jul 12 17:07:04.531107 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:04.531065 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cts6x_cbf613d9-055b-406e-a242-575ebd6c8456/extractor/0.log" Jul 12 17:07:05.829189 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:05.829159 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g4l5h/perf-node-gather-daemonset-wdldz" Jul 12 17:07:06.812082 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:06.812052 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-lqdjs_b54f4131-97b3-4587-82da-b5a6d9c425e9/manager/0.log" Jul 12 17:07:06.908295 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:06.908262 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6pxcd_65f26595-63f4-4127-83b1-ff7d7a09b091/manager/0.log" Jul 12 17:07:06.991443 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:06.991404 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9cffbc554-mgjnn_c089a73f-c78f-49c6-b800-02da87be1f50/manager/0.log" Jul 12 17:07:07.014719 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:07.014691 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-4bzdk_af582587-b92c-4b9d-a6f9-ff2de31e0549/server/0.log" Jul 12 17:07:07.171374 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:07.171342 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b9b7cc988-jjtxt_57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8/manager/0.log" Jul 12 17:07:07.192860 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:07.192833 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b9b7cc988-jjtxt_57c0e390-0f41-43ed-a0e7-ec8d78eeb3a8/copy-manifests/0.log" Jul 12 17:07:08.591853 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:08.591774 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7cdff5df8d-rjlxq_78e88911-9946-485c-b169-92cd325d0c2b/manager/0.log" Jul 12 17:07:09.481964 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:09.481887 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-695cd9447dv976c_9ada764e-9915-4557-86ae-dc90393975ff/istio-proxy/0.log" Jul 12 17:07:09.586061 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:09.586030 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-mczpl_f5142047-88e7-4c30-96b2-a59c93bd81fa/istio-proxy/0.log" Jul 12 17:07:09.616593 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:09.616559 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-mczpl_f5142047-88e7-4c30-96b2-a59c93bd81fa/istio-proxy/1.log" Jul 12 17:07:09.637392 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:09.637366 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-7lmp2_5cd5c9dc-62b6-47ae-a56b-48cfdc8887e7/payload-pre-processing/0.log" Jul 12 17:07:09.680576 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:09.680548 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84d8b6c75b-z8cbq_d7f3297c-6de4-4db9-b1a9-df6b0c61dff4/router/0.log" Jul 12 17:07:10.804561 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:10.804531 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-695cd9447dv976c_9ada764e-9915-4557-86ae-dc90393975ff/istio-proxy/0.log" Jul 12 17:07:10.928472 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:10.928437 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-mczpl_f5142047-88e7-4c30-96b2-a59c93bd81fa/istio-proxy/0.log" Jul 12 17:07:10.957585 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:10.957554 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-mczpl_f5142047-88e7-4c30-96b2-a59c93bd81fa/istio-proxy/1.log" Jul 12 17:07:10.983569 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:10.983541 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-7lmp2_5cd5c9dc-62b6-47ae-a56b-48cfdc8887e7/payload-pre-processing/0.log" Jul 12 17:07:11.030549 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:11.030520 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84d8b6c75b-z8cbq_d7f3297c-6de4-4db9-b1a9-df6b0c61dff4/router/0.log" Jul 12 17:07:14.061195 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:14.061165 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-bvl9s_0710e54e-dec4-4fd6-be9f-a923266bf153/kube-storage-version-migrator-operator/1.log" Jul 12 17:07:14.062145 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:14.062128 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-bvl9s_0710e54e-dec4-4fd6-be9f-a923266bf153/kube-storage-version-migrator-operator/0.log" Jul 12 17:07:15.232412 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:15.232386 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hztg9_cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559/kube-multus-additional-cni-plugins/0.log" Jul 12 17:07:15.253533 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:15.253505 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hztg9_cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559/egress-router-binary-copy/0.log" Jul 12 17:07:15.274840 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:15.274813 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hztg9_cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559/cni-plugins/0.log" Jul 12 17:07:15.296041 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:15.296019 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hztg9_cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559/bond-cni-plugin/0.log" Jul 12 17:07:15.317454 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:15.317413 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hztg9_cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559/routeoverride-cni/0.log" Jul 12 17:07:15.338800 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:15.338772 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hztg9_cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559/whereabouts-cni-bincopy/0.log" Jul 12 17:07:15.359772 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:15.359747 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hztg9_cc9e1aea-ae32-4e4c-801e-dc0ce2c6d559/whereabouts-cni/0.log" Jul 12 17:07:15.552308 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:15.552279 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sdjjz_8b81da15-6b81-47e2-9162-e897fd167e11/kube-multus/0.log" Jul 12 17:07:15.702476 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:15.702448 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vjfj4_ccd1221a-8ea7-4bba-ba15-999ca853321e/network-metrics-daemon/0.log" Jul 12 17:07:15.721692 ip-10-0-130-204 kubenswrapper[2559]: I0712 17:07:15.721668 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vjfj4_ccd1221a-8ea7-4bba-ba15-999ca853321e/kube-rbac-proxy/0.log"