Sep 07 22:56:47.121587 ip-10-0-133-218 systemd[1]: Starting Kubernetes Kubelet...
Sep 07 22:56:47.536419 ip-10-0-133-218 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 22:56:47.536419 ip-10-0-133-218 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 07 22:56:47.536419 ip-10-0-133-218 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 22:56:47.536419 ip-10-0-133-218 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 07 22:56:47.536419 ip-10-0-133-218 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 22:56:47.537071 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.536478    2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 07 22:56:47.539617 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539601    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 22:56:47.539617 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539617    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 22:56:47.539682 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539621    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 22:56:47.539682 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539624    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 22:56:47.539682 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539627    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 22:56:47.539682 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539630    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 22:56:47.539682 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539632    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 22:56:47.539682 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539637    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 22:56:47.539682 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539641    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 22:56:47.539682 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539644    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 22:56:47.539682 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539646    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 22:56:47.539682 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539649    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 22:56:47.539682 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539652    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 22:56:47.539682 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539655    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 22:56:47.539682 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539657    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 22:56:47.539682 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539660    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 22:56:47.539682 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539662    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 22:56:47.539682 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539665    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 22:56:47.539682 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539668    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 22:56:47.539682 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539670    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 22:56:47.539682 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539674    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 22:56:47.540135 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539677    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 22:56:47.540135 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539679    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 22:56:47.540135 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539682    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 22:56:47.540135 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539691    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 22:56:47.540135 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539694    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 22:56:47.540135 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539698    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 22:56:47.540135 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539701    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 22:56:47.540135 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539703    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 22:56:47.540135 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539706    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 22:56:47.540135 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539708    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 22:56:47.540135 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539711    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 22:56:47.540135 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539713    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 22:56:47.540135 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539716    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 22:56:47.540135 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539719    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 22:56:47.540135 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539721    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 22:56:47.540135 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539723    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 22:56:47.540135 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539726    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 22:56:47.540135 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539729    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 22:56:47.540135 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539731    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 22:56:47.540135 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539734    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 22:56:47.540727 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539736    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 22:56:47.540727 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539739    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 22:56:47.540727 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539742    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 22:56:47.540727 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539744    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 22:56:47.540727 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539747    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 22:56:47.540727 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539749    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 22:56:47.540727 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539752    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 22:56:47.540727 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539754    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 22:56:47.540727 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539757    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 22:56:47.540727 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539759    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 22:56:47.540727 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539762    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 22:56:47.540727 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539764    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 22:56:47.540727 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539767    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 22:56:47.540727 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539771    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 22:56:47.540727 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539773    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 22:56:47.540727 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539776    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 22:56:47.540727 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539778    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 22:56:47.540727 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539781    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 22:56:47.540727 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539783    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 22:56:47.540727 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539786    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 22:56:47.541222 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539788    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 22:56:47.541222 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539791    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 22:56:47.541222 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539793    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 22:56:47.541222 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539796    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 22:56:47.541222 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539798    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 22:56:47.541222 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539801    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 22:56:47.541222 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539803    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 22:56:47.541222 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539806    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 22:56:47.541222 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539810    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 22:56:47.541222 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539814    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 22:56:47.541222 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539816    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 22:56:47.541222 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539819    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 22:56:47.541222 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539821    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 22:56:47.541222 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539824    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 22:56:47.541222 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539826    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 22:56:47.541222 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539829    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 22:56:47.541222 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539833    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 22:56:47.541222 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539836    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 22:56:47.541222 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539839    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 22:56:47.541707 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539842    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 22:56:47.541707 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539845    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 22:56:47.541707 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539848    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 22:56:47.541707 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539850    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 22:56:47.541707 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539853    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 22:56:47.541707 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539856    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 22:56:47.541707 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539860    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 22:56:47.541707 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539862    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 22:56:47.541707 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539865    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 22:56:47.541707 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539868    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 22:56:47.541707 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539870    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 22:56:47.541707 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539873    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 22:56:47.541707 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539876    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 22:56:47.541707 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539878    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 22:56:47.541707 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539881    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 22:56:47.541707 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539883    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 22:56:47.541707 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539886    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 22:56:47.541707 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539889    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 22:56:47.541707 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.539891    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 22:56:47.541707 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540564    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 22:56:47.542185 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540571    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 22:56:47.542185 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540574    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 22:56:47.542185 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540577    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 22:56:47.542185 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540580    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 22:56:47.542185 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540583    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 22:56:47.542185 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540585    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 22:56:47.542185 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540588    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 22:56:47.542185 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540590    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 22:56:47.542185 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540593    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 22:56:47.542185 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540596    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 22:56:47.542185 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540599    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 22:56:47.542185 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540601    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 22:56:47.542185 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540607    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 22:56:47.542185 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540610    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 22:56:47.542185 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540613    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 22:56:47.542185 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540616    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 22:56:47.542185 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540618    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 22:56:47.542185 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540621    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 22:56:47.542185 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540624    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 22:56:47.542185 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540626    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 22:56:47.542185 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540629    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 22:56:47.542724 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540631    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 22:56:47.542724 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540634    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 22:56:47.542724 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540636    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 22:56:47.542724 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540639    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 22:56:47.542724 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540641    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 22:56:47.542724 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540644    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 22:56:47.542724 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540647    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 22:56:47.542724 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540649    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 22:56:47.542724 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540652    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 22:56:47.542724 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540654    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 22:56:47.542724 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540657    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 22:56:47.542724 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540661    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 22:56:47.542724 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540665    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 22:56:47.542724 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540668    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 22:56:47.542724 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540671    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 22:56:47.542724 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540674    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 22:56:47.542724 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540677    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 22:56:47.542724 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540680    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 22:56:47.542724 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540682    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 22:56:47.542724 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540685    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 22:56:47.543216 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540687    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 22:56:47.543216 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540690    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 22:56:47.543216 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540694    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 22:56:47.543216 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540697    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 22:56:47.543216 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540701    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 22:56:47.543216 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540703    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 22:56:47.543216 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540706    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 22:56:47.543216 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540709    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 22:56:47.543216 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540713    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 22:56:47.543216 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540716    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 22:56:47.543216 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540718    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 22:56:47.543216 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540721    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 22:56:47.543216 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540724    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 22:56:47.543216 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540726    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 22:56:47.543216 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540729    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 22:56:47.543216 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540732    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 22:56:47.543216 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540734    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 22:56:47.543216 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540738    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 22:56:47.543216 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540742    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 22:56:47.543704 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540745    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 22:56:47.543704 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540748    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 22:56:47.543704 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540751    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 22:56:47.543704 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540754    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 22:56:47.543704 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540756    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 22:56:47.543704 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540759    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 22:56:47.543704 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540761    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 22:56:47.543704 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540764    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 22:56:47.543704 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540766    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 22:56:47.543704 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540769    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 22:56:47.543704 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540772    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 22:56:47.543704 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540775    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 22:56:47.543704 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540777    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 22:56:47.543704 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540780    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 22:56:47.543704 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540782    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 22:56:47.543704 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540785    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 22:56:47.543704 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540787    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 22:56:47.543704 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540790    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 22:56:47.543704 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540798    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 22:56:47.544179 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540801    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 22:56:47.544179 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540803    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 22:56:47.544179 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540806    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 22:56:47.544179 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540808    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 22:56:47.544179 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540811    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 22:56:47.544179 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540815    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 22:56:47.544179 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540817    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 22:56:47.544179 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540820    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 22:56:47.544179 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540822    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 22:56:47.544179 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540825    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 22:56:47.544179 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540827    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 22:56:47.544179 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540830    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 22:56:47.544179 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540833    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 22:56:47.544179 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540835    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 22:56:47.544179 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540838    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 22:56:47.544179 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540840    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 22:56:47.544179 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540843    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 22:56:47.544179 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540846    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 22:56:47.544179 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.540849    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 22:56:47.544179 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541197    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 22:56:47.544666 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541201    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 22:56:47.544666 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541204    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 22:56:47.544666 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541207    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 22:56:47.544666 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541210    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 22:56:47.544666 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541212    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 22:56:47.544666 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541215    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 22:56:47.544666 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541217    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 22:56:47.544666 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541220    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 22:56:47.544666 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541222    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 22:56:47.544666 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541225    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 22:56:47.544666 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541228    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 22:56:47.544666 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541231    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 22:56:47.544666 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541236    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 22:56:47.544666 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541239    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 22:56:47.544666 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541242    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 22:56:47.544666 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541244    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 22:56:47.544666 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541247    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 22:56:47.544666 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541249    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 22:56:47.544666 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541252    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 22:56:47.544666 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541254    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 22:56:47.545183 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541257    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 22:56:47.545183 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541260    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 22:56:47.545183 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541262    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 22:56:47.545183 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541265    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 22:56:47.545183 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541267    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 22:56:47.545183 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541270    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 22:56:47.545183 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541273    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 22:56:47.545183 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541275    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 22:56:47.545183 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541278    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 22:56:47.545183 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541282    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 22:56:47.545183 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541285    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 22:56:47.545183 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541288    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 22:56:47.545183 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541291    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 22:56:47.545183 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541293    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 22:56:47.545183 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541296    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 22:56:47.545183 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541298    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 22:56:47.545183 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541301    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 22:56:47.545183 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541303    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 22:56:47.545183 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541306    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 22:56:47.545183 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541308    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 22:56:47.545691 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541311    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 22:56:47.545691 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541313    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 22:56:47.545691 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541316    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 22:56:47.545691 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541318    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 22:56:47.545691 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541337    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 22:56:47.545691 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541340    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 22:56:47.545691 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541343    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 22:56:47.545691 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541346    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 22:56:47.545691 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541348    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 22:56:47.545691 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541351    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 22:56:47.545691 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541353    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 22:56:47.545691 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541357    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 22:56:47.545691 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541359    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 22:56:47.545691 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541364    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 22:56:47.545691 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541367    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 22:56:47.545691 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541370    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 22:56:47.545691 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541373    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 22:56:47.545691 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541376    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 22:56:47.545691 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541378    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 22:56:47.546149 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541381    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 22:56:47.546149 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541383    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 22:56:47.546149 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541387    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 22:56:47.546149 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541390    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 22:56:47.546149 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541392    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 22:56:47.546149 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541395    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 22:56:47.546149 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541398    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 22:56:47.546149 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541400    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 22:56:47.546149 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541403    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 22:56:47.546149 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541405    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 22:56:47.546149 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541408    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 22:56:47.546149 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541411    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 22:56:47.546149 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541413    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 22:56:47.546149 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541422    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 22:56:47.546149 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541425    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 22:56:47.546149 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541428    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 22:56:47.546149 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541432    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 22:56:47.546149 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541436    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 22:56:47.546149 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541439    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 22:56:47.546690 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541443    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 22:56:47.546690 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541447    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 22:56:47.546690 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541450    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 22:56:47.546690 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541453    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 22:56:47.546690 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541456    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 22:56:47.546690 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541458    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 22:56:47.546690 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541462    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 22:56:47.546690 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541466    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 22:56:47.546690 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541468    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 22:56:47.546690 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541471    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 22:56:47.546690 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541473    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 22:56:47.546690 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541476    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 22:56:47.546690 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541478    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 22:56:47.546690 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541481    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 22:56:47.546690 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541483    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 22:56:47.546690 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541487    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 22:56:47.546690 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541490    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 22:56:47.546690 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541493    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 22:56:47.546690 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541495    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 22:56:47.547137 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.541498    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 22:56:47.547137 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541563    2557 flags.go:64] FLAG: --address="0.0.0.0"
Sep 07 22:56:47.547137 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541593    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 07 22:56:47.547137 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541602    2557 flags.go:64] FLAG: --anonymous-auth="true"
Sep 07 22:56:47.547137 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541607    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 07 22:56:47.547137 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541610    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 07 22:56:47.547137 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541614    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 07 22:56:47.547137 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541617    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 07 22:56:47.547137 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541621    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 07 22:56:47.547137 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541625    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 07 22:56:47.547137 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541628    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 07 22:56:47.547137 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541633    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 07 22:56:47.547137 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541636    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 07 22:56:47.547137 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541645    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 07 22:56:47.547137 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541648    2557 flags.go:64] FLAG: --cgroup-root=""
Sep 07 22:56:47.547137 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541652    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 07 22:56:47.547137 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541655    2557 flags.go:64] FLAG: --client-ca-file=""
Sep 07 22:56:47.547137 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541658    2557 flags.go:64] FLAG: --cloud-provider="external"
Sep 07 22:56:47.547137 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541661    2557 flags.go:64] FLAG: --cluster-dns="[]"
Sep 07 22:56:47.547137 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541667    2557 flags.go:64] FLAG: --cluster-domain=""
Sep 07 22:56:47.547137 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541670    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 07 22:56:47.547137 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541673    2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 07 22:56:47.547137 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541676    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 07 22:56:47.547137 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541679    2557 flags.go:64] FLAG: --container-log-max-files="5"
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541683    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541686    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541689    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541692    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541696    2557 flags.go:64] FLAG: --contention-profiling="false"
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541700    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541702    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541705    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541709    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541713    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541716    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541719    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541722    2557 flags.go:64] FLAG: --enable-load-reader="false"
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541725    2557 flags.go:64] FLAG: --enable-server="true"
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541728    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541732    2557 flags.go:64] FLAG: --event-burst="100"
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541735    2557 flags.go:64] FLAG: --event-qps="50"
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541738    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541741    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541745    2557 flags.go:64] FLAG: --eviction-hard=""
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541749    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541752    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541755    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541758    2557 flags.go:64] FLAG: --eviction-soft=""
Sep 07 22:56:47.547763 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541761    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 07 22:56:47.548379 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541764    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 07 22:56:47.548379 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541767    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 07 22:56:47.548379 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541770    2557 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 07 22:56:47.548379 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541773    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 07 22:56:47.548379 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541776    2557 flags.go:64] FLAG: --fail-swap-on="true"
Sep 07 22:56:47.548379 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541778    2557 flags.go:64] FLAG: --feature-gates=""
Sep 07 22:56:47.548379 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541782    2557 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 07 22:56:47.548379 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541785    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 07 22:56:47.548379 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541788    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 07 22:56:47.548379 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541791    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 07 22:56:47.548379 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541794    2557 flags.go:64] FLAG: --healthz-port="10248"
Sep 07 22:56:47.548379 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541798    2557 flags.go:64] FLAG: --help="false"
Sep 07 22:56:47.548379 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541801    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-133-218.ec2.internal"
Sep 07 22:56:47.548379 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541804    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 07 22:56:47.548379 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541807    2557 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 07 22:56:47.548379 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541809    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 07 22:56:47.548379 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541813    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 07 22:56:47.548379 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541816    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 07 22:56:47.548379 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541819    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 07 22:56:47.548379 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541821    2557 flags.go:64] FLAG: --image-service-endpoint=""
Sep 07 22:56:47.548379 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541824    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 07 22:56:47.548379 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541827    2557 flags.go:64] FLAG: --kube-api-burst="100"
Sep 07 22:56:47.548379 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541830    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541833    2557 flags.go:64] FLAG: --kube-api-qps="50"
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541836    2557 flags.go:64] FLAG: --kube-reserved=""
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541839    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541843    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541846    2557 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541849    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541852    2557 flags.go:64] FLAG: --lock-file=""
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541855    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541858    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541861    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541866    2557 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541869    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541872    2557 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541874    2557 flags.go:64] FLAG: --logging-format="text"
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541877    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541880    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541883    2557 flags.go:64] FLAG: --manifest-url=""
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541886    2557 flags.go:64] FLAG: --manifest-url-header=""
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541893    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541895    2557 flags.go:64] FLAG: --max-open-files="1000000"
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541900    2557 flags.go:64] FLAG: --max-pods="110"
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541903    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541906    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541908    2557 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 07 22:56:47.548959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541911    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541914    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541917    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541920    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541926    2557 flags.go:64] FLAG: --node-status-max-images="50"
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541929    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541932    2557 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541936    2557 flags.go:64] FLAG: --pod-cidr=""
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541939    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541943    2557 flags.go:64] FLAG: --pod-manifest-path=""
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541946    2557 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541951    2557 flags.go:64] FLAG: --pods-per-core="0"
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541954    2557 flags.go:64] FLAG: --port="10250"
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541957    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541959    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e6539f12dab8e6c3"
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541963    2557 flags.go:64] FLAG: --qos-reserved=""
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541966    2557 flags.go:64] FLAG: --read-only-port="10255"
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541969    2557 flags.go:64] FLAG: --register-node="true"
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541972    2557 flags.go:64] FLAG: --register-with-taints=""
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541976    2557 flags.go:64] FLAG: --registry-burst="10"
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541978    2557 flags.go:64] FLAG: --registry-qps="5"
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541981    2557 flags.go:64] FLAG: --reserved-cpus=""
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541984    2557 flags.go:64] FLAG: --reserved-memory=""
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541988    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541991    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 07 22:56:47.549602 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541994    2557 flags.go:64] FLAG: --rotate-certificates="false"
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541997    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.541999    2557 flags.go:64] FLAG: --runonce="false"
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542002    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542006    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542009    2557 flags.go:64] FLAG: --seccomp-default="false"
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542011    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542015    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542018    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542021    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542024    2557 flags.go:64] FLAG: --storage-driver-password="root"
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542027    2557 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542029    2557 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542032    2557 flags.go:64] FLAG: --storage-driver-user="root"
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542035    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542038    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542041    2557 flags.go:64] FLAG: --system-cgroups=""
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542043    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542050    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542052    2557 flags.go:64] FLAG: --tls-cert-file=""
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542055    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542061    2557 flags.go:64] FLAG: --tls-min-version=""
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542064    2557 flags.go:64] FLAG: --tls-private-key-file=""
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542067    2557 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542070    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 07 22:56:47.550210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542073    2557 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 07 22:56:47.550892 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542076    2557 flags.go:64] FLAG: --v="2"
Sep 07 22:56:47.550892 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542080    2557 flags.go:64] FLAG: --version="false"
Sep 07 22:56:47.550892 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542084    2557 flags.go:64] FLAG: --vmodule=""
Sep 07 22:56:47.550892 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542087    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 07 22:56:47.550892 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.542090    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 07 22:56:47.550892 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542193    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 22:56:47.550892 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542197    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 22:56:47.550892 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542200    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 22:56:47.550892 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542203    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 22:56:47.550892 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542205    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 22:56:47.550892 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542209    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 22:56:47.550892 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542211    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 22:56:47.550892 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542214    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 22:56:47.550892 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542217    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 22:56:47.550892 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542219    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 22:56:47.550892 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542222    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 22:56:47.550892 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542224    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 22:56:47.550892 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542227    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 22:56:47.550892 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542230    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 22:56:47.550892 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542232    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 22:56:47.550892 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542234    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 22:56:47.551457 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542237    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 22:56:47.551457 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542239    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 22:56:47.551457 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542242    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 22:56:47.551457 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542245    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 22:56:47.551457 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542247    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 22:56:47.551457 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542250    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 22:56:47.551457 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542254    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 22:56:47.551457 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542258    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 22:56:47.551457 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542261    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 22:56:47.551457 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542264    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 22:56:47.551457 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542267    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 22:56:47.551457 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542270    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 22:56:47.551457 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542273    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 22:56:47.551457 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542277    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 22:56:47.551457 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542280    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 22:56:47.551457 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542282    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 22:56:47.551457 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542285    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 22:56:47.551457 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542288    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 22:56:47.551896 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542291    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 22:56:47.551896 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542294    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 22:56:47.551896 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542299    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 22:56:47.551896 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542302    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 22:56:47.551896 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542305    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 22:56:47.551896 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542308    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 22:56:47.551896 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542311    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 22:56:47.551896 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542313    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 22:56:47.551896 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542316    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 22:56:47.551896 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542318    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 22:56:47.551896 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542321    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 22:56:47.551896 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542339    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 22:56:47.551896 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542342    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 22:56:47.551896 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542344    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 22:56:47.551896 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542347    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 22:56:47.551896 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542350    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 22:56:47.551896 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542352    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 22:56:47.551896 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542355    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 22:56:47.551896 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542358    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 22:56:47.551896 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542361    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 22:56:47.552396 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542363    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 22:56:47.552396 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542366    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 22:56:47.552396 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542369    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 22:56:47.552396 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542371    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 22:56:47.552396 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542375    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 22:56:47.552396 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542379    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 22:56:47.552396 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542382    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 22:56:47.552396 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542385    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 22:56:47.552396 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542388    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 22:56:47.552396 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542390    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 22:56:47.552396 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542393    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 22:56:47.552396 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542395    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 22:56:47.552396 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542398    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 22:56:47.552396 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542400    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 22:56:47.552396 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542404    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 22:56:47.552396 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542407    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 22:56:47.552396 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542410    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 22:56:47.552396 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542412    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 22:56:47.552396 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542415    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 22:56:47.552396 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542417    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 22:56:47.552919 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542420    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 22:56:47.552919 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542423    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 22:56:47.552919 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542432    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 22:56:47.552919 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542435    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 22:56:47.552919 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542438    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 22:56:47.552919 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542440    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 22:56:47.552919 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542443    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 22:56:47.552919 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542446    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 22:56:47.552919 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542448    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 22:56:47.552919 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542451    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 22:56:47.552919 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542453    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 22:56:47.552919 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542456    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 22:56:47.552919 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542459    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 22:56:47.552919 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542461    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 22:56:47.552919 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542464    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 22:56:47.552919 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542467    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 22:56:47.552919 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542469    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 22:56:47.552919 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542472    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 22:56:47.552919 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542474    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 22:56:47.552919 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542477    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 22:56:47.553432 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542480    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 22:56:47.553432 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542482    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 22:56:47.553432 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542485    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 22:56:47.553432 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542488    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 22:56:47.553432 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.542490    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 22:56:47.553432 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.543402    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 22:56:47.553432 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.551796    2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 07 22:56:47.553432 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.551810    2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 07 22:56:47.553432 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.551824    2557 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 07 22:56:47.553432 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.551832    2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 07 22:56:47.553432 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551896    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 22:56:47.553432 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551902    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 22:56:47.553432 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551906    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 22:56:47.553432 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551910    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 22:56:47.553432 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551913    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 22:56:47.553815 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551916    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 22:56:47.553815 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551919    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 22:56:47.553815 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551922    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 22:56:47.553815 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551925    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 22:56:47.553815 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551928    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 22:56:47.553815 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551930    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 22:56:47.553815 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551933    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 22:56:47.553815 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551936    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 22:56:47.553815 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551939    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 22:56:47.553815 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551941    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 22:56:47.553815 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551944    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 22:56:47.553815 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551947    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 22:56:47.553815 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551950    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 22:56:47.553815 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551954    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 22:56:47.553815 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551958    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 22:56:47.553815 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551966    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 22:56:47.553815 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551969    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 22:56:47.553815 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551972    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 22:56:47.553815 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551975    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 22:56:47.554283 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551978    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 22:56:47.554283 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551981    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 22:56:47.554283 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551983    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 22:56:47.554283 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551986    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 22:56:47.554283 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551989    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 22:56:47.554283 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551992    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 22:56:47.554283 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551995    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 22:56:47.554283 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.551999    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 22:56:47.554283 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552001    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 22:56:47.554283 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552004    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 22:56:47.554283 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552007    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 22:56:47.554283 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552009    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 22:56:47.554283 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552012    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 22:56:47.554283 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552015    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 22:56:47.554283 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552017    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 22:56:47.554283 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552020    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 22:56:47.554283 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552023    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 22:56:47.554283 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552025    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 22:56:47.554283 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552028    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 22:56:47.554810 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552030    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 22:56:47.554810 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552033    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 22:56:47.554810 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552036    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 22:56:47.554810 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552038    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 22:56:47.554810 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552041    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 22:56:47.554810 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552044    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 22:56:47.554810 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552046    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 22:56:47.554810 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552049    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 22:56:47.554810 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552051    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 22:56:47.554810 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552054    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 22:56:47.554810 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552064    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 22:56:47.554810 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552067    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 22:56:47.554810 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552069    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 22:56:47.554810 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552072    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 22:56:47.554810 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552074    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 22:56:47.554810 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552077    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 22:56:47.554810 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552095    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 22:56:47.554810 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552099    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 22:56:47.554810 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552103    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 22:56:47.554810 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552107    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 22:56:47.555304 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552110    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 22:56:47.555304 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552113    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 22:56:47.555304 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552116    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 22:56:47.555304 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552118    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 22:56:47.555304 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552121    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 22:56:47.555304 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552124    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 22:56:47.555304 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552126    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 22:56:47.555304 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552129    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 22:56:47.555304 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552132    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 22:56:47.555304 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552135    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 22:56:47.555304 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552137    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 22:56:47.555304 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552140    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 22:56:47.555304 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552142    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 22:56:47.555304 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552145    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 22:56:47.555304 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552147    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 22:56:47.555304 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552150    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 22:56:47.555304 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552152    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 22:56:47.555304 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552155    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 22:56:47.555304 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552157    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 22:56:47.555304 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552160    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 22:56:47.555799 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552162    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 22:56:47.555799 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552165    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 22:56:47.555799 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552167    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 22:56:47.555799 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552180    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 22:56:47.555799 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552183    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 22:56:47.555799 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552186    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 22:56:47.555799 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552189    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 22:56:47.555799 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552192    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 22:56:47.555799 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552195    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 22:56:47.555799 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552197    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 22:56:47.555799 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552200    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 22:56:47.555799 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552203    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 22:56:47.555799 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552207    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 22:56:47.555799 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552210    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 22:56:47.555799 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552213    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 22:56:47.555799 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552216    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 22:56:47.556184 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.552221    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 22:56:47.556184 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552369    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 22:56:47.556184 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552374    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 22:56:47.556184 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552378    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 22:56:47.556184 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552381    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 22:56:47.556184 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552384    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 22:56:47.556184 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552387    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 22:56:47.556184 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552390    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 22:56:47.556184 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552392    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 22:56:47.556184 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552395    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 22:56:47.556184 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552397    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 22:56:47.556184 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552400    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 22:56:47.556184 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552403    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 22:56:47.556184 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552406    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 22:56:47.556184 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552409    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 22:56:47.556570 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552411    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 22:56:47.556570 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552416    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 22:56:47.556570 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552419    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 22:56:47.556570 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552422    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 22:56:47.556570 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552425    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 22:56:47.556570 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552434    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 22:56:47.556570 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552437    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 22:56:47.556570 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552440    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 22:56:47.556570 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552443    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 22:56:47.556570 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552446    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 22:56:47.556570 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552448    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 22:56:47.556570 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552451    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 22:56:47.556570 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552454    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 22:56:47.556570 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552457    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 22:56:47.556570 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552459    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 22:56:47.556570 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552462    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 22:56:47.556570 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552464    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 22:56:47.556570 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552467    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 22:56:47.556570 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552469    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 22:56:47.557023 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552472    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 22:56:47.557023 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552475    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 22:56:47.557023 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552477    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 22:56:47.557023 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552480    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 22:56:47.557023 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552482    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 22:56:47.557023 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552485    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 22:56:47.557023 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552487    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 22:56:47.557023 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552490    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 22:56:47.557023 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552492    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 22:56:47.557023 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552495    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 22:56:47.557023 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552498    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 22:56:47.557023 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552500    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 22:56:47.557023 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552503    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 22:56:47.557023 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552507    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 22:56:47.557023 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552509    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 22:56:47.557023 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552512    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 22:56:47.557023 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552514    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 22:56:47.557023 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552517    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 22:56:47.557023 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552520    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 22:56:47.557023 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552528    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 22:56:47.557518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552531    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 22:56:47.557518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552534    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 22:56:47.557518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552536    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 22:56:47.557518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552538    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 22:56:47.557518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552541    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 22:56:47.557518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552543    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 22:56:47.557518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552546    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 22:56:47.557518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552549    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 22:56:47.557518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552551    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 22:56:47.557518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552554    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 22:56:47.557518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552556    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 22:56:47.557518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552559    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 22:56:47.557518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552561    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 22:56:47.557518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552564    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 22:56:47.557518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552566    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 22:56:47.557518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552570    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 22:56:47.557518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552573    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 22:56:47.557518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552576    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 22:56:47.557518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552579    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 22:56:47.557518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552582    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 22:56:47.558018 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552584    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 22:56:47.558018 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552587    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 22:56:47.558018 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552590    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 22:56:47.558018 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552592    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 22:56:47.558018 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552595    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 22:56:47.558018 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552597    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 22:56:47.558018 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552600    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 22:56:47.558018 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552602    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 22:56:47.558018 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552605    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 22:56:47.558018 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552608    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 22:56:47.558018 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552610    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 22:56:47.558018 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552612    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 22:56:47.558018 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552620    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 22:56:47.558018 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552623    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 22:56:47.558018 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552626    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 22:56:47.558018 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552629    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 22:56:47.558018 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552631    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 22:56:47.558018 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552634    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 22:56:47.558018 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552636    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 22:56:47.558018 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552639    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 22:56:47.558518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552641    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 22:56:47.558518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552644    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 22:56:47.558518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552646    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 22:56:47.558518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552654    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 22:56:47.558518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552657    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 22:56:47.558518 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:47.552659    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 22:56:47.558518 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.552664    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 22:56:47.558518 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.552780    2557 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 07 22:56:47.558518 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.555284    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 07 22:56:47.558518 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.556352    2557 server.go:1019] "Starting client certificate rotation"
Sep 07 22:56:47.558518 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.556462    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 22:56:47.558518 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.557273    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 22:56:47.559410 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.559397    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 22:56:47.563725 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.563688    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 22:56:47.577986 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.577968    2557 log.go:25] "Validated CRI v1 runtime API"
Sep 07 22:56:47.582022 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.582009    2557 log.go:25] "Validated CRI v1 image API"
Sep 07 22:56:47.582908 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.582889    2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 07 22:56:47.585030 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.585014    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 22:56:47.589408 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.589391    2557 fs.go:135] Filesystem UUIDs: map[2f26d32c-169a-4ac5-bc2f-325ab86909b7:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ce731a3d-42d6-4334-8cf0-2cc85faae2af:/dev/nvme0n1p3]
Sep 07 22:56:47.589466 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.589408    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 07 22:56:47.594459 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.594357    2557 manager.go:216] Machine: {Timestamp:2026-09-07 22:56:47.592969168 +0000 UTC m=+0.368042060 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098859 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20cf517303c7e0d6543fb3428f5a66 SystemUUID:ec20cf51-7303-c7e0-d654-3fb3428f5a66 BootID:f7bb9cdf-2ddb-412a-bf47-c51d0fd2b450 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f2:24:4e:e8:c9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f2:24:4e:e8:c9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:77:3d:3d:02:fb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 07 22:56:47.594459 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.594457    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 07 22:56:47.594571 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.594528    2557 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 07 22:56:47.598238 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.598216    2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 07 22:56:47.598394 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.598242    2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-218.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 07 22:56:47.599158 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.599148    2557 topology_manager.go:138] "Creating topology manager with none policy"
Sep 07 22:56:47.599192 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.599162    2557 container_manager_linux.go:309] "Creating device plugin manager"
Sep 07 22:56:47.599192 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.599179    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 22:56:47.599917 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.599907    2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 22:56:47.601697 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.601686    2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 07 22:56:47.606977 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.606965    2557 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 22:56:47.607090 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.607081    2557 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 07 22:56:47.607126 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.607109    2557 kubelet.go:486] "Attempting to sync node with API server"
Sep 07 22:56:47.607126 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.607119    2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 07 22:56:47.607201 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.607133    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 07 22:56:47.607201 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.607141    2557 kubelet.go:398] "Adding apiserver pod source"
Sep 07 22:56:47.607201 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.607149    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 07 22:56:47.607599 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.607586    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 22:56:47.607642 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.607617    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 22:56:47.610061 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.610043    2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 07 22:56:47.614019 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.613078    2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 07 22:56:47.614232 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.614151    2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 07 22:56:47.614467 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.614455    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 07 22:56:47.614513 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.614475    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 07 22:56:47.614513 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.614492    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 07 22:56:47.614513 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.614500    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 07 22:56:47.614513 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.614510    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 07 22:56:47.614674 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.614518    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 07 22:56:47.615047 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.615032    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 07 22:56:47.615047 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.615049    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 07 22:56:47.615203 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.615070    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 07 22:56:47.615203 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.615082    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 07 22:56:47.615203 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.615094    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 07 22:56:47.615203 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.615112    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 07 22:56:47.616071 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.616050    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 07 22:56:47.616193 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.616176    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 07 22:56:47.617457 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:47.617433    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 07 22:56:47.617539 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:47.617469    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-218.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 07 22:56:47.621751 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.621736    2557 server.go:1268] "Started kubelet"
Sep 07 22:56:47.621835 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.621810    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 07 22:56:47.621898 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.621805    2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 07 22:56:47.621898 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.621863    2557 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 07 22:56:47.622546 ip-10-0-133-218 systemd[1]: Started Kubernetes Kubelet.
Sep 07 22:56:47.623603 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.622858    2557 server.go:310] "Adding debug handlers to kubelet server"
Sep 07 22:56:47.623603 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.623293    2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 07 22:56:47.627853 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.627829    2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-218.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 07 22:56:47.628195 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:47.628177    2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 07 22:56:47.628808 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:47.627685    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-218.ec2.internal.18d32bf4d9c393fb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-218.ec2.internal,UID:ip-10-0-133-218.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-218.ec2.internal,},FirstTimestamp:2026-09-07 22:56:47.621706747 +0000 UTC m=+0.396779637,LastTimestamp:2026-09-07 22:56:47.621706747 +0000 UTC m=+0.396779637,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-218.ec2.internal,}"
Sep 07 22:56:47.629213 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.629200    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-flvhw"
Sep 07 22:56:47.631566 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.631551    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 07 22:56:47.631626 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.631557    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 07 22:56:47.631715 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:47.631697    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-218.ec2.internal\" not found"
Sep 07 22:56:47.632356 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.632250    2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 07 22:56:47.632433 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.632371    2557 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 07 22:56:47.632433 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.632386    2557 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 07 22:56:47.632433 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.632426    2557 factory.go:55] Registering systemd factory
Sep 07 22:56:47.632586 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.632442    2557 factory.go:223] Registration of the systemd container factory successfully
Sep 07 22:56:47.632649 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.632501    2557 reconstruct.go:97] "Volume reconstruction finished"
Sep 07 22:56:47.632702 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.632652    2557 reconciler.go:29] "Reconciler: start to sync state"
Sep 07 22:56:47.632742 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.632736    2557 factory.go:153] Registering CRI-O factory
Sep 07 22:56:47.632781 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.632748    2557 factory.go:223] Registration of the crio container factory successfully
Sep 07 22:56:47.632836 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.632804    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 07 22:56:47.632836 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.632818    2557 factory.go:103] Registering Raw factory
Sep 07 22:56:47.632836 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.632829    2557 manager.go:1196] Started watching for new ooms in manager
Sep 07 22:56:47.633238 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.633225    2557 manager.go:349] Starting recovery of all containers
Sep 07 22:56:47.637413 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.637384    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-flvhw"
Sep 07 22:56:47.638182 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:47.638157    2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-218.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 07 22:56:47.638295 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:47.638273    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 07 22:56:47.642695 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.642642    2557 manager.go:354] Recovery completed
Sep 07 22:56:47.648390 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.648375    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 22:56:47.650182 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.650162    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-218.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 22:56:47.650264 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.650193    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-218.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 22:56:47.650264 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.650203    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-218.ec2.internal" event="NodeHasSufficientPID"
Sep 07 22:56:47.650803 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.650791    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 07 22:56:47.650803 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.650801    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 07 22:56:47.650803 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.650803    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 22:56:47.650803 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.650815    2557 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 22:56:47.651494 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.651476    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-218.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 22:56:47.651558 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.651510    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-218.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 22:56:47.651558 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.651527    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-218.ec2.internal" event="NodeHasSufficientPID"
Sep 07 22:56:47.651671 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:47.651612    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-218.ec2.internal.18d32bf4db760b29  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-218.ec2.internal,UID:ip-10-0-133-218.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-218.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-218.ec2.internal,},FirstTimestamp:2026-09-07 22:56:47.650179881 +0000 UTC m=+0.425252773,LastTimestamp:2026-09-07 22:56:47.650179881 +0000 UTC m=+0.425252773,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-218.ec2.internal,}"
Sep 07 22:56:47.653699 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.653684    2557 policy_none.go:49] "None policy: Start"
Sep 07 22:56:47.653699 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.653700    2557 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 07 22:56:47.653836 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.653711    2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 07 22:56:47.655814 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.655802    2557 policy_none.go:47] "Start"
Sep 07 22:56:47.680991 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.680976    2557 manager.go:337] "Starting Device Plugin manager"
Sep 07 22:56:47.707270 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:47.681008    2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 07 22:56:47.707270 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.681017    2557 server.go:87] "Starting device plugin registration server"
Sep 07 22:56:47.707270 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.681289    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 07 22:56:47.707270 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.681299    2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 07 22:56:47.707270 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.681394    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 07 22:56:47.707270 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.681478    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 07 22:56:47.707270 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.681486    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 07 22:56:47.707270 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:47.681990    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 07 22:56:47.707270 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:47.682042    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-218.ec2.internal\" not found"
Sep 07 22:56:47.722592 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.722572    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 07 22:56:47.723876 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.723850    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 07 22:56:47.723976 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.723902    2557 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 07 22:56:47.723976 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.723925    2557 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 07 22:56:47.723976 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:47.723958    2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 07 22:56:47.725872 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.725856    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 22:56:47.781890 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.781853    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 22:56:47.782744 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.782726    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-218.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 22:56:47.782816 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.782760    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-218.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 22:56:47.782816 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.782777    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-218.ec2.internal" event="NodeHasSufficientPID"
Sep 07 22:56:47.782816 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.782806    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-218.ec2.internal"
Sep 07 22:56:47.792289 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.792225    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-218.ec2.internal"
Sep 07 22:56:47.792289 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:47.792245    2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-218.ec2.internal\": node \"ip-10-0-133-218.ec2.internal\" not found"
Sep 07 22:56:47.809528 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:47.809502    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-218.ec2.internal\" not found"
Sep 07 22:56:47.824612 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.824569    2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-218.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-218.ec2.internal"]
Sep 07 22:56:47.824670 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.824661    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 22:56:47.825526 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.825510    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-218.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 22:56:47.825595 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.825544    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-218.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 22:56:47.825595 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.825557    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-218.ec2.internal" event="NodeHasSufficientPID"
Sep 07 22:56:47.827905 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.827893    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 22:56:47.828027 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.828000    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-218.ec2.internal"
Sep 07 22:56:47.828073 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.828031    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 22:56:47.828588 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.828572    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-218.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 22:56:47.828670 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.828601    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-218.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 22:56:47.828670 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.828616    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-218.ec2.internal" event="NodeHasSufficientPID"
Sep 07 22:56:47.828670 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.828629    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-218.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 22:56:47.828670 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.828649    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-218.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 22:56:47.828670 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.828657    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-218.ec2.internal" event="NodeHasSufficientPID"
Sep 07 22:56:47.830807 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.830793    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-218.ec2.internal"
Sep 07 22:56:47.830868 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.830820    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 22:56:47.831459 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.831445    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-218.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 22:56:47.831539 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.831471    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-218.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 22:56:47.831539 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.831484    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-218.ec2.internal" event="NodeHasSufficientPID"
Sep 07 22:56:47.834162 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.834147    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5f1cd443c132fc94efb930ee12180b30-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-218.ec2.internal\" (UID: \"5f1cd443c132fc94efb930ee12180b30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-218.ec2.internal"
Sep 07 22:56:47.834229 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.834169    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f1cd443c132fc94efb930ee12180b30-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-218.ec2.internal\" (UID: \"5f1cd443c132fc94efb930ee12180b30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-218.ec2.internal"
Sep 07 22:56:47.834229 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.834186    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a2bbcb9fb12c236ec947180a3f51ffeb-config\") pod \"kube-apiserver-proxy-ip-10-0-133-218.ec2.internal\" (UID: \"a2bbcb9fb12c236ec947180a3f51ffeb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-218.ec2.internal"
Sep 07 22:56:47.847835 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:47.847818    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-218.ec2.internal\" not found" node="ip-10-0-133-218.ec2.internal"
Sep 07 22:56:47.851135 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:47.851121    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-218.ec2.internal\" not found" node="ip-10-0-133-218.ec2.internal"
Sep 07 22:56:47.910550 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:47.910531    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-218.ec2.internal\" not found"
Sep 07 22:56:47.934457 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.934439    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a2bbcb9fb12c236ec947180a3f51ffeb-config\") pod \"kube-apiserver-proxy-ip-10-0-133-218.ec2.internal\" (UID: \"a2bbcb9fb12c236ec947180a3f51ffeb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-218.ec2.internal"
Sep 07 22:56:47.934563 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.934470    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5f1cd443c132fc94efb930ee12180b30-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-218.ec2.internal\" (UID: \"5f1cd443c132fc94efb930ee12180b30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-218.ec2.internal"
Sep 07 22:56:47.934563 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.934496    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f1cd443c132fc94efb930ee12180b30-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-218.ec2.internal\" (UID: \"5f1cd443c132fc94efb930ee12180b30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-218.ec2.internal"
Sep 07 22:56:47.934663 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.934548    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a2bbcb9fb12c236ec947180a3f51ffeb-config\") pod \"kube-apiserver-proxy-ip-10-0-133-218.ec2.internal\" (UID: \"a2bbcb9fb12c236ec947180a3f51ffeb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-218.ec2.internal"
Sep 07 22:56:47.934663 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.934581    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f1cd443c132fc94efb930ee12180b30-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-218.ec2.internal\" (UID: \"5f1cd443c132fc94efb930ee12180b30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-218.ec2.internal"
Sep 07 22:56:47.934663 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:47.934568    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5f1cd443c132fc94efb930ee12180b30-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-218.ec2.internal\" (UID: \"5f1cd443c132fc94efb930ee12180b30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-218.ec2.internal"
Sep 07 22:56:48.011588 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:48.011561    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-218.ec2.internal\" not found"
Sep 07 22:56:48.112312 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:48.112253    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-218.ec2.internal\" not found"
Sep 07 22:56:48.150706 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:48.150684    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-218.ec2.internal"
Sep 07 22:56:48.153807 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:48.153794    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-218.ec2.internal"
Sep 07 22:56:48.212517 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:48.212496    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-218.ec2.internal\" not found"
Sep 07 22:56:48.312942 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:48.312922    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-218.ec2.internal\" not found"
Sep 07 22:56:48.413566 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:48.413495    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-218.ec2.internal\" not found"
Sep 07 22:56:49.660703 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:49.660671    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-218.ec2.internal\" not found"
Sep 07 22:56:49.665891 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:49.665875    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 22:56:49.703075 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:49.703041    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 07 22:56:49.703432 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:49.703175    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 07 22:56:49.703432 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:49.703209    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 07 22:56:49.761575 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:49.761549    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-218.ec2.internal\" not found"
Sep 07 22:56:49.787004 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:49.786973    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 22:51:48 +0000 UTC" deadline="2028-03-31 17:08:52.92602004 +0000 UTC"
Sep 07 22:56:49.787004 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:49.787001    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13698h12m3.139022154s"
Sep 07 22:56:49.862403 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:49.862372    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-218.ec2.internal\" not found"
Sep 07 22:56:49.962991 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:49.962960    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-218.ec2.internal\" not found"
Sep 07 22:56:49.980552 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:49.980525    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2bbcb9fb12c236ec947180a3f51ffeb.slice/crio-4a6dcafe711d6a8d8c75f96da2405905b7158ebafdee3b01c984f482fb9de9b6 WatchSource:0}: Error finding container 4a6dcafe711d6a8d8c75f96da2405905b7158ebafdee3b01c984f482fb9de9b6: Status 404 returned error can't find the container with id 4a6dcafe711d6a8d8c75f96da2405905b7158ebafdee3b01c984f482fb9de9b6
Sep 07 22:56:49.980829 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:49.980801    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1cd443c132fc94efb930ee12180b30.slice/crio-0ad88eba5cf824afdabee1952a668c3ec24869b9e3db811803cf4bb2333d01f7 WatchSource:0}: Error finding container 0ad88eba5cf824afdabee1952a668c3ec24869b9e3db811803cf4bb2333d01f7: Status 404 returned error can't find the container with id 0ad88eba5cf824afdabee1952a668c3ec24869b9e3db811803cf4bb2333d01f7
Sep 07 22:56:49.985706 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:49.985567    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 22:56:50.055131 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.055107    2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 22:56:50.063903 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:50.063882    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-218.ec2.internal\" not found"
Sep 07 22:56:50.164385 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:50.164332    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-218.ec2.internal\" not found"
Sep 07 22:56:50.265127 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:50.265107    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-218.ec2.internal\" not found"
Sep 07 22:56:50.331208 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.331190    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 22:56:50.379001 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.378982    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-218.ec2.internal"
Sep 07 22:56:50.388038 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.388025    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 22:56:50.389006 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.388994    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-218.ec2.internal"
Sep 07 22:56:50.399087 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.399074    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 22:56:50.755230 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.755147    2557 apiserver.go:52] "Watching apiserver"
Sep 07 22:56:50.762089 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.761777    2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 07 22:56:50.762959 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.762934    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-6pkgd","openshift-ovn-kubernetes/ovnkube-node-dnn7j","kube-system/kube-apiserver-proxy-ip-10-0-133-218.ec2.internal","openshift-cluster-node-tuning-operator/tuned-f2m5f","openshift-dns/node-resolver-9fnns","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-218.ec2.internal","openshift-multus/multus-drkf4","openshift-multus/network-metrics-daemon-9wwxc","openshift-network-diagnostics/network-check-target-mtmmp","openshift-network-operator/iptables-alerter-wd4ll","kube-system/global-pull-secret-syncer-cds22","kube-system/konnectivity-agent-jg69x","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5","openshift-image-registry/node-ca-6c8dw"]
Sep 07 22:56:50.765863 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.765478    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6pkgd"
Sep 07 22:56:50.767621 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.767592    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6c8dw"
Sep 07 22:56:50.768283 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.768032    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 07 22:56:50.768283 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.768125    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5fbf5\""
Sep 07 22:56:50.768283 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.768257    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 07 22:56:50.769072 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.768618    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 07 22:56:50.769072 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.768642    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 07 22:56:50.769072 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.768642    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 07 22:56:50.770095 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.769816    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:56:50.770095 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:50.769944    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtmmp" podUID="e11df460-0a45-48e5-a54f-a4e08ec31b19"
Sep 07 22:56:50.770095 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.769945    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 07 22:56:50.770958 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.770403    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 07 22:56:50.770958 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.770534    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 07 22:56:50.770958 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.770747    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nhz6p\""
Sep 07 22:56:50.772227 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.772209    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.774603 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.774381    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 07 22:56:50.774603 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.774568    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9fnns"
Sep 07 22:56:50.775001 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.774982    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rdjxj\""
Sep 07 22:56:50.776659 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.776604    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.777087 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.777016    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 07 22:56:50.777087 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.777049    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8dgvm\""
Sep 07 22:56:50.777237 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.777123    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 07 22:56:50.778488 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.778470    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 07 22:56:50.778613 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.778593    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 07 22:56:50.778869 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.778854    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 07 22:56:50.779299 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.779282    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qz25z\""
Sep 07 22:56:50.780910 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.780889    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:56:50.781008 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:50.780977    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wwxc" podUID="a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff"
Sep 07 22:56:50.783897 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.783872    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wd4ll"
Sep 07 22:56:50.786204 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.786181    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 07 22:56:50.787428 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.787406    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 07 22:56:50.787516 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.787463    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 07 22:56:50.787675 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.787657    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:56:50.787762 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:50.787739    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cds22" podUID="2d26fc16-73a5-4574-9525-4ff6eabc0c32"
Sep 07 22:56:50.787816 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.787747    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xkzcb\""
Sep 07 22:56:50.789247 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789223    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5604f0be-842e-40a5-b8a4-677763cf9551-cni-binary-copy\") pod \"multus-additional-cni-plugins-6pkgd\" (UID: \"5604f0be-842e-40a5-b8a4-677763cf9551\") " pod="openshift-multus/multus-additional-cni-plugins-6pkgd"
Sep 07 22:56:50.789336 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789258    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjkws\" (UniqueName: \"kubernetes.io/projected/be6f18f7-5628-458a-93fe-962199c8f623-kube-api-access-fjkws\") pod \"node-ca-6c8dw\" (UID: \"be6f18f7-5628-458a-93fe-962199c8f623\") " pod="openshift-image-registry/node-ca-6c8dw"
Sep 07 22:56:50.789336 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789300    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-etc-sysctl-d\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.789550 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789334    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs\") pod \"network-metrics-daemon-9wwxc\" (UID: \"a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff\") " pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:56:50.789550 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789362    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-etc-kubernetes\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.789550 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789388    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt94l\" (UniqueName: \"kubernetes.io/projected/15cf1f7c-7686-47db-83a3-431fa37e2050-kube-api-access-nt94l\") pod \"node-resolver-9fnns\" (UID: \"15cf1f7c-7686-47db-83a3-431fa37e2050\") " pod="openshift-dns/node-resolver-9fnns"
Sep 07 22:56:50.789550 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789411    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-lib-modules\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.789550 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789437    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-system-cni-dir\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.789550 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789465    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-host-var-lib-cni-bin\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.789550 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789487    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-hostroot\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.789550 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789510    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/15cf1f7c-7686-47db-83a3-431fa37e2050-hosts-file\") pod \"node-resolver-9fnns\" (UID: \"15cf1f7c-7686-47db-83a3-431fa37e2050\") " pod="openshift-dns/node-resolver-9fnns"
Sep 07 22:56:50.789550 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789533    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5604f0be-842e-40a5-b8a4-677763cf9551-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6pkgd\" (UID: \"5604f0be-842e-40a5-b8a4-677763cf9551\") " pod="openshift-multus/multus-additional-cni-plugins-6pkgd"
Sep 07 22:56:50.789910 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789555    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-etc-sysconfig\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.789910 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789576    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29bvf\" (UniqueName: \"kubernetes.io/projected/9bfcafa5-70d4-4c55-94c4-5548256d27d8-kube-api-access-29bvf\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.789910 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789600    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-multus-socket-dir-parent\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.789910 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789619    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jg69x"
Sep 07 22:56:50.789910 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789621    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-host-run-k8s-cni-cncf-io\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.789910 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789696    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5604f0be-842e-40a5-b8a4-677763cf9551-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6pkgd\" (UID: \"5604f0be-842e-40a5-b8a4-677763cf9551\") " pod="openshift-multus/multus-additional-cni-plugins-6pkgd"
Sep 07 22:56:50.789910 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789721    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdmw4\" (UniqueName: \"kubernetes.io/projected/5604f0be-842e-40a5-b8a4-677763cf9551-kube-api-access-wdmw4\") pod \"multus-additional-cni-plugins-6pkgd\" (UID: \"5604f0be-842e-40a5-b8a4-677763cf9551\") " pod="openshift-multus/multus-additional-cni-plugins-6pkgd"
Sep 07 22:56:50.789910 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789744    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-etc-sysctl-conf\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.789910 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789766    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-host-var-lib-kubelet\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.789910 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789792    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5604f0be-842e-40a5-b8a4-677763cf9551-system-cni-dir\") pod \"multus-additional-cni-plugins-6pkgd\" (UID: \"5604f0be-842e-40a5-b8a4-677763cf9551\") " pod="openshift-multus/multus-additional-cni-plugins-6pkgd"
Sep 07 22:56:50.789910 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789813    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-etc-systemd\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.789910 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789834    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-host-run-netns\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.789910 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789855    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-host-var-lib-cni-multus\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.789910 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789895    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5604f0be-842e-40a5-b8a4-677763cf9551-cnibin\") pod \"multus-additional-cni-plugins-6pkgd\" (UID: \"5604f0be-842e-40a5-b8a4-677763cf9551\") " pod="openshift-multus/multus-additional-cni-plugins-6pkgd"
Sep 07 22:56:50.790451 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789933    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-etc-kubernetes\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.790451 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789957    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-host\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.790451 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.789978    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-multus-conf-dir\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.790451 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.790002    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0af21eb1-139e-444e-809f-39e12274e7e6-multus-daemon-config\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.790451 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.790023    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-host-run-multus-certs\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.790451 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.790044    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15cf1f7c-7686-47db-83a3-431fa37e2050-tmp-dir\") pod \"node-resolver-9fnns\" (UID: \"15cf1f7c-7686-47db-83a3-431fa37e2050\") " pod="openshift-dns/node-resolver-9fnns"
Sep 07 22:56:50.790451 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.790094    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9srm\" (UniqueName: \"kubernetes.io/projected/e11df460-0a45-48e5-a54f-a4e08ec31b19-kube-api-access-g9srm\") pod \"network-check-target-mtmmp\" (UID: \"e11df460-0a45-48e5-a54f-a4e08ec31b19\") " pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:56:50.790451 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.790128    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-var-lib-kubelet\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.790451 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.790150    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bfcafa5-70d4-4c55-94c4-5548256d27d8-tmp\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.790451 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.790173    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4tmp\" (UniqueName: \"kubernetes.io/projected/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-kube-api-access-s4tmp\") pod \"network-metrics-daemon-9wwxc\" (UID: \"a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff\") " pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:56:50.790451 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.790194    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-cnibin\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.790451 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.790217    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0af21eb1-139e-444e-809f-39e12274e7e6-cni-binary-copy\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.790451 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.790239    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qgww\" (UniqueName: \"kubernetes.io/projected/0af21eb1-139e-444e-809f-39e12274e7e6-kube-api-access-2qgww\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.790451 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.790263    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5604f0be-842e-40a5-b8a4-677763cf9551-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6pkgd\" (UID: \"5604f0be-842e-40a5-b8a4-677763cf9551\") " pod="openshift-multus/multus-additional-cni-plugins-6pkgd"
Sep 07 22:56:50.790451 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.790285    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be6f18f7-5628-458a-93fe-962199c8f623-host\") pod \"node-ca-6c8dw\" (UID: \"be6f18f7-5628-458a-93fe-962199c8f623\") " pod="openshift-image-registry/node-ca-6c8dw"
Sep 07 22:56:50.790451 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.790307    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be6f18f7-5628-458a-93fe-962199c8f623-serviceca\") pod \"node-ca-6c8dw\" (UID: \"be6f18f7-5628-458a-93fe-962199c8f623\") " pod="openshift-image-registry/node-ca-6c8dw"
Sep 07 22:56:50.790451 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.790331    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-etc-modprobe-d\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.791235 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.790356    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-run\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.791235 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.790377    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-sys\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.791235 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.790400    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9bfcafa5-70d4-4c55-94c4-5548256d27d8-etc-tuned\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.791235 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.790556    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-multus-cni-dir\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.792131 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.791964    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 07 22:56:50.792333 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.792316    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 07 22:56:50.792405 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.792353    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vzl7n\""
Sep 07 22:56:50.792539 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.792525    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5"
Sep 07 22:56:50.793819 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.793796    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 22:56:50.794876 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.794360    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.795604 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.795544    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 07 22:56:50.796109 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.796088    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-87s9d\""
Sep 07 22:56:50.796333 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.796315    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 07 22:56:50.796412 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.796347    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 07 22:56:50.798245 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.798226    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 07 22:56:50.798245 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.798241    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 07 22:56:50.798435 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.798408    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 07 22:56:50.798513 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.798469    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 07 22:56:50.798582 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.798549    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rrwxn\""
Sep 07 22:56:50.798671 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.798658    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 07 22:56:50.798772 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.798752    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 07 22:56:50.876126 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.876062    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-218.ec2.internal" event={"ID":"a2bbcb9fb12c236ec947180a3f51ffeb","Type":"ContainerStarted","Data":"4a6dcafe711d6a8d8c75f96da2405905b7158ebafdee3b01c984f482fb9de9b6"}
Sep 07 22:56:50.881352 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.880869    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-218.ec2.internal" event={"ID":"5f1cd443c132fc94efb930ee12180b30","Type":"ContainerStarted","Data":"0ad88eba5cf824afdabee1952a668c3ec24869b9e3db811803cf4bb2333d01f7"}
Sep 07 22:56:50.881352 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.880956    2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 07 22:56:50.890725 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.890694    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2d26fc16-73a5-4574-9525-4ff6eabc0c32-kubelet-config\") pod \"global-pull-secret-syncer-cds22\" (UID: \"2d26fc16-73a5-4574-9525-4ff6eabc0c32\") " pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:56:50.890844 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.890729    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-etc-kubernetes\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.890844 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.890764    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-multus-conf-dir\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.890844 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.890788    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-host-run-multus-certs\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.890844 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.890809    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-run-ovn\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.890844 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.890834    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-etc-kubernetes\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.891138 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.890834    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bfcafa5-70d4-4c55-94c4-5548256d27d8-tmp\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.891138 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.890858    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-multus-conf-dir\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.891138 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.890879    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4tmp\" (UniqueName: \"kubernetes.io/projected/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-kube-api-access-s4tmp\") pod \"network-metrics-daemon-9wwxc\" (UID: \"a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff\") " pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:56:50.891138 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.890906    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-cnibin\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.891138 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.890951    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qgww\" (UniqueName: \"kubernetes.io/projected/0af21eb1-139e-444e-809f-39e12274e7e6-kube-api-access-2qgww\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.891138 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.890976    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-host-run-netns\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.891138 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891000    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98ee66cc-6517-4fa8-81cd-8b045c045c79-agent-certs\") pod \"konnectivity-agent-jg69x\" (UID: \"98ee66cc-6517-4fa8-81cd-8b045c045c79\") " pod="kube-system/konnectivity-agent-jg69x"
Sep 07 22:56:50.891138 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891029    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-sys\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.891138 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891059    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-multus-cni-dir\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.891138 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891093    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a53e68e-e682-48bc-a1ab-40f94eda6ff9-socket-dir\") pod \"aws-ebs-csi-driver-node-p7zj5\" (UID: \"5a53e68e-e682-48bc-a1ab-40f94eda6ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5"
Sep 07 22:56:50.891138 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891117    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a53e68e-e682-48bc-a1ab-40f94eda6ff9-device-dir\") pod \"aws-ebs-csi-driver-node-p7zj5\" (UID: \"5a53e68e-e682-48bc-a1ab-40f94eda6ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5"
Sep 07 22:56:50.891711 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891144    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-log-socket\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.891711 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.890905    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-host-run-multus-certs\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.891711 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891182    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjkws\" (UniqueName: \"kubernetes.io/projected/be6f18f7-5628-458a-93fe-962199c8f623-kube-api-access-fjkws\") pod \"node-ca-6c8dw\" (UID: \"be6f18f7-5628-458a-93fe-962199c8f623\") " pod="openshift-image-registry/node-ca-6c8dw"
Sep 07 22:56:50.891711 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891244    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-sys\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.891711 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891244    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-cnibin\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.891711 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891363    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-multus-cni-dir\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.891711 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891376    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 07 22:56:50.891711 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891429    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-etc-sysctl-d\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.891711 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891465    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xshzq\" (UniqueName: \"kubernetes.io/projected/5a53e68e-e682-48bc-a1ab-40f94eda6ff9-kube-api-access-xshzq\") pod \"aws-ebs-csi-driver-node-p7zj5\" (UID: \"5a53e68e-e682-48bc-a1ab-40f94eda6ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5"
Sep 07 22:56:50.891711 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891489    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-host-slash\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.891711 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891529    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-etc-sysctl-d\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.891711 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891532    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-host-var-lib-cni-bin\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.891711 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891563    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-run-openvswitch\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.891711 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891585    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac46b891-0723-42df-a019-f593e45ce30e-ovnkube-config\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.891711 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891608    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aeebe660-56d9-40ff-86c8-459b70eb7d91-iptables-alerter-script\") pod \"iptables-alerter-wd4ll\" (UID: \"aeebe660-56d9-40ff-86c8-459b70eb7d91\") " pod="openshift-network-operator/iptables-alerter-wd4ll"
Sep 07 22:56:50.891711 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891621    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-host-var-lib-cni-bin\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.891711 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891632    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2d26fc16-73a5-4574-9525-4ff6eabc0c32-dbus\") pod \"global-pull-secret-syncer-cds22\" (UID: \"2d26fc16-73a5-4574-9525-4ff6eabc0c32\") " pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:56:50.891711 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891655    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29bvf\" (UniqueName: \"kubernetes.io/projected/9bfcafa5-70d4-4c55-94c4-5548256d27d8-kube-api-access-29bvf\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.892571 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891674    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-multus-socket-dir-parent\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.892571 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891816    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-multus-socket-dir-parent\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.892571 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891812    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-host-run-k8s-cni-cncf-io\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.892571 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891850    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-host-run-k8s-cni-cncf-io\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.892571 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891850    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-run-systemd\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.892571 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891891    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-etc-sysctl-conf\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.892571 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891912    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-host-var-lib-kubelet\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.892571 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891950    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-host-cni-netd\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.892571 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891972    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5604f0be-842e-40a5-b8a4-677763cf9551-system-cni-dir\") pod \"multus-additional-cni-plugins-6pkgd\" (UID: \"5604f0be-842e-40a5-b8a4-677763cf9551\") " pod="openshift-multus/multus-additional-cni-plugins-6pkgd"
Sep 07 22:56:50.892571 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891992    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-host-var-lib-kubelet\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.892571 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.891993    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-etc-systemd\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.892571 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892044    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5604f0be-842e-40a5-b8a4-677763cf9551-system-cni-dir\") pod \"multus-additional-cni-plugins-6pkgd\" (UID: \"5604f0be-842e-40a5-b8a4-677763cf9551\") " pod="openshift-multus/multus-additional-cni-plugins-6pkgd"
Sep 07 22:56:50.892571 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892067    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-etc-systemd\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.892571 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892011    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-etc-sysctl-conf\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.892571 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892240    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-host-var-lib-cni-multus\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.892571 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892281    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-host-cni-bin\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.892571 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892304    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5604f0be-842e-40a5-b8a4-677763cf9551-cnibin\") pod \"multus-additional-cni-plugins-6pkgd\" (UID: \"5604f0be-842e-40a5-b8a4-677763cf9551\") " pod="openshift-multus/multus-additional-cni-plugins-6pkgd"
Sep 07 22:56:50.893431 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892336    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-host\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.893431 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892348    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-host-var-lib-cni-multus\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.893431 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892368    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0af21eb1-139e-444e-809f-39e12274e7e6-multus-daemon-config\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.893431 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892377    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5604f0be-842e-40a5-b8a4-677763cf9551-cnibin\") pod \"multus-additional-cni-plugins-6pkgd\" (UID: \"5604f0be-842e-40a5-b8a4-677763cf9551\") " pod="openshift-multus/multus-additional-cni-plugins-6pkgd"
Sep 07 22:56:50.893431 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892409    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15cf1f7c-7686-47db-83a3-431fa37e2050-tmp-dir\") pod \"node-resolver-9fnns\" (UID: \"15cf1f7c-7686-47db-83a3-431fa37e2050\") " pod="openshift-dns/node-resolver-9fnns"
Sep 07 22:56:50.893431 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892418    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-host\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.893431 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892490    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-systemd-units\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.893431 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892509    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-etc-openvswitch\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.893431 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892524    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4ql9\" (UniqueName: \"kubernetes.io/projected/ac46b891-0723-42df-a019-f593e45ce30e-kube-api-access-s4ql9\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.893431 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892541    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9srm\" (UniqueName: \"kubernetes.io/projected/e11df460-0a45-48e5-a54f-a4e08ec31b19-kube-api-access-g9srm\") pod \"network-check-target-mtmmp\" (UID: \"e11df460-0a45-48e5-a54f-a4e08ec31b19\") " pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:56:50.893431 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892562    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-var-lib-kubelet\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.893431 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892577    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0af21eb1-139e-444e-809f-39e12274e7e6-cni-binary-copy\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.893431 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892593    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5604f0be-842e-40a5-b8a4-677763cf9551-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6pkgd\" (UID: \"5604f0be-842e-40a5-b8a4-677763cf9551\") " pod="openshift-multus/multus-additional-cni-plugins-6pkgd"
Sep 07 22:56:50.893431 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892607    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be6f18f7-5628-458a-93fe-962199c8f623-host\") pod \"node-ca-6c8dw\" (UID: \"be6f18f7-5628-458a-93fe-962199c8f623\") " pod="openshift-image-registry/node-ca-6c8dw"
Sep 07 22:56:50.893431 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892621    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be6f18f7-5628-458a-93fe-962199c8f623-serviceca\") pod \"node-ca-6c8dw\" (UID: \"be6f18f7-5628-458a-93fe-962199c8f623\") " pod="openshift-image-registry/node-ca-6c8dw"
Sep 07 22:56:50.893431 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892640    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-etc-modprobe-d\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.893431 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892655    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-run\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.894338 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892668    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9bfcafa5-70d4-4c55-94c4-5548256d27d8-etc-tuned\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.894338 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892675    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15cf1f7c-7686-47db-83a3-431fa37e2050-tmp-dir\") pod \"node-resolver-9fnns\" (UID: \"15cf1f7c-7686-47db-83a3-431fa37e2050\") " pod="openshift-dns/node-resolver-9fnns"
Sep 07 22:56:50.894338 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892682    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.894338 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892698    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5604f0be-842e-40a5-b8a4-677763cf9551-cni-binary-copy\") pod \"multus-additional-cni-plugins-6pkgd\" (UID: \"5604f0be-842e-40a5-b8a4-677763cf9551\") " pod="openshift-multus/multus-additional-cni-plugins-6pkgd"
Sep 07 22:56:50.894338 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892719    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs\") pod \"network-metrics-daemon-9wwxc\" (UID: \"a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff\") " pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:56:50.894338 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892733    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-etc-kubernetes\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.894338 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892747    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt94l\" (UniqueName: \"kubernetes.io/projected/15cf1f7c-7686-47db-83a3-431fa37e2050-kube-api-access-nt94l\") pod \"node-resolver-9fnns\" (UID: \"15cf1f7c-7686-47db-83a3-431fa37e2050\") " pod="openshift-dns/node-resolver-9fnns"
Sep 07 22:56:50.894338 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892769    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a53e68e-e682-48bc-a1ab-40f94eda6ff9-sys-fs\") pod \"aws-ebs-csi-driver-node-p7zj5\" (UID: \"5a53e68e-e682-48bc-a1ab-40f94eda6ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5"
Sep 07 22:56:50.894338 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892800    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-node-log\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.894338 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892876    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-run\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.894338 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892899    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0af21eb1-139e-444e-809f-39e12274e7e6-multus-daemon-config\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.894338 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892953    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac46b891-0723-42df-a019-f593e45ce30e-env-overrides\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.894338 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892969    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac46b891-0723-42df-a019-f593e45ce30e-ovnkube-script-lib\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.894338 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.892987    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-lib-modules\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.894338 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893004    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-system-cni-dir\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.894338 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893042    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-hostroot\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.894338 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893064    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/15cf1f7c-7686-47db-83a3-431fa37e2050-hosts-file\") pod \"node-resolver-9fnns\" (UID: \"15cf1f7c-7686-47db-83a3-431fa37e2050\") " pod="openshift-dns/node-resolver-9fnns"
Sep 07 22:56:50.895226 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893071    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be6f18f7-5628-458a-93fe-962199c8f623-serviceca\") pod \"node-ca-6c8dw\" (UID: \"be6f18f7-5628-458a-93fe-962199c8f623\") " pod="openshift-image-registry/node-ca-6c8dw"
Sep 07 22:56:50.895226 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893124    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-etc-modprobe-d\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.895226 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893150    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-system-cni-dir\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.895226 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893159    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-etc-kubernetes\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.895226 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893222    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be6f18f7-5628-458a-93fe-962199c8f623-host\") pod \"node-ca-6c8dw\" (UID: \"be6f18f7-5628-458a-93fe-962199c8f623\") " pod="openshift-image-registry/node-ca-6c8dw"
Sep 07 22:56:50.895226 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893352    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5604f0be-842e-40a5-b8a4-677763cf9551-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6pkgd\" (UID: \"5604f0be-842e-40a5-b8a4-677763cf9551\") " pod="openshift-multus/multus-additional-cni-plugins-6pkgd"
Sep 07 22:56:50.895226 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:50.893382    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 22:56:50.895226 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893430    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-var-lib-kubelet\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.895226 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893428    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5604f0be-842e-40a5-b8a4-677763cf9551-cni-binary-copy\") pod \"multus-additional-cni-plugins-6pkgd\" (UID: \"5604f0be-842e-40a5-b8a4-677763cf9551\") " pod="openshift-multus/multus-additional-cni-plugins-6pkgd"
Sep 07 22:56:50.895226 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893465    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0af21eb1-139e-444e-809f-39e12274e7e6-cni-binary-copy\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.895226 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893475    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/15cf1f7c-7686-47db-83a3-431fa37e2050-hosts-file\") pod \"node-resolver-9fnns\" (UID: \"15cf1f7c-7686-47db-83a3-431fa37e2050\") " pod="openshift-dns/node-resolver-9fnns"
Sep 07 22:56:50.895226 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893519    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a53e68e-e682-48bc-a1ab-40f94eda6ff9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p7zj5\" (UID: \"5a53e68e-e682-48bc-a1ab-40f94eda6ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5"
Sep 07 22:56:50.895226 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893553    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-hostroot\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.895226 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893554    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-lib-modules\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.895226 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893596    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a53e68e-e682-48bc-a1ab-40f94eda6ff9-registration-dir\") pod \"aws-ebs-csi-driver-node-p7zj5\" (UID: \"5a53e68e-e682-48bc-a1ab-40f94eda6ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5"
Sep 07 22:56:50.895226 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:50.893623    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs podName:a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff nodeName:}" failed. No retries permitted until 2026-09-07 22:56:51.393602618 +0000 UTC m=+3.022084934 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs") pod "network-metrics-daemon-9wwxc" (UID: "a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 22:56:50.895226 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893669    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a53e68e-e682-48bc-a1ab-40f94eda6ff9-etc-selinux\") pod \"aws-ebs-csi-driver-node-p7zj5\" (UID: \"5a53e68e-e682-48bc-a1ab-40f94eda6ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5"
Sep 07 22:56:50.896158 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893693    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac46b891-0723-42df-a019-f593e45ce30e-ovn-node-metrics-cert\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.896158 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893719    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5604f0be-842e-40a5-b8a4-677763cf9551-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6pkgd\" (UID: \"5604f0be-842e-40a5-b8a4-677763cf9551\") " pod="openshift-multus/multus-additional-cni-plugins-6pkgd"
Sep 07 22:56:50.896158 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893742    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-etc-sysconfig\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.896158 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893763    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aeebe660-56d9-40ff-86c8-459b70eb7d91-host-slash\") pod \"iptables-alerter-wd4ll\" (UID: \"aeebe660-56d9-40ff-86c8-459b70eb7d91\") " pod="openshift-network-operator/iptables-alerter-wd4ll"
Sep 07 22:56:50.896158 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893823    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9bfcafa5-70d4-4c55-94c4-5548256d27d8-etc-sysconfig\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.896158 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893848    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d26fc16-73a5-4574-9525-4ff6eabc0c32-original-pull-secret\") pod \"global-pull-secret-syncer-cds22\" (UID: \"2d26fc16-73a5-4574-9525-4ff6eabc0c32\") " pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:56:50.896158 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893873    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5604f0be-842e-40a5-b8a4-677763cf9551-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6pkgd\" (UID: \"5604f0be-842e-40a5-b8a4-677763cf9551\") " pod="openshift-multus/multus-additional-cni-plugins-6pkgd"
Sep 07 22:56:50.896158 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893900    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdmw4\" (UniqueName: \"kubernetes.io/projected/5604f0be-842e-40a5-b8a4-677763cf9551-kube-api-access-wdmw4\") pod \"multus-additional-cni-plugins-6pkgd\" (UID: \"5604f0be-842e-40a5-b8a4-677763cf9551\") " pod="openshift-multus/multus-additional-cni-plugins-6pkgd"
Sep 07 22:56:50.896158 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.893948    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-host-run-ovn-kubernetes\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.896158 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.894045    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjbdn\" (UniqueName: \"kubernetes.io/projected/aeebe660-56d9-40ff-86c8-459b70eb7d91-kube-api-access-vjbdn\") pod \"iptables-alerter-wd4ll\" (UID: \"aeebe660-56d9-40ff-86c8-459b70eb7d91\") " pod="openshift-network-operator/iptables-alerter-wd4ll"
Sep 07 22:56:50.896158 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.894070    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98ee66cc-6517-4fa8-81cd-8b045c045c79-konnectivity-ca\") pod \"konnectivity-agent-jg69x\" (UID: \"98ee66cc-6517-4fa8-81cd-8b045c045c79\") " pod="kube-system/konnectivity-agent-jg69x"
Sep 07 22:56:50.896158 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.894095    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-host-run-netns\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.896158 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.894116    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-host-kubelet\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.896158 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.894138    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-var-lib-openvswitch\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.896158 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.894221    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0af21eb1-139e-444e-809f-39e12274e7e6-host-run-netns\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.896158 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.894232    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5604f0be-842e-40a5-b8a4-677763cf9551-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6pkgd\" (UID: \"5604f0be-842e-40a5-b8a4-677763cf9551\") " pod="openshift-multus/multus-additional-cni-plugins-6pkgd"
Sep 07 22:56:50.896967 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.894383    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5604f0be-842e-40a5-b8a4-677763cf9551-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6pkgd\" (UID: \"5604f0be-842e-40a5-b8a4-677763cf9551\") " pod="openshift-multus/multus-additional-cni-plugins-6pkgd"
Sep 07 22:56:50.896967 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.895672    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bfcafa5-70d4-4c55-94c4-5548256d27d8-tmp\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.896967 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.895783    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9bfcafa5-70d4-4c55-94c4-5548256d27d8-etc-tuned\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.896967 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.896468    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mtfz9"
Sep 07 22:56:50.901559 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.901271    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt94l\" (UniqueName: \"kubernetes.io/projected/15cf1f7c-7686-47db-83a3-431fa37e2050-kube-api-access-nt94l\") pod \"node-resolver-9fnns\" (UID: \"15cf1f7c-7686-47db-83a3-431fa37e2050\") " pod="openshift-dns/node-resolver-9fnns"
Sep 07 22:56:50.902713 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:50.902155    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 22:56:50.902713 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:50.902180    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 22:56:50.902713 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:50.902194    2557 projected.go:196] Error preparing data for projected volume kube-api-access-g9srm for pod openshift-network-diagnostics/network-check-target-mtmmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 22:56:50.902713 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:50.902254    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e11df460-0a45-48e5-a54f-a4e08ec31b19-kube-api-access-g9srm podName:e11df460-0a45-48e5-a54f-a4e08ec31b19 nodeName:}" failed. No retries permitted until 2026-09-07 22:56:51.402239042 +0000 UTC m=+3.030721357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-g9srm" (UniqueName: "kubernetes.io/projected/e11df460-0a45-48e5-a54f-a4e08ec31b19-kube-api-access-g9srm") pod "network-check-target-mtmmp" (UID: "e11df460-0a45-48e5-a54f-a4e08ec31b19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 22:56:50.902713 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.902616    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdmw4\" (UniqueName: \"kubernetes.io/projected/5604f0be-842e-40a5-b8a4-677763cf9551-kube-api-access-wdmw4\") pod \"multus-additional-cni-plugins-6pkgd\" (UID: \"5604f0be-842e-40a5-b8a4-677763cf9551\") " pod="openshift-multus/multus-additional-cni-plugins-6pkgd"
Sep 07 22:56:50.903091 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.903051    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qgww\" (UniqueName: \"kubernetes.io/projected/0af21eb1-139e-444e-809f-39e12274e7e6-kube-api-access-2qgww\") pod \"multus-drkf4\" (UID: \"0af21eb1-139e-444e-809f-39e12274e7e6\") " pod="openshift-multus/multus-drkf4"
Sep 07 22:56:50.904512 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.904488    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mtfz9"
Sep 07 22:56:50.904979 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.904955    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjkws\" (UniqueName: \"kubernetes.io/projected/be6f18f7-5628-458a-93fe-962199c8f623-kube-api-access-fjkws\") pod \"node-ca-6c8dw\" (UID: \"be6f18f7-5628-458a-93fe-962199c8f623\") " pod="openshift-image-registry/node-ca-6c8dw"
Sep 07 22:56:50.905642 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.905623    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4tmp\" (UniqueName: \"kubernetes.io/projected/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-kube-api-access-s4tmp\") pod \"network-metrics-daemon-9wwxc\" (UID: \"a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff\") " pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:56:50.906079 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.906060    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29bvf\" (UniqueName: \"kubernetes.io/projected/9bfcafa5-70d4-4c55-94c4-5548256d27d8-kube-api-access-29bvf\") pod \"tuned-f2m5f\" (UID: \"9bfcafa5-70d4-4c55-94c4-5548256d27d8\") " pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:50.994858 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.994825    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac46b891-0723-42df-a019-f593e45ce30e-ovnkube-config\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.994858 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.994863    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aeebe660-56d9-40ff-86c8-459b70eb7d91-iptables-alerter-script\") pod \"iptables-alerter-wd4ll\" (UID: \"aeebe660-56d9-40ff-86c8-459b70eb7d91\") " pod="openshift-network-operator/iptables-alerter-wd4ll"
Sep 07 22:56:50.995113 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.994886    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2d26fc16-73a5-4574-9525-4ff6eabc0c32-dbus\") pod \"global-pull-secret-syncer-cds22\" (UID: \"2d26fc16-73a5-4574-9525-4ff6eabc0c32\") " pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:56:50.995113 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.994929    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-run-systemd\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.995113 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.994958    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-host-cni-netd\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.995113 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.994982    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-host-cni-bin\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.995113 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995032    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-systemd-units\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.995113 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995066    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-run-systemd\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.995113 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995071    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-etc-openvswitch\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.995113 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995101    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4ql9\" (UniqueName: \"kubernetes.io/projected/ac46b891-0723-42df-a019-f593e45ce30e-kube-api-access-s4ql9\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.995659 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995133    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-host-cni-netd\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.995659 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995041    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-host-cni-bin\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.995659 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995148    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.995659 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995189    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a53e68e-e682-48bc-a1ab-40f94eda6ff9-sys-fs\") pod \"aws-ebs-csi-driver-node-p7zj5\" (UID: \"5a53e68e-e682-48bc-a1ab-40f94eda6ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5"
Sep 07 22:56:50.995659 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995213    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-node-log\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.995659 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995235    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac46b891-0723-42df-a019-f593e45ce30e-env-overrides\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.995659 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995259    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac46b891-0723-42df-a019-f593e45ce30e-ovnkube-script-lib\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.995659 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995274    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2d26fc16-73a5-4574-9525-4ff6eabc0c32-dbus\") pod \"global-pull-secret-syncer-cds22\" (UID: \"2d26fc16-73a5-4574-9525-4ff6eabc0c32\") " pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:56:50.995659 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995286    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a53e68e-e682-48bc-a1ab-40f94eda6ff9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p7zj5\" (UID: \"5a53e68e-e682-48bc-a1ab-40f94eda6ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5"
Sep 07 22:56:50.995659 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995312    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a53e68e-e682-48bc-a1ab-40f94eda6ff9-registration-dir\") pod \"aws-ebs-csi-driver-node-p7zj5\" (UID: \"5a53e68e-e682-48bc-a1ab-40f94eda6ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5"
Sep 07 22:56:50.995659 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995313    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-systemd-units\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.995659 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995335    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a53e68e-e682-48bc-a1ab-40f94eda6ff9-etc-selinux\") pod \"aws-ebs-csi-driver-node-p7zj5\" (UID: \"5a53e68e-e682-48bc-a1ab-40f94eda6ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5"
Sep 07 22:56:50.995659 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995357    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac46b891-0723-42df-a019-f593e45ce30e-ovn-node-metrics-cert\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.995659 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995358    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-node-log\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.995659 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995385    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac46b891-0723-42df-a019-f593e45ce30e-ovnkube-config\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.995659 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995426    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-etc-openvswitch\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.995659 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995434    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aeebe660-56d9-40ff-86c8-459b70eb7d91-host-slash\") pod \"iptables-alerter-wd4ll\" (UID: \"aeebe660-56d9-40ff-86c8-459b70eb7d91\") " pod="openshift-network-operator/iptables-alerter-wd4ll"
Sep 07 22:56:50.996521 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995489    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aeebe660-56d9-40ff-86c8-459b70eb7d91-iptables-alerter-script\") pod \"iptables-alerter-wd4ll\" (UID: \"aeebe660-56d9-40ff-86c8-459b70eb7d91\") " pod="openshift-network-operator/iptables-alerter-wd4ll"
Sep 07 22:56:50.996521 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995386    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aeebe660-56d9-40ff-86c8-459b70eb7d91-host-slash\") pod \"iptables-alerter-wd4ll\" (UID: \"aeebe660-56d9-40ff-86c8-459b70eb7d91\") " pod="openshift-network-operator/iptables-alerter-wd4ll"
Sep 07 22:56:50.996521 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995532    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.996521 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995553    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a53e68e-e682-48bc-a1ab-40f94eda6ff9-registration-dir\") pod \"aws-ebs-csi-driver-node-p7zj5\" (UID: \"5a53e68e-e682-48bc-a1ab-40f94eda6ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5"
Sep 07 22:56:50.996521 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995555    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d26fc16-73a5-4574-9525-4ff6eabc0c32-original-pull-secret\") pod \"global-pull-secret-syncer-cds22\" (UID: \"2d26fc16-73a5-4574-9525-4ff6eabc0c32\") " pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:56:50.996521 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995579    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a53e68e-e682-48bc-a1ab-40f94eda6ff9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p7zj5\" (UID: \"5a53e68e-e682-48bc-a1ab-40f94eda6ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5"
Sep 07 22:56:50.996521 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995591    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-host-run-ovn-kubernetes\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.996521 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:50.995618    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 22:56:50.996521 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995624    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-host-run-ovn-kubernetes\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.996521 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995627    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjbdn\" (UniqueName: \"kubernetes.io/projected/aeebe660-56d9-40ff-86c8-459b70eb7d91-kube-api-access-vjbdn\") pod \"iptables-alerter-wd4ll\" (UID: \"aeebe660-56d9-40ff-86c8-459b70eb7d91\") " pod="openshift-network-operator/iptables-alerter-wd4ll"
Sep 07 22:56:50.996521 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995633    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a53e68e-e682-48bc-a1ab-40f94eda6ff9-etc-selinux\") pod \"aws-ebs-csi-driver-node-p7zj5\" (UID: \"5a53e68e-e682-48bc-a1ab-40f94eda6ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5"
Sep 07 22:56:50.996521 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995666    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98ee66cc-6517-4fa8-81cd-8b045c045c79-konnectivity-ca\") pod \"konnectivity-agent-jg69x\" (UID: \"98ee66cc-6517-4fa8-81cd-8b045c045c79\") " pod="kube-system/konnectivity-agent-jg69x"
Sep 07 22:56:50.996521 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995677    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a53e68e-e682-48bc-a1ab-40f94eda6ff9-sys-fs\") pod \"aws-ebs-csi-driver-node-p7zj5\" (UID: \"5a53e68e-e682-48bc-a1ab-40f94eda6ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5"
Sep 07 22:56:50.996521 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:50.995687    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d26fc16-73a5-4574-9525-4ff6eabc0c32-original-pull-secret podName:2d26fc16-73a5-4574-9525-4ff6eabc0c32 nodeName:}" failed. No retries permitted until 2026-09-07 22:56:51.495670217 +0000 UTC m=+3.124152545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d26fc16-73a5-4574-9525-4ff6eabc0c32-original-pull-secret") pod "global-pull-secret-syncer-cds22" (UID: "2d26fc16-73a5-4574-9525-4ff6eabc0c32") : object "kube-system"/"original-pull-secret" not registered
Sep 07 22:56:50.996521 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995720    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-host-kubelet\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.996521 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995747    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-var-lib-openvswitch\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.997403 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995771    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2d26fc16-73a5-4574-9525-4ff6eabc0c32-kubelet-config\") pod \"global-pull-secret-syncer-cds22\" (UID: \"2d26fc16-73a5-4574-9525-4ff6eabc0c32\") " pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:56:50.997403 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995800    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-run-ovn\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.997403 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995812    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-host-kubelet\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.997403 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995828    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-host-run-netns\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.997403 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995847    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-var-lib-openvswitch\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.997403 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995859    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-run-ovn\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.997403 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995851    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98ee66cc-6517-4fa8-81cd-8b045c045c79-agent-certs\") pod \"konnectivity-agent-jg69x\" (UID: \"98ee66cc-6517-4fa8-81cd-8b045c045c79\") " pod="kube-system/konnectivity-agent-jg69x"
Sep 07 22:56:50.997403 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995886    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2d26fc16-73a5-4574-9525-4ff6eabc0c32-kubelet-config\") pod \"global-pull-secret-syncer-cds22\" (UID: \"2d26fc16-73a5-4574-9525-4ff6eabc0c32\") " pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:56:50.997403 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995899    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac46b891-0723-42df-a019-f593e45ce30e-ovnkube-script-lib\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.997403 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995906    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a53e68e-e682-48bc-a1ab-40f94eda6ff9-socket-dir\") pod \"aws-ebs-csi-driver-node-p7zj5\" (UID: \"5a53e68e-e682-48bc-a1ab-40f94eda6ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5"
Sep 07 22:56:50.997403 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995949    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a53e68e-e682-48bc-a1ab-40f94eda6ff9-device-dir\") pod \"aws-ebs-csi-driver-node-p7zj5\" (UID: \"5a53e68e-e682-48bc-a1ab-40f94eda6ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5"
Sep 07 22:56:50.997403 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995970    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-log-socket\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.997403 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.996014    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-log-socket\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.997403 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.996018    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a53e68e-e682-48bc-a1ab-40f94eda6ff9-socket-dir\") pod \"aws-ebs-csi-driver-node-p7zj5\" (UID: \"5a53e68e-e682-48bc-a1ab-40f94eda6ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5"
Sep 07 22:56:50.997403 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.996023    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xshzq\" (UniqueName: \"kubernetes.io/projected/5a53e68e-e682-48bc-a1ab-40f94eda6ff9-kube-api-access-xshzq\") pod \"aws-ebs-csi-driver-node-p7zj5\" (UID: \"5a53e68e-e682-48bc-a1ab-40f94eda6ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5"
Sep 07 22:56:50.997403 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.996060    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a53e68e-e682-48bc-a1ab-40f94eda6ff9-device-dir\") pod \"aws-ebs-csi-driver-node-p7zj5\" (UID: \"5a53e68e-e682-48bc-a1ab-40f94eda6ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5"
Sep 07 22:56:50.997403 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.996060    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-host-slash\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.998228 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.996087    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-host-slash\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.998228 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.996098    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-run-openvswitch\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.998228 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.996150    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-run-openvswitch\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.998228 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.995901    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac46b891-0723-42df-a019-f593e45ce30e-host-run-netns\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.998228 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.996253    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac46b891-0723-42df-a019-f593e45ce30e-env-overrides\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.998228 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.996306    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98ee66cc-6517-4fa8-81cd-8b045c045c79-konnectivity-ca\") pod \"konnectivity-agent-jg69x\" (UID: \"98ee66cc-6517-4fa8-81cd-8b045c045c79\") " pod="kube-system/konnectivity-agent-jg69x"
Sep 07 22:56:50.998228 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.998181    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac46b891-0723-42df-a019-f593e45ce30e-ovn-node-metrics-cert\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:50.998559 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:50.998414    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98ee66cc-6517-4fa8-81cd-8b045c045c79-agent-certs\") pod \"konnectivity-agent-jg69x\" (UID: \"98ee66cc-6517-4fa8-81cd-8b045c045c79\") " pod="kube-system/konnectivity-agent-jg69x"
Sep 07 22:56:51.006454 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:51.006406    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjbdn\" (UniqueName: \"kubernetes.io/projected/aeebe660-56d9-40ff-86c8-459b70eb7d91-kube-api-access-vjbdn\") pod \"iptables-alerter-wd4ll\" (UID: \"aeebe660-56d9-40ff-86c8-459b70eb7d91\") " pod="openshift-network-operator/iptables-alerter-wd4ll"
Sep 07 22:56:51.006623 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:51.006597    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xshzq\" (UniqueName: \"kubernetes.io/projected/5a53e68e-e682-48bc-a1ab-40f94eda6ff9-kube-api-access-xshzq\") pod \"aws-ebs-csi-driver-node-p7zj5\" (UID: \"5a53e68e-e682-48bc-a1ab-40f94eda6ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5"
Sep 07 22:56:51.006886 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:51.006866    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4ql9\" (UniqueName: \"kubernetes.io/projected/ac46b891-0723-42df-a019-f593e45ce30e-kube-api-access-s4ql9\") pod \"ovnkube-node-dnn7j\" (UID: \"ac46b891-0723-42df-a019-f593e45ce30e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:51.078889 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:51.078857    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6pkgd"
Sep 07 22:56:51.094582 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:51.094559    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6c8dw"
Sep 07 22:56:51.103165 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:51.103145    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-drkf4"
Sep 07 22:56:51.110646 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:51.110624    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9fnns"
Sep 07 22:56:51.118202 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:51.118185    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f2m5f"
Sep 07 22:56:51.126691 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:51.126675    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wd4ll"
Sep 07 22:56:51.135168 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:51.135147    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jg69x"
Sep 07 22:56:51.140740 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:51.140709    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5"
Sep 07 22:56:51.146295 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:51.146278    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:56:51.298380 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:51.298319    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 22:56:51.398757 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:51.398724    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs\") pod \"network-metrics-daemon-9wwxc\" (UID: \"a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff\") " pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:56:51.398912 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:51.398865    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 22:56:51.398989 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:51.398944    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs podName:a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff nodeName:}" failed. No retries permitted until 2026-09-07 22:56:52.398911992 +0000 UTC m=+4.027394323 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs") pod "network-metrics-daemon-9wwxc" (UID: "a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 22:56:51.499866 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:51.499833    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d26fc16-73a5-4574-9525-4ff6eabc0c32-original-pull-secret\") pod \"global-pull-secret-syncer-cds22\" (UID: \"2d26fc16-73a5-4574-9525-4ff6eabc0c32\") " pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:56:51.500067 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:51.499912    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9srm\" (UniqueName: \"kubernetes.io/projected/e11df460-0a45-48e5-a54f-a4e08ec31b19-kube-api-access-g9srm\") pod \"network-check-target-mtmmp\" (UID: \"e11df460-0a45-48e5-a54f-a4e08ec31b19\") " pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:56:51.500067 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:51.500014    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 22:56:51.500174 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:51.500072    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 22:56:51.500174 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:51.500086    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d26fc16-73a5-4574-9525-4ff6eabc0c32-original-pull-secret podName:2d26fc16-73a5-4574-9525-4ff6eabc0c32 nodeName:}" failed. No retries permitted until 2026-09-07 22:56:52.500066955 +0000 UTC m=+4.128549283 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d26fc16-73a5-4574-9525-4ff6eabc0c32-original-pull-secret") pod "global-pull-secret-syncer-cds22" (UID: "2d26fc16-73a5-4574-9525-4ff6eabc0c32") : object "kube-system"/"original-pull-secret" not registered
Sep 07 22:56:51.500174 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:51.500091    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 22:56:51.500174 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:51.500103    2557 projected.go:196] Error preparing data for projected volume kube-api-access-g9srm for pod openshift-network-diagnostics/network-check-target-mtmmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 22:56:51.500174 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:51.500147    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e11df460-0a45-48e5-a54f-a4e08ec31b19-kube-api-access-g9srm podName:e11df460-0a45-48e5-a54f-a4e08ec31b19 nodeName:}" failed. No retries permitted until 2026-09-07 22:56:52.500136078 +0000 UTC m=+4.128618405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-g9srm" (UniqueName: "kubernetes.io/projected/e11df460-0a45-48e5-a54f-a4e08ec31b19-kube-api-access-g9srm") pod "network-check-target-mtmmp" (UID: "e11df460-0a45-48e5-a54f-a4e08ec31b19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 22:56:51.908976 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:51.908892    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 22:51:50 +0000 UTC" deadline="2028-04-14 09:44:48.561454952 +0000 UTC"
Sep 07 22:56:51.909336 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:51.908977    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14026h47m56.652482988s"
Sep 07 22:56:51.911707 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:51.911666    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98ee66cc_6517_4fa8_81cd_8b045c045c79.slice/crio-71b1f7cfad8b3e0b2db8dbdba2d933b392d372186ba05ac3915d4e1669cb48a6 WatchSource:0}: Error finding container 71b1f7cfad8b3e0b2db8dbdba2d933b392d372186ba05ac3915d4e1669cb48a6: Status 404 returned error can't find the container with id 71b1f7cfad8b3e0b2db8dbdba2d933b392d372186ba05ac3915d4e1669cb48a6
Sep 07 22:56:51.913812 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:51.913786    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bfcafa5_70d4_4c55_94c4_5548256d27d8.slice/crio-75b174ce407ff27eac79493fb334e00bddc5d76789d79b350a9f4fe0cba2ee05 WatchSource:0}: Error finding container 75b174ce407ff27eac79493fb334e00bddc5d76789d79b350a9f4fe0cba2ee05: Status 404 returned error can't find the container with id 75b174ce407ff27eac79493fb334e00bddc5d76789d79b350a9f4fe0cba2ee05
Sep 07 22:56:51.914643 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:56:51.914603    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15cf1f7c_7686_47db_83a3_431fa37e2050.slice/crio-441c8b68b142196b0ef5726fddb84df081963c7b2b9d384a277a5c9d9e4debce WatchSource:0}: Error finding container 441c8b68b142196b0ef5726fddb84df081963c7b2b9d384a277a5c9d9e4debce: Status 404 returned error can't find the container with id 441c8b68b142196b0ef5726fddb84df081963c7b2b9d384a277a5c9d9e4debce
Sep 07 22:56:52.329533 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:52.329509    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 22:56:52.407760 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:52.407685    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs\") pod \"network-metrics-daemon-9wwxc\" (UID: \"a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff\") " pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:56:52.407904 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:52.407827    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 22:56:52.407904 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:52.407883    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs podName:a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff nodeName:}" failed. No retries permitted until 2026-09-07 22:56:54.40786478 +0000 UTC m=+6.036347107 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs") pod "network-metrics-daemon-9wwxc" (UID: "a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 22:56:52.508748 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:52.508710    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d26fc16-73a5-4574-9525-4ff6eabc0c32-original-pull-secret\") pod \"global-pull-secret-syncer-cds22\" (UID: \"2d26fc16-73a5-4574-9525-4ff6eabc0c32\") " pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:56:52.508928 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:52.508792    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9srm\" (UniqueName: \"kubernetes.io/projected/e11df460-0a45-48e5-a54f-a4e08ec31b19-kube-api-access-g9srm\") pod \"network-check-target-mtmmp\" (UID: \"e11df460-0a45-48e5-a54f-a4e08ec31b19\") " pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:56:52.509132 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:52.509112    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 22:56:52.509210 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:52.509139    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 22:56:52.509210 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:52.509178    2557 projected.go:196] Error preparing data for projected volume kube-api-access-g9srm for pod openshift-network-diagnostics/network-check-target-mtmmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 22:56:52.509307 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:52.509254    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e11df460-0a45-48e5-a54f-a4e08ec31b19-kube-api-access-g9srm podName:e11df460-0a45-48e5-a54f-a4e08ec31b19 nodeName:}" failed. No retries permitted until 2026-09-07 22:56:54.509234134 +0000 UTC m=+6.137716463 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-g9srm" (UniqueName: "kubernetes.io/projected/e11df460-0a45-48e5-a54f-a4e08ec31b19-kube-api-access-g9srm") pod "network-check-target-mtmmp" (UID: "e11df460-0a45-48e5-a54f-a4e08ec31b19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 22:56:52.509665 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:52.509643    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 22:56:52.509756 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:52.509702    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d26fc16-73a5-4574-9525-4ff6eabc0c32-original-pull-secret podName:2d26fc16-73a5-4574-9525-4ff6eabc0c32 nodeName:}" failed. No retries permitted until 2026-09-07 22:56:54.509686986 +0000 UTC m=+6.138169313 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d26fc16-73a5-4574-9525-4ff6eabc0c32-original-pull-secret") pod "global-pull-secret-syncer-cds22" (UID: "2d26fc16-73a5-4574-9525-4ff6eabc0c32") : object "kube-system"/"original-pull-secret" not registered
Sep 07 22:56:52.873487 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:52.873409    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:56:52.873629 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:52.873556    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wwxc" podUID="a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff"
Sep 07 22:56:52.873976 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:52.873948    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:56:52.874084 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:52.874047    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cds22" podUID="2d26fc16-73a5-4574-9525-4ff6eabc0c32"
Sep 07 22:56:52.874153 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:52.874112    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:56:52.874209 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:52.874177    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtmmp" podUID="e11df460-0a45-48e5-a54f-a4e08ec31b19"
Sep 07 22:56:52.900188 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:52.900158    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pkgd" event={"ID":"5604f0be-842e-40a5-b8a4-677763cf9551","Type":"ContainerStarted","Data":"5f8115b8312d8d2d03cdbc84fe0b4dd8ad59ed50d44379933a05bb64d433e31b"}
Sep 07 22:56:52.909714 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:52.909608    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9fnns" event={"ID":"15cf1f7c-7686-47db-83a3-431fa37e2050","Type":"ContainerStarted","Data":"441c8b68b142196b0ef5726fddb84df081963c7b2b9d384a277a5c9d9e4debce"}
Sep 07 22:56:52.910592 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:52.909725    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 22:51:50 +0000 UTC" deadline="2028-02-02 09:05:55.297302065 +0000 UTC"
Sep 07 22:56:52.910592 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:52.909753    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12298h9m2.38755346s"
Sep 07 22:56:52.920159 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:52.919206    2557 generic.go:356] "Generic (PLEG): container finished" podID="5f1cd443c132fc94efb930ee12180b30" containerID="da1708e11285d0c6ea976606d0fdf2fa35b0216ace1a0a2fcbf55fee79ab0701" exitCode=0
Sep 07 22:56:52.920159 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:52.919276    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-218.ec2.internal" event={"ID":"5f1cd443c132fc94efb930ee12180b30","Type":"ContainerDied","Data":"da1708e11285d0c6ea976606d0fdf2fa35b0216ace1a0a2fcbf55fee79ab0701"}
Sep 07 22:56:52.931179 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:52.931067    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-drkf4" event={"ID":"0af21eb1-139e-444e-809f-39e12274e7e6","Type":"ContainerStarted","Data":"ff47c5b3bef2d8888fb6221a176c95e7c149cb6997a2c2b28fa60b6f0402d1cc"}
Sep 07 22:56:52.937435 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:52.937413    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wd4ll" event={"ID":"aeebe660-56d9-40ff-86c8-459b70eb7d91","Type":"ContainerStarted","Data":"e0cb427d68f4a1923ccf97e35ac9b35f2b803905ac74657af416abec774d198b"}
Sep 07 22:56:52.940141 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:52.940114    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6c8dw" event={"ID":"be6f18f7-5628-458a-93fe-962199c8f623","Type":"ContainerStarted","Data":"0f8ee57e27db7fd2aa62dc345debbddd1bf32971fe064ba870f002b571693212"}
Sep 07 22:56:52.952697 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:52.952672    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5" event={"ID":"5a53e68e-e682-48bc-a1ab-40f94eda6ff9","Type":"ContainerStarted","Data":"f8b5662ae7abd3caf0811d65c82548515df00349342294e7ee5628a8c724554b"}
Sep 07 22:56:52.955811 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:52.955789    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f2m5f" event={"ID":"9bfcafa5-70d4-4c55-94c4-5548256d27d8","Type":"ContainerStarted","Data":"75b174ce407ff27eac79493fb334e00bddc5d76789d79b350a9f4fe0cba2ee05"}
Sep 07 22:56:52.959366 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:52.959341    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jg69x" event={"ID":"98ee66cc-6517-4fa8-81cd-8b045c045c79","Type":"ContainerStarted","Data":"71b1f7cfad8b3e0b2db8dbdba2d933b392d372186ba05ac3915d4e1669cb48a6"}
Sep 07 22:56:52.968153 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:52.968131    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-218.ec2.internal" event={"ID":"a2bbcb9fb12c236ec947180a3f51ffeb","Type":"ContainerStarted","Data":"a6f2c84a64f5395851f6a1d282d419e1046b9247b7542b5f89737ac4b38c510a"}
Sep 07 22:56:52.971885 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:52.971803    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j" event={"ID":"ac46b891-0723-42df-a019-f593e45ce30e","Type":"ContainerStarted","Data":"518451bb0bda0f231208da83d3c67a37c1d35184c5273397749757005efbc8dd"}
Sep 07 22:56:54.006185 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:54.006129    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-218.ec2.internal" event={"ID":"5f1cd443c132fc94efb930ee12180b30","Type":"ContainerStarted","Data":"1909b79369c200341da4402db5f152d0a05dcc93903b11f2653cef42231c26e4"}
Sep 07 22:56:54.020223 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:54.020173    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-218.ec2.internal" podStartSLOduration=4.02015331 podStartE2EDuration="4.02015331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 22:56:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:56:54.020017323 +0000 UTC m=+5.648499656" watchObservedRunningTime="2026-09-07 22:56:54.02015331 +0000 UTC m=+5.648635646"
Sep 07 22:56:54.021132 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:54.021091    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-218.ec2.internal" podStartSLOduration=4.021076894 podStartE2EDuration="4.021076894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 22:56:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:56:52.981089352 +0000 UTC m=+4.609571689" watchObservedRunningTime="2026-09-07 22:56:54.021076894 +0000 UTC m=+5.649559230"
Sep 07 22:56:54.433050 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:54.432241    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs\") pod \"network-metrics-daemon-9wwxc\" (UID: \"a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff\") " pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:56:54.433050 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:54.432632    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 22:56:54.433050 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:54.432691    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs podName:a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff nodeName:}" failed. No retries permitted until 2026-09-07 22:56:58.432672918 +0000 UTC m=+10.061155238 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs") pod "network-metrics-daemon-9wwxc" (UID: "a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 22:56:54.534316 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:54.533517    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9srm\" (UniqueName: \"kubernetes.io/projected/e11df460-0a45-48e5-a54f-a4e08ec31b19-kube-api-access-g9srm\") pod \"network-check-target-mtmmp\" (UID: \"e11df460-0a45-48e5-a54f-a4e08ec31b19\") " pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:56:54.534316 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:54.533588    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d26fc16-73a5-4574-9525-4ff6eabc0c32-original-pull-secret\") pod \"global-pull-secret-syncer-cds22\" (UID: \"2d26fc16-73a5-4574-9525-4ff6eabc0c32\") " pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:56:54.534316 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:54.533728    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 22:56:54.534316 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:54.533789    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d26fc16-73a5-4574-9525-4ff6eabc0c32-original-pull-secret podName:2d26fc16-73a5-4574-9525-4ff6eabc0c32 nodeName:}" failed. No retries permitted until 2026-09-07 22:56:58.533771693 +0000 UTC m=+10.162254023 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d26fc16-73a5-4574-9525-4ff6eabc0c32-original-pull-secret") pod "global-pull-secret-syncer-cds22" (UID: "2d26fc16-73a5-4574-9525-4ff6eabc0c32") : object "kube-system"/"original-pull-secret" not registered
Sep 07 22:56:54.534316 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:54.534186    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 22:56:54.534316 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:54.534207    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 22:56:54.534316 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:54.534220    2557 projected.go:196] Error preparing data for projected volume kube-api-access-g9srm for pod openshift-network-diagnostics/network-check-target-mtmmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 22:56:54.534316 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:54.534281    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e11df460-0a45-48e5-a54f-a4e08ec31b19-kube-api-access-g9srm podName:e11df460-0a45-48e5-a54f-a4e08ec31b19 nodeName:}" failed. No retries permitted until 2026-09-07 22:56:58.534252776 +0000 UTC m=+10.162735104 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-g9srm" (UniqueName: "kubernetes.io/projected/e11df460-0a45-48e5-a54f-a4e08ec31b19-kube-api-access-g9srm") pod "network-check-target-mtmmp" (UID: "e11df460-0a45-48e5-a54f-a4e08ec31b19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 22:56:54.877003 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:54.876040    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:56:54.877003 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:54.876078    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:56:54.877003 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:54.876049    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:56:54.877003 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:54.876203    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtmmp" podUID="e11df460-0a45-48e5-a54f-a4e08ec31b19"
Sep 07 22:56:54.877003 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:54.876623    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cds22" podUID="2d26fc16-73a5-4574-9525-4ff6eabc0c32"
Sep 07 22:56:54.877003 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:54.876796    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wwxc" podUID="a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff"
Sep 07 22:56:56.871745 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:56.871161    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:56:56.871745 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:56.871292    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cds22" podUID="2d26fc16-73a5-4574-9525-4ff6eabc0c32"
Sep 07 22:56:56.871745 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:56.871651    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:56:56.871745 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:56.871745    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtmmp" podUID="e11df460-0a45-48e5-a54f-a4e08ec31b19"
Sep 07 22:56:56.872382 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:56.871789    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:56:56.872382 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:56.871867    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wwxc" podUID="a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff"
Sep 07 22:56:58.467692 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:58.467625    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs\") pod \"network-metrics-daemon-9wwxc\" (UID: \"a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff\") " pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:56:58.468244 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:58.467814    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 22:56:58.468244 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:58.467900    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs podName:a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff nodeName:}" failed. No retries permitted until 2026-09-07 22:57:06.467878247 +0000 UTC m=+18.096360582 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs") pod "network-metrics-daemon-9wwxc" (UID: "a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 22:56:58.568252 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:58.568214    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9srm\" (UniqueName: \"kubernetes.io/projected/e11df460-0a45-48e5-a54f-a4e08ec31b19-kube-api-access-g9srm\") pod \"network-check-target-mtmmp\" (UID: \"e11df460-0a45-48e5-a54f-a4e08ec31b19\") " pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:56:58.568419 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:58.568293    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d26fc16-73a5-4574-9525-4ff6eabc0c32-original-pull-secret\") pod \"global-pull-secret-syncer-cds22\" (UID: \"2d26fc16-73a5-4574-9525-4ff6eabc0c32\") " pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:56:58.568472 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:58.568443    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 22:56:58.568528 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:58.568510    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d26fc16-73a5-4574-9525-4ff6eabc0c32-original-pull-secret podName:2d26fc16-73a5-4574-9525-4ff6eabc0c32 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:06.568491928 +0000 UTC m=+18.196974302 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d26fc16-73a5-4574-9525-4ff6eabc0c32-original-pull-secret") pod "global-pull-secret-syncer-cds22" (UID: "2d26fc16-73a5-4574-9525-4ff6eabc0c32") : object "kube-system"/"original-pull-secret" not registered
Sep 07 22:56:58.568528 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:58.568515    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 22:56:58.568624 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:58.568542    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 22:56:58.568624 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:58.568555    2557 projected.go:196] Error preparing data for projected volume kube-api-access-g9srm for pod openshift-network-diagnostics/network-check-target-mtmmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 22:56:58.568624 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:58.568607    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e11df460-0a45-48e5-a54f-a4e08ec31b19-kube-api-access-g9srm podName:e11df460-0a45-48e5-a54f-a4e08ec31b19 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:06.56859172 +0000 UTC m=+18.197074039 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-g9srm" (UniqueName: "kubernetes.io/projected/e11df460-0a45-48e5-a54f-a4e08ec31b19-kube-api-access-g9srm") pod "network-check-target-mtmmp" (UID: "e11df460-0a45-48e5-a54f-a4e08ec31b19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 22:56:58.871834 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:58.871757    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:56:58.872000 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:58.871887    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wwxc" podUID="a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff"
Sep 07 22:56:58.872281 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:58.872257    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:56:58.872460 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:58.872364    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cds22" podUID="2d26fc16-73a5-4574-9525-4ff6eabc0c32"
Sep 07 22:56:58.872460 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:56:58.872410    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:56:58.872547 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:56:58.872470    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtmmp" podUID="e11df460-0a45-48e5-a54f-a4e08ec31b19"
Sep 07 22:57:00.871637 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:00.871455    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:57:00.871637 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:00.871587    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtmmp" podUID="e11df460-0a45-48e5-a54f-a4e08ec31b19"
Sep 07 22:57:00.872201 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:00.871950    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:57:00.872201 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:00.872031    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:57:00.872201 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:00.872126    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cds22" podUID="2d26fc16-73a5-4574-9525-4ff6eabc0c32"
Sep 07 22:57:00.872330 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:00.872218    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wwxc" podUID="a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff"
Sep 07 22:57:02.871771 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:02.871708    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:57:02.872254 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:02.871717    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:57:02.872254 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:02.871842    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtmmp" podUID="e11df460-0a45-48e5-a54f-a4e08ec31b19"
Sep 07 22:57:02.872254 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:02.871857    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:57:02.872254 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:02.872062    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wwxc" podUID="a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff"
Sep 07 22:57:02.872254 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:02.872153    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cds22" podUID="2d26fc16-73a5-4574-9525-4ff6eabc0c32"
Sep 07 22:57:04.870992 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:04.870953    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:57:04.871451 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:04.870958    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:57:04.871451 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:04.871084    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtmmp" podUID="e11df460-0a45-48e5-a54f-a4e08ec31b19"
Sep 07 22:57:04.871451 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:04.871212    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wwxc" podUID="a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff"
Sep 07 22:57:04.871451 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:04.870958    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:57:04.871451 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:04.871351    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cds22" podUID="2d26fc16-73a5-4574-9525-4ff6eabc0c32"
Sep 07 22:57:06.523877 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:06.523838    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs\") pod \"network-metrics-daemon-9wwxc\" (UID: \"a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff\") " pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:57:06.524346 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:06.523988    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 22:57:06.524346 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:06.524052    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs podName:a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff nodeName:}" failed. No retries permitted until 2026-09-07 22:57:22.524036174 +0000 UTC m=+34.152518496 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs") pod "network-metrics-daemon-9wwxc" (UID: "a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 22:57:06.624740 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:06.624703    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9srm\" (UniqueName: \"kubernetes.io/projected/e11df460-0a45-48e5-a54f-a4e08ec31b19-kube-api-access-g9srm\") pod \"network-check-target-mtmmp\" (UID: \"e11df460-0a45-48e5-a54f-a4e08ec31b19\") " pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:57:06.624935 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:06.624779    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d26fc16-73a5-4574-9525-4ff6eabc0c32-original-pull-secret\") pod \"global-pull-secret-syncer-cds22\" (UID: \"2d26fc16-73a5-4574-9525-4ff6eabc0c32\") " pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:57:06.624935 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:06.624876    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 22:57:06.624935 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:06.624899    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 22:57:06.624935 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:06.624926    2557 projected.go:196] Error preparing data for projected volume kube-api-access-g9srm for pod openshift-network-diagnostics/network-check-target-mtmmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 22:57:06.625070 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:06.624873    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 22:57:06.625070 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:06.624984    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e11df460-0a45-48e5-a54f-a4e08ec31b19-kube-api-access-g9srm podName:e11df460-0a45-48e5-a54f-a4e08ec31b19 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:22.624967707 +0000 UTC m=+34.253450025 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-g9srm" (UniqueName: "kubernetes.io/projected/e11df460-0a45-48e5-a54f-a4e08ec31b19-kube-api-access-g9srm") pod "network-check-target-mtmmp" (UID: "e11df460-0a45-48e5-a54f-a4e08ec31b19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 22:57:06.625070 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:06.625002    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d26fc16-73a5-4574-9525-4ff6eabc0c32-original-pull-secret podName:2d26fc16-73a5-4574-9525-4ff6eabc0c32 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:22.624991801 +0000 UTC m=+34.253474133 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d26fc16-73a5-4574-9525-4ff6eabc0c32-original-pull-secret") pod "global-pull-secret-syncer-cds22" (UID: "2d26fc16-73a5-4574-9525-4ff6eabc0c32") : object "kube-system"/"original-pull-secret" not registered
Sep 07 22:57:06.871470 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:06.871385    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:57:06.871619 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:06.871392    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:57:06.871619 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:06.871505    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtmmp" podUID="e11df460-0a45-48e5-a54f-a4e08ec31b19"
Sep 07 22:57:06.871619 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:06.871514    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:57:06.871619 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:06.871585    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wwxc" podUID="a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff"
Sep 07 22:57:06.871832 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:06.871655    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cds22" podUID="2d26fc16-73a5-4574-9525-4ff6eabc0c32"
Sep 07 22:57:08.872104 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:08.872073    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:57:08.872532 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:08.872170    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtmmp" podUID="e11df460-0a45-48e5-a54f-a4e08ec31b19"
Sep 07 22:57:08.872532 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:08.872265    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:57:08.872532 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:08.872371    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wwxc" podUID="a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff"
Sep 07 22:57:08.872532 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:08.872421    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:57:08.872532 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:08.872490    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cds22" podUID="2d26fc16-73a5-4574-9525-4ff6eabc0c32"
Sep 07 22:57:10.044078 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:10.043829    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/ovn-acl-logging/0.log"
Sep 07 22:57:10.044943 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:10.044522    2557 generic.go:356] "Generic (PLEG): container finished" podID="ac46b891-0723-42df-a019-f593e45ce30e" containerID="6da59adf8142cce808ecfbdbec7c6df742fcef1c1ba04f94f71e516b95921995" exitCode=1
Sep 07 22:57:10.044943 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:10.044592    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j" event={"ID":"ac46b891-0723-42df-a019-f593e45ce30e","Type":"ContainerStarted","Data":"882e4f5d057bac88e7fee124f329293b4947436fe7ffd782b69bfd91c279e0d0"}
Sep 07 22:57:10.044943 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:10.044697    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j" event={"ID":"ac46b891-0723-42df-a019-f593e45ce30e","Type":"ContainerStarted","Data":"469c78832e84d31667f5ced353ed0756a1b459f58f371edebd43e1a7b86e1b48"}
Sep 07 22:57:10.044943 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:10.044751    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j" event={"ID":"ac46b891-0723-42df-a019-f593e45ce30e","Type":"ContainerStarted","Data":"31fd1d092f658afbe749167de46b7283d7232d5647d2e3730138eb6c55a9adbe"}
Sep 07 22:57:10.044943 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:10.044799    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j" event={"ID":"ac46b891-0723-42df-a019-f593e45ce30e","Type":"ContainerDied","Data":"6da59adf8142cce808ecfbdbec7c6df742fcef1c1ba04f94f71e516b95921995"}
Sep 07 22:57:10.044943 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:10.044848    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j" event={"ID":"ac46b891-0723-42df-a019-f593e45ce30e","Type":"ContainerStarted","Data":"dbf4ad0b41ee72f85eb49fa1439ee7ac517d1b155ff5e13322612170afc5107c"}
Sep 07 22:57:10.046448 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:10.046423    2557 generic.go:356] "Generic (PLEG): container finished" podID="5604f0be-842e-40a5-b8a4-677763cf9551" containerID="eb6afbd3aa9574d41b5b4facc02a4d4fe41ca7e03da0143052ca2ed20b57d98f" exitCode=0
Sep 07 22:57:10.046540 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:10.046502    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pkgd" event={"ID":"5604f0be-842e-40a5-b8a4-677763cf9551","Type":"ContainerDied","Data":"eb6afbd3aa9574d41b5b4facc02a4d4fe41ca7e03da0143052ca2ed20b57d98f"}
Sep 07 22:57:10.048630 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:10.048607    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9fnns" event={"ID":"15cf1f7c-7686-47db-83a3-431fa37e2050","Type":"ContainerStarted","Data":"462cc7afd001bdbe1ff86908d4795dd5a30666687fed9cc7112af79d29528cb0"}
Sep 07 22:57:10.051370 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:10.051241    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-drkf4" event={"ID":"0af21eb1-139e-444e-809f-39e12274e7e6","Type":"ContainerStarted","Data":"be7ab57771e302107f835b9a1f29aadbb9cf82f61a8abcb50d2b035edb839b1a"}
Sep 07 22:57:10.053309 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:10.053286    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6c8dw" event={"ID":"be6f18f7-5628-458a-93fe-962199c8f623","Type":"ContainerStarted","Data":"2da690b5a0d5b955a41cef4be942114f0ab7846b397d8a79abb151c1de6a714f"}
Sep 07 22:57:10.055045 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:10.055023    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5" event={"ID":"5a53e68e-e682-48bc-a1ab-40f94eda6ff9","Type":"ContainerStarted","Data":"77ad164ca05391c3b64a04cb61641ca4f10148abc4a68a49836573c88d7d4730"}
Sep 07 22:57:10.056608 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:10.056583    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f2m5f" event={"ID":"9bfcafa5-70d4-4c55-94c4-5548256d27d8","Type":"ContainerStarted","Data":"d663b9280e7d7048716227af59f54963fd4eb8879a598a6ab5febc4d7ddc0fc0"}
Sep 07 22:57:10.059019 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:10.058624    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jg69x" event={"ID":"98ee66cc-6517-4fa8-81cd-8b045c045c79","Type":"ContainerStarted","Data":"8a53ce1cd3e32ff222823dd927ade49b84d658f26d91b20f11987f7a673c4f05"}
Sep 07 22:57:10.078898 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:10.078860    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-f2m5f" podStartSLOduration=3.5539953459999998 podStartE2EDuration="21.078844682s" totalImagesPullingTime="17.524849336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 22:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:57:10.078661007 +0000 UTC m=+21.707143342" watchObservedRunningTime="2026-09-07 22:57:10.078844682 +0000 UTC m=+21.707327018"
Sep 07 22:57:10.094600 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:10.094555    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-drkf4" podStartSLOduration=3.218518667 podStartE2EDuration="21.094537504s" totalImagesPullingTime="17.876018837s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 22:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:57:10.093673878 +0000 UTC m=+21.722156205" watchObservedRunningTime="2026-09-07 22:57:10.094537504 +0000 UTC m=+21.723019840"
Sep 07 22:57:10.112492 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:10.112088    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jg69x" podStartSLOduration=3.658837491 podStartE2EDuration="21.112067109s" totalImagesPullingTime="17.453229618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 22:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:57:10.111730485 +0000 UTC m=+21.740212820" watchObservedRunningTime="2026-09-07 22:57:10.112067109 +0000 UTC m=+21.740549446"
Sep 07 22:57:10.128230 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:10.128162    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6c8dw" podStartSLOduration=4.609826273 podStartE2EDuration="22.128145184s" totalImagesPullingTime="17.518318911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 22:56:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:57:10.127505633 +0000 UTC m=+21.755987962" watchObservedRunningTime="2026-09-07 22:57:10.128145184 +0000 UTC m=+21.756627521"
Sep 07 22:57:10.870749 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:10.870722    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:57:10.870843 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:10.870753    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:57:10.870907 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:10.870843    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtmmp" podUID="e11df460-0a45-48e5-a54f-a4e08ec31b19"
Sep 07 22:57:10.870907 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:10.870877    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:57:10.871033 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:10.870977    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cds22" podUID="2d26fc16-73a5-4574-9525-4ff6eabc0c32"
Sep 07 22:57:10.871088 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:10.871062    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wwxc" podUID="a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff"
Sep 07 22:57:10.875477 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:10.875458    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 07 22:57:11.064717 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:11.064648    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/ovn-acl-logging/0.log"
Sep 07 22:57:11.065146 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:11.065056    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j" event={"ID":"ac46b891-0723-42df-a019-f593e45ce30e","Type":"ContainerStarted","Data":"1ce76a04187b5118882372e11f97a6aabb2534a9f92e968f92cd9829578499b3"}
Sep 07 22:57:11.066745 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:11.066718    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wd4ll" event={"ID":"aeebe660-56d9-40ff-86c8-459b70eb7d91","Type":"ContainerStarted","Data":"238b7c9a66285cf9ffe329fe0a36dc35a6dd0de0041863dba03ca4acc5758070"}
Sep 07 22:57:11.068832 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:11.068805    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5" event={"ID":"5a53e68e-e682-48bc-a1ab-40f94eda6ff9","Type":"ContainerStarted","Data":"fed7e2f8447e0ef6759d407560a2968338557ff8d5403ec2c4313a5aa231bf61"}
Sep 07 22:57:11.079710 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:11.079670    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wd4ll" podStartSLOduration=4.562338776 podStartE2EDuration="22.079658579s" totalImagesPullingTime="17.517319803s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 22:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:57:11.079639159 +0000 UTC m=+22.708121496" watchObservedRunningTime="2026-09-07 22:57:11.079658579 +0000 UTC m=+22.708140914"
Sep 07 22:57:11.080196 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:11.080166    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9fnns" podStartSLOduration=4.551908015 podStartE2EDuration="22.080159101s" totalImagesPullingTime="17.528251086s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 22:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:57:10.143230607 +0000 UTC m=+21.771712941" watchObservedRunningTime="2026-09-07 22:57:11.080159101 +0000 UTC m=+22.708641482"
Sep 07 22:57:11.841116 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:11.840982    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T22:57:10.875474391Z","UUID":"1ec00ca3-43c0-4db9-bb40-08fe44a470ec","Handler":null,"Name":"","Endpoint":""}
Sep 07 22:57:11.842633 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:11.842609    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 07 22:57:11.842743 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:11.842644    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 07 22:57:12.073450 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:12.073412    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5" event={"ID":"5a53e68e-e682-48bc-a1ab-40f94eda6ff9","Type":"ContainerStarted","Data":"51f16793eb00ad3a667871d4f36b4012498a899736d0355913da742608b8bf10"}
Sep 07 22:57:12.088984 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:12.088911    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7zj5" podStartSLOduration=3.518446307 podStartE2EDuration="23.088895272s" totalImagesPullingTime="19.570448965s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 22:56:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:57:12.08863061 +0000 UTC m=+23.717112946" watchObservedRunningTime="2026-09-07 22:57:12.088895272 +0000 UTC m=+23.717377607"
Sep 07 22:57:12.871630 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:12.871600    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:57:12.871630 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:12.871615    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:57:12.871979 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:12.871601    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:57:12.871979 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:12.871724    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wwxc" podUID="a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff"
Sep 07 22:57:12.871979 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:12.871776    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtmmp" podUID="e11df460-0a45-48e5-a54f-a4e08ec31b19"
Sep 07 22:57:12.871979 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:12.871855    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cds22" podUID="2d26fc16-73a5-4574-9525-4ff6eabc0c32"
Sep 07 22:57:13.079072 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:13.079038    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/ovn-acl-logging/0.log"
Sep 07 22:57:13.079530 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:13.079496    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j" event={"ID":"ac46b891-0723-42df-a019-f593e45ce30e","Type":"ContainerStarted","Data":"9966fe540596a39a0f1917e6609ce2fd5d8078b13f813e94c3c09d67790e4f7b"}
Sep 07 22:57:13.780193 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:13.780159    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jg69x"
Sep 07 22:57:13.780692 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:13.780674    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jg69x"
Sep 07 22:57:14.081667 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:14.081586    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jg69x"
Sep 07 22:57:14.082074 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:14.082015    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jg69x"
Sep 07 22:57:14.871699 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:14.871495    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:57:14.871847 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:14.871514    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:57:14.871847 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:14.871734    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cds22" podUID="2d26fc16-73a5-4574-9525-4ff6eabc0c32"
Sep 07 22:57:14.871847 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:14.871794    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtmmp" podUID="e11df460-0a45-48e5-a54f-a4e08ec31b19"
Sep 07 22:57:14.871847 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:14.871562    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:57:14.872092 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:14.871929    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wwxc" podUID="a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff"
Sep 07 22:57:15.086430 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:15.086407    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/ovn-acl-logging/0.log"
Sep 07 22:57:15.087061 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:15.086766    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j" event={"ID":"ac46b891-0723-42df-a019-f593e45ce30e","Type":"ContainerStarted","Data":"3f168f4eca6bbb12ba3b2c0ce468cc2216d6155f3172a799fbce2c8e379a998a"}
Sep 07 22:57:15.087126 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:15.087059    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:57:15.087278 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:15.087252    2557 scope.go:117] "RemoveContainer" containerID="6da59adf8142cce808ecfbdbec7c6df742fcef1c1ba04f94f71e516b95921995"
Sep 07 22:57:15.090119 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:15.090095    2557 generic.go:356] "Generic (PLEG): container finished" podID="5604f0be-842e-40a5-b8a4-677763cf9551" containerID="69d2afd60ba448d51bc57729c7156a39b74f138ede1e488c218dfd377463aa3b" exitCode=0
Sep 07 22:57:15.090968 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:15.090903    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pkgd" event={"ID":"5604f0be-842e-40a5-b8a4-677763cf9551","Type":"ContainerDied","Data":"69d2afd60ba448d51bc57729c7156a39b74f138ede1e488c218dfd377463aa3b"}
Sep 07 22:57:15.103670 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:15.103648    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:57:16.095909 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:16.095880    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/ovn-acl-logging/0.log"
Sep 07 22:57:16.096401 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:16.096212    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j" event={"ID":"ac46b891-0723-42df-a019-f593e45ce30e","Type":"ContainerStarted","Data":"2df2a4e5399aa9fa92891751b4ff35abb6d9db01c9a23930039fcf6a76f5b9c2"}
Sep 07 22:57:16.096458 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:16.096446    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:57:16.096499 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:16.096487    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:57:16.110807 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:16.110787    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:57:16.124006 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:16.123958    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j" podStartSLOduration=9.382907863 podStartE2EDuration="27.123944262s" totalImagesPullingTime="17.741036399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 22:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:57:16.123593863 +0000 UTC m=+27.752076198" watchObservedRunningTime="2026-09-07 22:57:16.123944262 +0000 UTC m=+27.752426596"
Sep 07 22:57:16.501722 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:16.501580    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cds22"]
Sep 07 22:57:16.501972 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:16.501799    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:57:16.501972 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:16.501893    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cds22" podUID="2d26fc16-73a5-4574-9525-4ff6eabc0c32"
Sep 07 22:57:16.504775 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:16.504600    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mtmmp"]
Sep 07 22:57:16.506661 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:16.506601    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9wwxc"]
Sep 07 22:57:16.506847 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:16.506760    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:57:16.506847 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:16.506777    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:57:16.507892 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:16.507723    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wwxc" podUID="a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff"
Sep 07 22:57:16.509528 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:16.508690    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtmmp" podUID="e11df460-0a45-48e5-a54f-a4e08ec31b19"
Sep 07 22:57:17.099848 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:17.099812    2557 generic.go:356] "Generic (PLEG): container finished" podID="5604f0be-842e-40a5-b8a4-677763cf9551" containerID="44e9d8709a7ddc6ea3512484281c228f29f2d150de94267bbe0b1daf2f29bd21" exitCode=0
Sep 07 22:57:17.100237 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:17.099901    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pkgd" event={"ID":"5604f0be-842e-40a5-b8a4-677763cf9551","Type":"ContainerDied","Data":"44e9d8709a7ddc6ea3512484281c228f29f2d150de94267bbe0b1daf2f29bd21"}
Sep 07 22:57:17.871255 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:17.871225    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:57:17.871255 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:17.871246    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:57:17.871594 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:17.871246    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:57:17.871594 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:17.871339    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cds22" podUID="2d26fc16-73a5-4574-9525-4ff6eabc0c32"
Sep 07 22:57:17.871594 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:17.871393    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtmmp" podUID="e11df460-0a45-48e5-a54f-a4e08ec31b19"
Sep 07 22:57:17.871594 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:17.871490    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wwxc" podUID="a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff"
Sep 07 22:57:19.105641 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:19.105578    2557 generic.go:356] "Generic (PLEG): container finished" podID="5604f0be-842e-40a5-b8a4-677763cf9551" containerID="d633c5b2a10591c80c878fd1080776a30e4db46b7ff4a557b9755be2cd7c1211" exitCode=0
Sep 07 22:57:19.105641 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:19.105617    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pkgd" event={"ID":"5604f0be-842e-40a5-b8a4-677763cf9551","Type":"ContainerDied","Data":"d633c5b2a10591c80c878fd1080776a30e4db46b7ff4a557b9755be2cd7c1211"}
Sep 07 22:57:19.871337 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:19.871309    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:57:19.871507 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:19.871309    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:57:19.871507 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:19.871411    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cds22" podUID="2d26fc16-73a5-4574-9525-4ff6eabc0c32"
Sep 07 22:57:19.871507 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:19.871309    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:57:19.871507 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:19.871477    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtmmp" podUID="e11df460-0a45-48e5-a54f-a4e08ec31b19"
Sep 07 22:57:19.871682 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:19.871549    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wwxc" podUID="a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff"
Sep 07 22:57:21.871161 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:21.871131    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:57:21.871610 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:21.871131    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:57:21.871610 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:21.871234    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wwxc" podUID="a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff"
Sep 07 22:57:21.871610 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:21.871143    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:57:21.871610 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:21.871294    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtmmp" podUID="e11df460-0a45-48e5-a54f-a4e08ec31b19"
Sep 07 22:57:21.871610 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:21.871358    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cds22" podUID="2d26fc16-73a5-4574-9525-4ff6eabc0c32"
Sep 07 22:57:22.538845 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.538771    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs\") pod \"network-metrics-daemon-9wwxc\" (UID: \"a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff\") " pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:57:22.539016 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:22.538906    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 22:57:22.539016 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:22.538992    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs podName:a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff nodeName:}" failed. No retries permitted until 2026-09-07 22:57:54.538971397 +0000 UTC m=+66.167453728 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs") pod "network-metrics-daemon-9wwxc" (UID: "a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 22:57:22.639629 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.639597    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9srm\" (UniqueName: \"kubernetes.io/projected/e11df460-0a45-48e5-a54f-a4e08ec31b19-kube-api-access-g9srm\") pod \"network-check-target-mtmmp\" (UID: \"e11df460-0a45-48e5-a54f-a4e08ec31b19\") " pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:57:22.639783 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.639662    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d26fc16-73a5-4574-9525-4ff6eabc0c32-original-pull-secret\") pod \"global-pull-secret-syncer-cds22\" (UID: \"2d26fc16-73a5-4574-9525-4ff6eabc0c32\") " pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:57:22.639783 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:22.639756    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 22:57:22.639896 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:22.639782    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 22:57:22.639896 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:22.639804    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d26fc16-73a5-4574-9525-4ff6eabc0c32-original-pull-secret podName:2d26fc16-73a5-4574-9525-4ff6eabc0c32 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:54.639791163 +0000 UTC m=+66.268273475 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d26fc16-73a5-4574-9525-4ff6eabc0c32-original-pull-secret") pod "global-pull-secret-syncer-cds22" (UID: "2d26fc16-73a5-4574-9525-4ff6eabc0c32") : object "kube-system"/"original-pull-secret" not registered
Sep 07 22:57:22.639896 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:22.639804    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 22:57:22.639896 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:22.639822    2557 projected.go:196] Error preparing data for projected volume kube-api-access-g9srm for pod openshift-network-diagnostics/network-check-target-mtmmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 22:57:22.639896 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:22.639858    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e11df460-0a45-48e5-a54f-a4e08ec31b19-kube-api-access-g9srm podName:e11df460-0a45-48e5-a54f-a4e08ec31b19 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:54.639848161 +0000 UTC m=+66.268330477 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-g9srm" (UniqueName: "kubernetes.io/projected/e11df460-0a45-48e5-a54f-a4e08ec31b19-kube-api-access-g9srm") pod "network-check-target-mtmmp" (UID: "e11df460-0a45-48e5-a54f-a4e08ec31b19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 22:57:22.686950 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.686925    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-218.ec2.internal" event="NodeReady"
Sep 07 22:57:22.687075 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.687039    2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 07 22:57:22.722264 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.722226    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b6f776cf4-ptqxw"]
Sep 07 22:57:22.726425 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.726395    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-dtxv7"]
Sep 07 22:57:22.726553 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.726533    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:22.728224 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.728205    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-dtxv7"
Sep 07 22:57:22.728863 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.728844    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 07 22:57:22.728967 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.728845    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 07 22:57:22.729408 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.729389    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 07 22:57:22.729648 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.729632    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nrmp6\""
Sep 07 22:57:22.730495 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.730476    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 07 22:57:22.730784 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.730764    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8zwjz\""
Sep 07 22:57:22.730884 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.730823    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 07 22:57:22.734225 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.733310    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zqpbc"]
Sep 07 22:57:22.735683 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.735123    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-dtxv7"]
Sep 07 22:57:22.735683 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.735205    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zqpbc"
Sep 07 22:57:22.736445 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.736426    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 07 22:57:22.737564 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.737544    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 07 22:57:22.737678 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.737590    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cnr5j\""
Sep 07 22:57:22.737730 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.737544    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 07 22:57:22.737871 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.737858    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 07 22:57:22.740058 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.740005    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b6f776cf4-ptqxw"]
Sep 07 22:57:22.740898 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.740695    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d8gbl"]
Sep 07 22:57:22.743989 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.743483    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zqpbc"]
Sep 07 22:57:22.743989 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.743566    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d8gbl"
Sep 07 22:57:22.746269 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.746237    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 07 22:57:22.746358 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.746268    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nflgb\""
Sep 07 22:57:22.746436 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.746422    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 07 22:57:22.755127 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.755108    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d8gbl"]
Sep 07 22:57:22.840425 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.840354    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmp49\" (UniqueName: \"kubernetes.io/projected/d155f254-2c44-4d90-97d8-e182e06fbee7-kube-api-access-dmp49\") pod \"ingress-canary-zqpbc\" (UID: \"d155f254-2c44-4d90-97d8-e182e06fbee7\") " pod="openshift-ingress-canary/ingress-canary-zqpbc"
Sep 07 22:57:22.840425 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.840385    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls\") pod \"dns-default-d8gbl\" (UID: \"e5b50755-c1fd-418a-9291-74b579b6c4a4\") " pod="openshift-dns/dns-default-d8gbl"
Sep 07 22:57:22.840425 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.840410    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5b50755-c1fd-418a-9291-74b579b6c4a4-tmp-dir\") pod \"dns-default-d8gbl\" (UID: \"e5b50755-c1fd-418a-9291-74b579b6c4a4\") " pod="openshift-dns/dns-default-d8gbl"
Sep 07 22:57:22.840667 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.840469    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-nginx-conf\") pod \"networking-console-plugin-79977f9844-dtxv7\" (UID: \"d6c9a39c-171b-4644-9e98-c5dd3ae84d3b\") " pod="openshift-network-console/networking-console-plugin-79977f9844-dtxv7"
Sep 07 22:57:22.840667 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.840510    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-dtxv7\" (UID: \"d6c9a39c-171b-4644-9e98-c5dd3ae84d3b\") " pod="openshift-network-console/networking-console-plugin-79977f9844-dtxv7"
Sep 07 22:57:22.840667 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.840545    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrcz4\" (UniqueName: \"kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-kube-api-access-zrcz4\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:22.840667 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.840572    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcx9b\" (UniqueName: \"kubernetes.io/projected/e5b50755-c1fd-418a-9291-74b579b6c4a4-kube-api-access-gcx9b\") pod \"dns-default-d8gbl\" (UID: \"e5b50755-c1fd-418a-9291-74b579b6c4a4\") " pod="openshift-dns/dns-default-d8gbl"
Sep 07 22:57:22.840667 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.840642    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/39023548-2a42-458f-adba-bc61a7cd6955-registry-certificates\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:22.840872 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.840669    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39023548-2a42-458f-adba-bc61a7cd6955-trusted-ca\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:22.840872 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.840697    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-bound-sa-token\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:22.840872 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.840725    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/39023548-2a42-458f-adba-bc61a7cd6955-ca-trust-extracted\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:22.840872 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.840762    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5b50755-c1fd-418a-9291-74b579b6c4a4-config-volume\") pod \"dns-default-d8gbl\" (UID: \"e5b50755-c1fd-418a-9291-74b579b6c4a4\") " pod="openshift-dns/dns-default-d8gbl"
Sep 07 22:57:22.840872 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.840834    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/39023548-2a42-458f-adba-bc61a7cd6955-image-registry-private-configuration\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:22.841079 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.840885    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:22.841079 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.840911    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/39023548-2a42-458f-adba-bc61a7cd6955-installation-pull-secrets\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:22.841079 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.840989    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d155f254-2c44-4d90-97d8-e182e06fbee7-cert\") pod \"ingress-canary-zqpbc\" (UID: \"d155f254-2c44-4d90-97d8-e182e06fbee7\") " pod="openshift-ingress-canary/ingress-canary-zqpbc"
Sep 07 22:57:22.942353 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.942312    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/39023548-2a42-458f-adba-bc61a7cd6955-ca-trust-extracted\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:22.942785 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.942455    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5b50755-c1fd-418a-9291-74b579b6c4a4-config-volume\") pod \"dns-default-d8gbl\" (UID: \"e5b50755-c1fd-418a-9291-74b579b6c4a4\") " pod="openshift-dns/dns-default-d8gbl"
Sep 07 22:57:22.942785 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.942503    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/39023548-2a42-458f-adba-bc61a7cd6955-image-registry-private-configuration\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:22.942785 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.942531    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:22.942785 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.942556    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/39023548-2a42-458f-adba-bc61a7cd6955-installation-pull-secrets\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:22.942785 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:22.942668    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 22:57:22.942785 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:22.942687    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b6f776cf4-ptqxw: secret "image-registry-tls" not found
Sep 07 22:57:22.942785 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.942725    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d155f254-2c44-4d90-97d8-e182e06fbee7-cert\") pod \"ingress-canary-zqpbc\" (UID: \"d155f254-2c44-4d90-97d8-e182e06fbee7\") " pod="openshift-ingress-canary/ingress-canary-zqpbc"
Sep 07 22:57:22.942785 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:22.942756    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls podName:39023548-2a42-458f-adba-bc61a7cd6955 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:23.442736775 +0000 UTC m=+35.071219103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls") pod "image-registry-b6f776cf4-ptqxw" (UID: "39023548-2a42-458f-adba-bc61a7cd6955") : secret "image-registry-tls" not found
Sep 07 22:57:22.943210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.942807    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/39023548-2a42-458f-adba-bc61a7cd6955-ca-trust-extracted\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:22.943210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.942825    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmp49\" (UniqueName: \"kubernetes.io/projected/d155f254-2c44-4d90-97d8-e182e06fbee7-kube-api-access-dmp49\") pod \"ingress-canary-zqpbc\" (UID: \"d155f254-2c44-4d90-97d8-e182e06fbee7\") " pod="openshift-ingress-canary/ingress-canary-zqpbc"
Sep 07 22:57:22.943210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.942856    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls\") pod \"dns-default-d8gbl\" (UID: \"e5b50755-c1fd-418a-9291-74b579b6c4a4\") " pod="openshift-dns/dns-default-d8gbl"
Sep 07 22:57:22.943210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.942880    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5b50755-c1fd-418a-9291-74b579b6c4a4-tmp-dir\") pod \"dns-default-d8gbl\" (UID: \"e5b50755-c1fd-418a-9291-74b579b6c4a4\") " pod="openshift-dns/dns-default-d8gbl"
Sep 07 22:57:22.943210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.942932    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-nginx-conf\") pod \"networking-console-plugin-79977f9844-dtxv7\" (UID: \"d6c9a39c-171b-4644-9e98-c5dd3ae84d3b\") " pod="openshift-network-console/networking-console-plugin-79977f9844-dtxv7"
Sep 07 22:57:22.943210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.942959    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-dtxv7\" (UID: \"d6c9a39c-171b-4644-9e98-c5dd3ae84d3b\") " pod="openshift-network-console/networking-console-plugin-79977f9844-dtxv7"
Sep 07 22:57:22.943210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.942993    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrcz4\" (UniqueName: \"kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-kube-api-access-zrcz4\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:22.943210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.943016    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcx9b\" (UniqueName: \"kubernetes.io/projected/e5b50755-c1fd-418a-9291-74b579b6c4a4-kube-api-access-gcx9b\") pod \"dns-default-d8gbl\" (UID: \"e5b50755-c1fd-418a-9291-74b579b6c4a4\") " pod="openshift-dns/dns-default-d8gbl"
Sep 07 22:57:22.943210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.943047    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/39023548-2a42-458f-adba-bc61a7cd6955-registry-certificates\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:22.943210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.943077    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39023548-2a42-458f-adba-bc61a7cd6955-trusted-ca\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:22.943210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.943095    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5b50755-c1fd-418a-9291-74b579b6c4a4-config-volume\") pod \"dns-default-d8gbl\" (UID: \"e5b50755-c1fd-418a-9291-74b579b6c4a4\") " pod="openshift-dns/dns-default-d8gbl"
Sep 07 22:57:22.943210 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.943105    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-bound-sa-token\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:22.943210 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:22.943181    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 07 22:57:22.943210 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:22.943186    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 22:57:22.943793 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:22.943226    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert podName:d6c9a39c-171b-4644-9e98-c5dd3ae84d3b nodeName:}" failed. No retries permitted until 2026-09-07 22:57:23.4432103 +0000 UTC m=+35.071692623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-dtxv7" (UID: "d6c9a39c-171b-4644-9e98-c5dd3ae84d3b") : secret "networking-console-plugin-cert" not found
Sep 07 22:57:22.943793 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:22.943242    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls podName:e5b50755-c1fd-418a-9291-74b579b6c4a4 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:23.44323323 +0000 UTC m=+35.071715549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls") pod "dns-default-d8gbl" (UID: "e5b50755-c1fd-418a-9291-74b579b6c4a4") : secret "dns-default-metrics-tls" not found
Sep 07 22:57:22.943793 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.943668    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5b50755-c1fd-418a-9291-74b579b6c4a4-tmp-dir\") pod \"dns-default-d8gbl\" (UID: \"e5b50755-c1fd-418a-9291-74b579b6c4a4\") " pod="openshift-dns/dns-default-d8gbl"
Sep 07 22:57:22.943793 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.943725    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-nginx-conf\") pod \"networking-console-plugin-79977f9844-dtxv7\" (UID: \"d6c9a39c-171b-4644-9e98-c5dd3ae84d3b\") " pod="openshift-network-console/networking-console-plugin-79977f9844-dtxv7"
Sep 07 22:57:22.943991 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.943786    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/39023548-2a42-458f-adba-bc61a7cd6955-registry-certificates\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:22.944695 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.944661    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39023548-2a42-458f-adba-bc61a7cd6955-trusted-ca\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:22.947185 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.947158    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/39023548-2a42-458f-adba-bc61a7cd6955-installation-pull-secrets\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:22.947185 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.947172    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/39023548-2a42-458f-adba-bc61a7cd6955-image-registry-private-configuration\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:22.947313 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.947187    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d155f254-2c44-4d90-97d8-e182e06fbee7-cert\") pod \"ingress-canary-zqpbc\" (UID: \"d155f254-2c44-4d90-97d8-e182e06fbee7\") " pod="openshift-ingress-canary/ingress-canary-zqpbc"
Sep 07 22:57:22.951643 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.951619    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-bound-sa-token\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:22.951746 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.951721    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmp49\" (UniqueName: \"kubernetes.io/projected/d155f254-2c44-4d90-97d8-e182e06fbee7-kube-api-access-dmp49\") pod \"ingress-canary-zqpbc\" (UID: \"d155f254-2c44-4d90-97d8-e182e06fbee7\") " pod="openshift-ingress-canary/ingress-canary-zqpbc"
Sep 07 22:57:22.951807 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.951743    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrcz4\" (UniqueName: \"kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-kube-api-access-zrcz4\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:22.952076 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:22.952055    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcx9b\" (UniqueName: \"kubernetes.io/projected/e5b50755-c1fd-418a-9291-74b579b6c4a4-kube-api-access-gcx9b\") pod \"dns-default-d8gbl\" (UID: \"e5b50755-c1fd-418a-9291-74b579b6c4a4\") " pod="openshift-dns/dns-default-d8gbl"
Sep 07 22:57:23.054779 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:23.054552    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zqpbc"
Sep 07 22:57:23.450532 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:23.448355    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls\") pod \"dns-default-d8gbl\" (UID: \"e5b50755-c1fd-418a-9291-74b579b6c4a4\") " pod="openshift-dns/dns-default-d8gbl"
Sep 07 22:57:23.450532 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:23.448433    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-dtxv7\" (UID: \"d6c9a39c-171b-4644-9e98-c5dd3ae84d3b\") " pod="openshift-network-console/networking-console-plugin-79977f9844-dtxv7"
Sep 07 22:57:23.450532 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:23.448503    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:23.450532 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:23.448739    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 22:57:23.450532 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:23.448756    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b6f776cf4-ptqxw: secret "image-registry-tls" not found
Sep 07 22:57:23.450532 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:23.448825    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls podName:39023548-2a42-458f-adba-bc61a7cd6955 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:24.44880639 +0000 UTC m=+36.077288724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls") pod "image-registry-b6f776cf4-ptqxw" (UID: "39023548-2a42-458f-adba-bc61a7cd6955") : secret "image-registry-tls" not found
Sep 07 22:57:23.450532 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:23.449369    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 22:57:23.450532 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:23.449430    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls podName:e5b50755-c1fd-418a-9291-74b579b6c4a4 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:24.449404972 +0000 UTC m=+36.077887284 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls") pod "dns-default-d8gbl" (UID: "e5b50755-c1fd-418a-9291-74b579b6c4a4") : secret "dns-default-metrics-tls" not found
Sep 07 22:57:23.450532 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:23.449498    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 07 22:57:23.450532 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:23.449538    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert podName:d6c9a39c-171b-4644-9e98-c5dd3ae84d3b nodeName:}" failed. No retries permitted until 2026-09-07 22:57:24.449526989 +0000 UTC m=+36.078009304 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-dtxv7" (UID: "d6c9a39c-171b-4644-9e98-c5dd3ae84d3b") : secret "networking-console-plugin-cert" not found
Sep 07 22:57:23.870780 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:23.870724    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:57:23.870780 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:23.870756    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:57:23.870931 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:23.870756    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:57:23.873201 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:23.873180    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 22:57:23.873437 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:23.873417    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 22:57:23.873563 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:23.873498    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-247hl\""
Sep 07 22:57:23.873563 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:23.873520    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rtt2p\""
Sep 07 22:57:23.873662 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:23.873524    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 22:57:23.873874 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:23.873858    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 22:57:23.886159 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:23.886141    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zqpbc"]
Sep 07 22:57:23.889498 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:57:23.889478    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd155f254_2c44_4d90_97d8_e182e06fbee7.slice/crio-4754a42150d0d20be0395d3ba95fa684649272221eee18c4979829440cbed4fc WatchSource:0}: Error finding container 4754a42150d0d20be0395d3ba95fa684649272221eee18c4979829440cbed4fc: Status 404 returned error can't find the container with id 4754a42150d0d20be0395d3ba95fa684649272221eee18c4979829440cbed4fc
Sep 07 22:57:24.117712 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:24.117679    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zqpbc" event={"ID":"d155f254-2c44-4d90-97d8-e182e06fbee7","Type":"ContainerStarted","Data":"4754a42150d0d20be0395d3ba95fa684649272221eee18c4979829440cbed4fc"}
Sep 07 22:57:24.120269 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:24.120245    2557 generic.go:356] "Generic (PLEG): container finished" podID="5604f0be-842e-40a5-b8a4-677763cf9551" containerID="274fd38f26457d0a207a380b8063a8b364177344023914b4c22eda41b3516721" exitCode=0
Sep 07 22:57:24.120355 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:24.120288    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pkgd" event={"ID":"5604f0be-842e-40a5-b8a4-677763cf9551","Type":"ContainerDied","Data":"274fd38f26457d0a207a380b8063a8b364177344023914b4c22eda41b3516721"}
Sep 07 22:57:24.455829 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:24.455761    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:24.455973 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:24.455830    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls\") pod \"dns-default-d8gbl\" (UID: \"e5b50755-c1fd-418a-9291-74b579b6c4a4\") " pod="openshift-dns/dns-default-d8gbl"
Sep 07 22:57:24.455973 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:24.455855    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-dtxv7\" (UID: \"d6c9a39c-171b-4644-9e98-c5dd3ae84d3b\") " pod="openshift-network-console/networking-console-plugin-79977f9844-dtxv7"
Sep 07 22:57:24.455973 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:24.455898    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 22:57:24.455973 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:24.455930    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b6f776cf4-ptqxw: secret "image-registry-tls" not found
Sep 07 22:57:24.456107 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:24.455983    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 07 22:57:24.456107 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:24.455983    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 22:57:24.456107 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:24.455989    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls podName:39023548-2a42-458f-adba-bc61a7cd6955 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:26.455972794 +0000 UTC m=+38.084455112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls") pod "image-registry-b6f776cf4-ptqxw" (UID: "39023548-2a42-458f-adba-bc61a7cd6955") : secret "image-registry-tls" not found
Sep 07 22:57:24.456107 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:24.456049    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert podName:d6c9a39c-171b-4644-9e98-c5dd3ae84d3b nodeName:}" failed. No retries permitted until 2026-09-07 22:57:26.45603612 +0000 UTC m=+38.084518436 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-dtxv7" (UID: "d6c9a39c-171b-4644-9e98-c5dd3ae84d3b") : secret "networking-console-plugin-cert" not found
Sep 07 22:57:24.456107 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:24.456063    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls podName:e5b50755-c1fd-418a-9291-74b579b6c4a4 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:26.456054837 +0000 UTC m=+38.084537149 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls") pod "dns-default-d8gbl" (UID: "e5b50755-c1fd-418a-9291-74b579b6c4a4") : secret "dns-default-metrics-tls" not found
Sep 07 22:57:25.127143 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:25.127041    2557 generic.go:356] "Generic (PLEG): container finished" podID="5604f0be-842e-40a5-b8a4-677763cf9551" containerID="0588920c5a5ae972e88e64d9521c99cc7fe11db688147bb5394b4e55d2cdba20" exitCode=0
Sep 07 22:57:25.127143 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:25.127095    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pkgd" event={"ID":"5604f0be-842e-40a5-b8a4-677763cf9551","Type":"ContainerDied","Data":"0588920c5a5ae972e88e64d9521c99cc7fe11db688147bb5394b4e55d2cdba20"}
Sep 07 22:57:26.132300 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:26.132085    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zqpbc" event={"ID":"d155f254-2c44-4d90-97d8-e182e06fbee7","Type":"ContainerStarted","Data":"37ab94fc204d65b0d817427d6a70da24660a476b37921ad2f417e85fb777f458"}
Sep 07 22:57:26.135944 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:26.135904    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pkgd" event={"ID":"5604f0be-842e-40a5-b8a4-677763cf9551","Type":"ContainerStarted","Data":"6b0da7547c50fd38a1cf6895423dcb7529816e13cc20b86c2a7520c4a091b344"}
Sep 07 22:57:26.145760 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:26.145692    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zqpbc" podStartSLOduration=1.981722565 podStartE2EDuration="4.145678825s" totalImagesPullingTime="2.16395626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 22:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:57:26.145108566 +0000 UTC m=+37.773590901" watchObservedRunningTime="2026-09-07 22:57:26.145678825 +0000 UTC m=+37.774161154"
Sep 07 22:57:26.163591 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:26.163536    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6pkgd" podStartSLOduration=9.089824837 podStartE2EDuration="38.163515069s" totalImagesPullingTime="29.073690232s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 22:56:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:57:26.162587702 +0000 UTC m=+37.791070038" watchObservedRunningTime="2026-09-07 22:57:26.163515069 +0000 UTC m=+37.791997404"
Sep 07 22:57:26.471741 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:26.471712    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:26.471848 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:26.471776    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls\") pod \"dns-default-d8gbl\" (UID: \"e5b50755-c1fd-418a-9291-74b579b6c4a4\") " pod="openshift-dns/dns-default-d8gbl"
Sep 07 22:57:26.471848 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:26.471805    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-dtxv7\" (UID: \"d6c9a39c-171b-4644-9e98-c5dd3ae84d3b\") " pod="openshift-network-console/networking-console-plugin-79977f9844-dtxv7"
Sep 07 22:57:26.471933 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:26.471852    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 22:57:26.471933 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:26.471869    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b6f776cf4-ptqxw: secret "image-registry-tls" not found
Sep 07 22:57:26.471933 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:26.471894    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 07 22:57:26.472036 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:26.471930    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 22:57:26.472036 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:26.471948    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls podName:39023548-2a42-458f-adba-bc61a7cd6955 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:30.471909647 +0000 UTC m=+42.100391959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls") pod "image-registry-b6f776cf4-ptqxw" (UID: "39023548-2a42-458f-adba-bc61a7cd6955") : secret "image-registry-tls" not found
Sep 07 22:57:26.472036 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:26.471973    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls podName:e5b50755-c1fd-418a-9291-74b579b6c4a4 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:30.471955322 +0000 UTC m=+42.100437647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls") pod "dns-default-d8gbl" (UID: "e5b50755-c1fd-418a-9291-74b579b6c4a4") : secret "dns-default-metrics-tls" not found
Sep 07 22:57:26.472036 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:26.471986    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert podName:d6c9a39c-171b-4644-9e98-c5dd3ae84d3b nodeName:}" failed. No retries permitted until 2026-09-07 22:57:30.471981061 +0000 UTC m=+42.100463374 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-dtxv7" (UID: "d6c9a39c-171b-4644-9e98-c5dd3ae84d3b") : secret "networking-console-plugin-cert" not found
Sep 07 22:57:30.499651 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:30.499613    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls\") pod \"dns-default-d8gbl\" (UID: \"e5b50755-c1fd-418a-9291-74b579b6c4a4\") " pod="openshift-dns/dns-default-d8gbl"
Sep 07 22:57:30.499651 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:30.499653    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-dtxv7\" (UID: \"d6c9a39c-171b-4644-9e98-c5dd3ae84d3b\") " pod="openshift-network-console/networking-console-plugin-79977f9844-dtxv7"
Sep 07 22:57:30.500075 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:30.499684    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:30.500075 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:30.499790    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 22:57:30.500075 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:30.499802    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 07 22:57:30.500075 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:30.499823    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 22:57:30.500075 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:30.499833    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b6f776cf4-ptqxw: secret "image-registry-tls" not found
Sep 07 22:57:30.500075 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:30.499863    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert podName:d6c9a39c-171b-4644-9e98-c5dd3ae84d3b nodeName:}" failed. No retries permitted until 2026-09-07 22:57:38.499846961 +0000 UTC m=+50.128329279 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-dtxv7" (UID: "d6c9a39c-171b-4644-9e98-c5dd3ae84d3b") : secret "networking-console-plugin-cert" not found
Sep 07 22:57:30.500075 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:30.499877    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls podName:e5b50755-c1fd-418a-9291-74b579b6c4a4 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:38.499870881 +0000 UTC m=+50.128353194 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls") pod "dns-default-d8gbl" (UID: "e5b50755-c1fd-418a-9291-74b579b6c4a4") : secret "dns-default-metrics-tls" not found
Sep 07 22:57:30.500075 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:30.499887    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls podName:39023548-2a42-458f-adba-bc61a7cd6955 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:38.499881882 +0000 UTC m=+50.128364195 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls") pod "image-registry-b6f776cf4-ptqxw" (UID: "39023548-2a42-458f-adba-bc61a7cd6955") : secret "image-registry-tls" not found
Sep 07 22:57:38.556618 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:38.556577    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:38.557126 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:38.556651    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls\") pod \"dns-default-d8gbl\" (UID: \"e5b50755-c1fd-418a-9291-74b579b6c4a4\") " pod="openshift-dns/dns-default-d8gbl"
Sep 07 22:57:38.557126 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:38.556674    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-dtxv7\" (UID: \"d6c9a39c-171b-4644-9e98-c5dd3ae84d3b\") " pod="openshift-network-console/networking-console-plugin-79977f9844-dtxv7"
Sep 07 22:57:38.557126 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:38.556733    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 22:57:38.557126 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:38.556752    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b6f776cf4-ptqxw: secret "image-registry-tls" not found
Sep 07 22:57:38.557126 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:38.556762    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 07 22:57:38.557126 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:38.556806    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert podName:d6c9a39c-171b-4644-9e98-c5dd3ae84d3b nodeName:}" failed. No retries permitted until 2026-09-07 22:57:54.556793391 +0000 UTC m=+66.185275705 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-dtxv7" (UID: "d6c9a39c-171b-4644-9e98-c5dd3ae84d3b") : secret "networking-console-plugin-cert" not found
Sep 07 22:57:38.557126 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:38.556812    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 22:57:38.557126 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:38.556818    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls podName:39023548-2a42-458f-adba-bc61a7cd6955 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:54.556812643 +0000 UTC m=+66.185294956 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls") pod "image-registry-b6f776cf4-ptqxw" (UID: "39023548-2a42-458f-adba-bc61a7cd6955") : secret "image-registry-tls" not found
Sep 07 22:57:38.557126 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:38.556894    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls podName:e5b50755-c1fd-418a-9291-74b579b6c4a4 nodeName:}" failed. No retries permitted until 2026-09-07 22:57:54.556874503 +0000 UTC m=+66.185356820 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls") pod "dns-default-d8gbl" (UID: "e5b50755-c1fd-418a-9291-74b579b6c4a4") : secret "dns-default-metrics-tls" not found
Sep 07 22:57:48.122476 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:48.122447    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dnn7j"
Sep 07 22:57:54.568755 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:54.568716    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls\") pod \"dns-default-d8gbl\" (UID: \"e5b50755-c1fd-418a-9291-74b579b6c4a4\") " pod="openshift-dns/dns-default-d8gbl"
Sep 07 22:57:54.568755 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:54.568757    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-dtxv7\" (UID: \"d6c9a39c-171b-4644-9e98-c5dd3ae84d3b\") " pod="openshift-network-console/networking-console-plugin-79977f9844-dtxv7"
Sep 07 22:57:54.569353 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:54.568850    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 07 22:57:54.569353 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:54.568857    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 22:57:54.569353 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:54.568884    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:57:54.569353 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:54.568897    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert podName:d6c9a39c-171b-4644-9e98-c5dd3ae84d3b nodeName:}" failed. No retries permitted until 2026-09-07 22:58:26.56888399 +0000 UTC m=+98.197366302 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-dtxv7" (UID: "d6c9a39c-171b-4644-9e98-c5dd3ae84d3b") : secret "networking-console-plugin-cert" not found
Sep 07 22:57:54.569353 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:54.568973    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs\") pod \"network-metrics-daemon-9wwxc\" (UID: \"a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff\") " pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:57:54.569353 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:54.569025    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls podName:e5b50755-c1fd-418a-9291-74b579b6c4a4 nodeName:}" failed. No retries permitted until 2026-09-07 22:58:26.569007686 +0000 UTC m=+98.197490006 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls") pod "dns-default-d8gbl" (UID: "e5b50755-c1fd-418a-9291-74b579b6c4a4") : secret "dns-default-metrics-tls" not found
Sep 07 22:57:54.569353 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:54.569046    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 22:57:54.569353 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:54.569066    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b6f776cf4-ptqxw: secret "image-registry-tls" not found
Sep 07 22:57:54.569353 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:54.569124    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls podName:39023548-2a42-458f-adba-bc61a7cd6955 nodeName:}" failed. No retries permitted until 2026-09-07 22:58:26.569109386 +0000 UTC m=+98.197591699 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls") pod "image-registry-b6f776cf4-ptqxw" (UID: "39023548-2a42-458f-adba-bc61a7cd6955") : secret "image-registry-tls" not found
Sep 07 22:57:54.571250 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:54.571230    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 22:57:54.579509 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:54.579493    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 07 22:57:54.579556 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:57:54.579530    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs podName:a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff nodeName:}" failed. No retries permitted until 2026-09-07 22:58:58.579520402 +0000 UTC m=+130.208002715 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs") pod "network-metrics-daemon-9wwxc" (UID: "a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff") : secret "metrics-daemon-secret" not found
Sep 07 22:57:54.669769 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:54.669747    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9srm\" (UniqueName: \"kubernetes.io/projected/e11df460-0a45-48e5-a54f-a4e08ec31b19-kube-api-access-g9srm\") pod \"network-check-target-mtmmp\" (UID: \"e11df460-0a45-48e5-a54f-a4e08ec31b19\") " pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:57:54.669830 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:54.669790    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d26fc16-73a5-4574-9525-4ff6eabc0c32-original-pull-secret\") pod \"global-pull-secret-syncer-cds22\" (UID: \"2d26fc16-73a5-4574-9525-4ff6eabc0c32\") " pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:57:54.672240 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:54.672222    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 22:57:54.672332 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:54.672318    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 22:57:54.681703 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:54.681682    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 22:57:54.683146 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:54.683121    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d26fc16-73a5-4574-9525-4ff6eabc0c32-original-pull-secret\") pod \"global-pull-secret-syncer-cds22\" (UID: \"2d26fc16-73a5-4574-9525-4ff6eabc0c32\") " pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:57:54.692347 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:54.692325    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9srm\" (UniqueName: \"kubernetes.io/projected/e11df460-0a45-48e5-a54f-a4e08ec31b19-kube-api-access-g9srm\") pod \"network-check-target-mtmmp\" (UID: \"e11df460-0a45-48e5-a54f-a4e08ec31b19\") " pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:57:54.788153 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:54.788132    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rtt2p\""
Sep 07 22:57:54.792003 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:54.791990    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cds22"
Sep 07 22:57:54.796131 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:54.796110    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:57:55.099326 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:55.099263    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cds22"]
Sep 07 22:57:55.103019 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:57:55.102991    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d26fc16_73a5_4574_9525_4ff6eabc0c32.slice/crio-ac448285fbe8d7384c24a6e5587c05232c47513ebb7dc113a513aad9f668b0a4 WatchSource:0}: Error finding container ac448285fbe8d7384c24a6e5587c05232c47513ebb7dc113a513aad9f668b0a4: Status 404 returned error can't find the container with id ac448285fbe8d7384c24a6e5587c05232c47513ebb7dc113a513aad9f668b0a4
Sep 07 22:57:55.117447 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:55.117426    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mtmmp"]
Sep 07 22:57:55.119765 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:57:55.119741    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode11df460_0a45_48e5_a54f_a4e08ec31b19.slice/crio-caeeff6ae1a22936f735012f304dffbaccf1a6a2faeba803db6d7e12c498406a WatchSource:0}: Error finding container caeeff6ae1a22936f735012f304dffbaccf1a6a2faeba803db6d7e12c498406a: Status 404 returned error can't find the container with id caeeff6ae1a22936f735012f304dffbaccf1a6a2faeba803db6d7e12c498406a
Sep 07 22:57:55.199671 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:55.199645    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mtmmp" event={"ID":"e11df460-0a45-48e5-a54f-a4e08ec31b19","Type":"ContainerStarted","Data":"caeeff6ae1a22936f735012f304dffbaccf1a6a2faeba803db6d7e12c498406a"}
Sep 07 22:57:55.200730 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:57:55.200708    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cds22" event={"ID":"2d26fc16-73a5-4574-9525-4ff6eabc0c32","Type":"ContainerStarted","Data":"ac448285fbe8d7384c24a6e5587c05232c47513ebb7dc113a513aad9f668b0a4"}
Sep 07 22:58:00.215390 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:00.215355    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mtmmp" event={"ID":"e11df460-0a45-48e5-a54f-a4e08ec31b19","Type":"ContainerStarted","Data":"647167072bfa7f3c66f7c42a10418f444b4db5c70ed8d87a988174b7646f84c0"}
Sep 07 22:58:00.215821 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:00.215455    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:58:00.216836 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:00.216811    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cds22" event={"ID":"2d26fc16-73a5-4574-9525-4ff6eabc0c32","Type":"ContainerStarted","Data":"18f0e46af52a279bdbb658e57133525331079f0a67d0c681d67dc1cedafbb4f0"}
Sep 07 22:58:00.228858 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:00.228817    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mtmmp" podStartSLOduration=67.636974379 podStartE2EDuration="1m12.228806155s" totalImagesPullingTime="4.591831776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 22:56:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:58:00.227585384 +0000 UTC m=+71.856067718" watchObservedRunningTime="2026-09-07 22:58:00.228806155 +0000 UTC m=+71.857288498"
Sep 07 22:58:00.239831 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:00.239799    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cds22" podStartSLOduration=66.628110246 podStartE2EDuration="1m11.239790464s" totalImagesPullingTime="4.611680218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 22:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:58:00.23971873 +0000 UTC m=+71.868201065" watchObservedRunningTime="2026-09-07 22:58:00.239790464 +0000 UTC m=+71.868272799"
Sep 07 22:58:26.576044 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:26.576001    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls\") pod \"dns-default-d8gbl\" (UID: \"e5b50755-c1fd-418a-9291-74b579b6c4a4\") " pod="openshift-dns/dns-default-d8gbl"
Sep 07 22:58:26.576494 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:26.576058    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-dtxv7\" (UID: \"d6c9a39c-171b-4644-9e98-c5dd3ae84d3b\") " pod="openshift-network-console/networking-console-plugin-79977f9844-dtxv7"
Sep 07 22:58:26.576494 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:26.576108    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:58:26.576494 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:58:26.576160    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 22:58:26.576494 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:58:26.576193    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 22:58:26.576494 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:58:26.576208    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b6f776cf4-ptqxw: secret "image-registry-tls" not found
Sep 07 22:58:26.576494 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:58:26.576219    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 07 22:58:26.576494 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:58:26.576249    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls podName:e5b50755-c1fd-418a-9291-74b579b6c4a4 nodeName:}" failed. No retries permitted until 2026-09-07 22:59:30.576227691 +0000 UTC m=+162.204710023 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls") pod "dns-default-d8gbl" (UID: "e5b50755-c1fd-418a-9291-74b579b6c4a4") : secret "dns-default-metrics-tls" not found
Sep 07 22:58:26.576494 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:58:26.576267    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls podName:39023548-2a42-458f-adba-bc61a7cd6955 nodeName:}" failed. No retries permitted until 2026-09-07 22:59:30.576260607 +0000 UTC m=+162.204742925 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls") pod "image-registry-b6f776cf4-ptqxw" (UID: "39023548-2a42-458f-adba-bc61a7cd6955") : secret "image-registry-tls" not found
Sep 07 22:58:26.576494 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:58:26.576288    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert podName:d6c9a39c-171b-4644-9e98-c5dd3ae84d3b nodeName:}" failed. No retries permitted until 2026-09-07 22:59:30.576273039 +0000 UTC m=+162.204755378 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-dtxv7" (UID: "d6c9a39c-171b-4644-9e98-c5dd3ae84d3b") : secret "networking-console-plugin-cert" not found
Sep 07 22:58:31.221587 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:31.221557    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mtmmp"
Sep 07 22:58:46.885688 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:46.885658    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-664cfc66bc-gc8wq"]
Sep 07 22:58:46.887256 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:46.887239    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664cfc66bc-gc8wq"
Sep 07 22:58:46.889500 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:46.889479    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 07 22:58:46.890483 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:46.890464    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 07 22:58:46.890589 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:46.890499    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 07 22:58:46.890589 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:46.890537    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 07 22:58:46.898010 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:46.897988    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-664cfc66bc-gc8wq"]
Sep 07 22:58:47.010401 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:47.010380    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg7w2\" (UniqueName: \"kubernetes.io/projected/58e7b36d-af93-4e66-8e07-8b8cc2e020ea-kube-api-access-zg7w2\") pod \"klusterlet-addon-workmgr-664cfc66bc-gc8wq\" (UID: \"58e7b36d-af93-4e66-8e07-8b8cc2e020ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664cfc66bc-gc8wq"
Sep 07 22:58:47.010503 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:47.010425    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58e7b36d-af93-4e66-8e07-8b8cc2e020ea-tmp\") pod \"klusterlet-addon-workmgr-664cfc66bc-gc8wq\" (UID: \"58e7b36d-af93-4e66-8e07-8b8cc2e020ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664cfc66bc-gc8wq"
Sep 07 22:58:47.010503 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:47.010449    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/58e7b36d-af93-4e66-8e07-8b8cc2e020ea-klusterlet-config\") pod \"klusterlet-addon-workmgr-664cfc66bc-gc8wq\" (UID: \"58e7b36d-af93-4e66-8e07-8b8cc2e020ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664cfc66bc-gc8wq"
Sep 07 22:58:47.111042 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:47.111011    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58e7b36d-af93-4e66-8e07-8b8cc2e020ea-tmp\") pod \"klusterlet-addon-workmgr-664cfc66bc-gc8wq\" (UID: \"58e7b36d-af93-4e66-8e07-8b8cc2e020ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664cfc66bc-gc8wq"
Sep 07 22:58:47.111042 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:47.111047    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/58e7b36d-af93-4e66-8e07-8b8cc2e020ea-klusterlet-config\") pod \"klusterlet-addon-workmgr-664cfc66bc-gc8wq\" (UID: \"58e7b36d-af93-4e66-8e07-8b8cc2e020ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664cfc66bc-gc8wq"
Sep 07 22:58:47.111153 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:47.111108    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg7w2\" (UniqueName: \"kubernetes.io/projected/58e7b36d-af93-4e66-8e07-8b8cc2e020ea-kube-api-access-zg7w2\") pod \"klusterlet-addon-workmgr-664cfc66bc-gc8wq\" (UID: \"58e7b36d-af93-4e66-8e07-8b8cc2e020ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664cfc66bc-gc8wq"
Sep 07 22:58:47.111380 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:47.111363    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58e7b36d-af93-4e66-8e07-8b8cc2e020ea-tmp\") pod \"klusterlet-addon-workmgr-664cfc66bc-gc8wq\" (UID: \"58e7b36d-af93-4e66-8e07-8b8cc2e020ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664cfc66bc-gc8wq"
Sep 07 22:58:47.113445 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:47.113426    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/58e7b36d-af93-4e66-8e07-8b8cc2e020ea-klusterlet-config\") pod \"klusterlet-addon-workmgr-664cfc66bc-gc8wq\" (UID: \"58e7b36d-af93-4e66-8e07-8b8cc2e020ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664cfc66bc-gc8wq"
Sep 07 22:58:47.120612 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:47.120592    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg7w2\" (UniqueName: \"kubernetes.io/projected/58e7b36d-af93-4e66-8e07-8b8cc2e020ea-kube-api-access-zg7w2\") pod \"klusterlet-addon-workmgr-664cfc66bc-gc8wq\" (UID: \"58e7b36d-af93-4e66-8e07-8b8cc2e020ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664cfc66bc-gc8wq"
Sep 07 22:58:47.196608 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:47.196558    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664cfc66bc-gc8wq"
Sep 07 22:58:47.478449 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:47.478358    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-664cfc66bc-gc8wq"]
Sep 07 22:58:47.481888 ip-10-0-133-218 kubenswrapper[2557]: W0907 22:58:47.481861    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58e7b36d_af93_4e66_8e07_8b8cc2e020ea.slice/crio-2179cc815ad3ea28662b5ae03f243dc277d2d38adb47d102781f380212ca2d92 WatchSource:0}: Error finding container 2179cc815ad3ea28662b5ae03f243dc277d2d38adb47d102781f380212ca2d92: Status 404 returned error can't find the container with id 2179cc815ad3ea28662b5ae03f243dc277d2d38adb47d102781f380212ca2d92
Sep 07 22:58:48.334999 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:48.334960    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664cfc66bc-gc8wq" event={"ID":"58e7b36d-af93-4e66-8e07-8b8cc2e020ea","Type":"ContainerStarted","Data":"2179cc815ad3ea28662b5ae03f243dc277d2d38adb47d102781f380212ca2d92"}
Sep 07 22:58:51.344374 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:51.344332    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664cfc66bc-gc8wq" event={"ID":"58e7b36d-af93-4e66-8e07-8b8cc2e020ea","Type":"ContainerStarted","Data":"e18d7d7c0450a0cb62791cdd06b3aaf4a2e49532f1acaec99889475aa760884e"}
Sep 07 22:58:51.344734 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:51.344523    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664cfc66bc-gc8wq"
Sep 07 22:58:51.345786 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:51.345767    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664cfc66bc-gc8wq"
Sep 07 22:58:51.358397 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:51.358326    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664cfc66bc-gc8wq" podStartSLOduration=1.736783245 podStartE2EDuration="5.358314683s" totalImagesPullingTime="3.621531438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 22:58:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 22:58:51.357610537 +0000 UTC m=+122.986092871" watchObservedRunningTime="2026-09-07 22:58:51.358314683 +0000 UTC m=+122.986797018"
Sep 07 22:58:58.594549 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:58:58.594500    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs\") pod \"network-metrics-daemon-9wwxc\" (UID: \"a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff\") " pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 22:58:58.595130 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:58:58.594676    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 07 22:58:58.595130 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:58:58.594758    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs podName:a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff nodeName:}" failed. No retries permitted until 2026-09-07 23:01:00.594735607 +0000 UTC m=+252.223217939 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs") pod "network-metrics-daemon-9wwxc" (UID: "a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff") : secret "metrics-daemon-secret" not found
Sep 07 22:59:25.739586 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:59:25.739538    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw" podUID="39023548-2a42-458f-adba-bc61a7cd6955"
Sep 07 22:59:25.747676 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:59:25.747654    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-79977f9844-dtxv7" podUID="d6c9a39c-171b-4644-9e98-c5dd3ae84d3b"
Sep 07 22:59:25.760973 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:59:25.760955    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-d8gbl" podUID="e5b50755-c1fd-418a-9291-74b579b6c4a4"
Sep 07 22:59:26.425675 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:59:26.425643    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d8gbl"
Sep 07 22:59:26.425838 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:59:26.425643    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:59:26.425838 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:59:26.425649    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-dtxv7"
Sep 07 22:59:26.880554 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:59:26.880518    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9wwxc" podUID="a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff"
Sep 07 22:59:30.620296 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:59:30.620259    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 22:59:30.620693 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:59:30.620313    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls\") pod \"dns-default-d8gbl\" (UID: \"e5b50755-c1fd-418a-9291-74b579b6c4a4\") " pod="openshift-dns/dns-default-d8gbl"
Sep 07 22:59:30.620693 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:59:30.620394    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 22:59:30.620693 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:59:30.620406    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 22:59:30.620693 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:59:30.620429    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b6f776cf4-ptqxw: secret "image-registry-tls" not found
Sep 07 22:59:30.620693 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:59:30.620429    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-dtxv7\" (UID: \"d6c9a39c-171b-4644-9e98-c5dd3ae84d3b\") " pod="openshift-network-console/networking-console-plugin-79977f9844-dtxv7"
Sep 07 22:59:30.620693 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:59:30.620462    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls podName:e5b50755-c1fd-418a-9291-74b579b6c4a4 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:32.620447849 +0000 UTC m=+284.248930162 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls") pod "dns-default-d8gbl" (UID: "e5b50755-c1fd-418a-9291-74b579b6c4a4") : secret "dns-default-metrics-tls" not found
Sep 07 22:59:30.620693 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:59:30.620491    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls podName:39023548-2a42-458f-adba-bc61a7cd6955 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:32.62047427 +0000 UTC m=+284.248956600 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls") pod "image-registry-b6f776cf4-ptqxw" (UID: "39023548-2a42-458f-adba-bc61a7cd6955") : secret "image-registry-tls" not found
Sep 07 22:59:30.620693 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:59:30.620505    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 07 22:59:30.620693 ip-10-0-133-218 kubenswrapper[2557]: E0907 22:59:30.620555    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert podName:d6c9a39c-171b-4644-9e98-c5dd3ae84d3b nodeName:}" failed. No retries permitted until 2026-09-07 23:01:32.620542798 +0000 UTC m=+284.249025138 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-dtxv7" (UID: "d6c9a39c-171b-4644-9e98-c5dd3ae84d3b") : secret "networking-console-plugin-cert" not found
Sep 07 22:59:38.872182 ip-10-0-133-218 kubenswrapper[2557]: I0907 22:59:38.872146    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 23:00:51.345552 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:00:51.345506    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664cfc66bc-gc8wq" podUID="58e7b36d-af93-4e66-8e07-8b8cc2e020ea" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/readyz\": dial tcp 10.132.0.10:8000: connect: connection refused"
Sep 07 23:00:51.625533 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:00:51.625499    2557 generic.go:356] "Generic (PLEG): container finished" podID="58e7b36d-af93-4e66-8e07-8b8cc2e020ea" containerID="e18d7d7c0450a0cb62791cdd06b3aaf4a2e49532f1acaec99889475aa760884e" exitCode=1
Sep 07 23:00:51.625668 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:00:51.625570    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664cfc66bc-gc8wq" event={"ID":"58e7b36d-af93-4e66-8e07-8b8cc2e020ea","Type":"ContainerDied","Data":"e18d7d7c0450a0cb62791cdd06b3aaf4a2e49532f1acaec99889475aa760884e"}
Sep 07 23:00:51.625884 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:00:51.625871    2557 scope.go:117] "RemoveContainer" containerID="e18d7d7c0450a0cb62791cdd06b3aaf4a2e49532f1acaec99889475aa760884e"
Sep 07 23:00:52.630325 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:00:52.630292    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664cfc66bc-gc8wq" event={"ID":"58e7b36d-af93-4e66-8e07-8b8cc2e020ea","Type":"ContainerStarted","Data":"9cb95453be37064c1eb969a370307d6ad27cd4917f375589fdcddde1f80c508c"}
Sep 07 23:00:52.630722 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:00:52.630573    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664cfc66bc-gc8wq"
Sep 07 23:00:52.631148 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:00:52.631130    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664cfc66bc-gc8wq"
Sep 07 23:01:00.615616 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:00.615562    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs\") pod \"network-metrics-daemon-9wwxc\" (UID: \"a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff\") " pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 23:01:00.616097 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:00.615716    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 07 23:01:00.616097 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:00.615790    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs podName:a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff nodeName:}" failed. No retries permitted until 2026-09-07 23:03:02.615773017 +0000 UTC m=+374.244255335 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs") pod "network-metrics-daemon-9wwxc" (UID: "a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff") : secret "metrics-daemon-secret" not found
Sep 07 23:01:08.344710 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.344675    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-mrkf4"]
Sep 07 23:01:08.347884 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.347860    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mrkf4"
Sep 07 23:01:08.348566 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.348539    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-79fdf4c694-bqmz4"]
Sep 07 23:01:08.350644 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.350625    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-whkmt\""
Sep 07 23:01:08.350878 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.350861    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 07 23:01:08.351217 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.351202    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:08.351516 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.351449    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 07 23:01:08.351663 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.351597    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 07 23:01:08.351730 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.351704    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 07 23:01:08.354530 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.354509    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 07 23:01:08.354740 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.354722    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 07 23:01:08.354740 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.354734    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vhn6t\""
Sep 07 23:01:08.354884 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.354752    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 07 23:01:08.354884 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.354878    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 07 23:01:08.355018 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.354978    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 07 23:01:08.355218 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.355202    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 07 23:01:08.361887 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.361868    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-mrkf4"]
Sep 07 23:01:08.374202 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.374183    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79fdf4c694-bqmz4"]
Sep 07 23:01:08.472788 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.472763    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a445422f-9995-4e11-88d9-b896c2070032-default-certificate\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:08.472894 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.472834    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b5bbe966-bf44-4edd-8221-7c56c60a9668-serving-cert\") pod \"service-ca-operator-859f94c4b-mrkf4\" (UID: \"b5bbe966-bf44-4edd-8221-7c56c60a9668\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mrkf4"
Sep 07 23:01:08.472894 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.472861    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a445422f-9995-4e11-88d9-b896c2070032-metrics-certs\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:08.473037 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.472899    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b5bbe966-bf44-4edd-8221-7c56c60a9668-config\") pod \"service-ca-operator-859f94c4b-mrkf4\" (UID: \"b5bbe966-bf44-4edd-8221-7c56c60a9668\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mrkf4"
Sep 07 23:01:08.473037 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.472941    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q4m5\" (UniqueName: \"kubernetes.io/projected/a445422f-9995-4e11-88d9-b896c2070032-kube-api-access-2q4m5\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:08.473037 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.472982    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a445422f-9995-4e11-88d9-b896c2070032-service-ca-bundle\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:08.473037 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.473009    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzfst\" (UniqueName: \"kubernetes.io/projected/b5bbe966-bf44-4edd-8221-7c56c60a9668-kube-api-access-wzfst\") pod \"service-ca-operator-859f94c4b-mrkf4\" (UID: \"b5bbe966-bf44-4edd-8221-7c56c60a9668\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mrkf4"
Sep 07 23:01:08.473196 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.473069    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a445422f-9995-4e11-88d9-b896c2070032-stats-auth\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:08.573525 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.573501    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a445422f-9995-4e11-88d9-b896c2070032-stats-auth\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:08.573610 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.573529    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a445422f-9995-4e11-88d9-b896c2070032-default-certificate\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:08.573610 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.573568    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b5bbe966-bf44-4edd-8221-7c56c60a9668-serving-cert\") pod \"service-ca-operator-859f94c4b-mrkf4\" (UID: \"b5bbe966-bf44-4edd-8221-7c56c60a9668\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mrkf4"
Sep 07 23:01:08.573610 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.573584    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a445422f-9995-4e11-88d9-b896c2070032-metrics-certs\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:08.573737 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.573620    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b5bbe966-bf44-4edd-8221-7c56c60a9668-config\") pod \"service-ca-operator-859f94c4b-mrkf4\" (UID: \"b5bbe966-bf44-4edd-8221-7c56c60a9668\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mrkf4"
Sep 07 23:01:08.573737 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.573646    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q4m5\" (UniqueName: \"kubernetes.io/projected/a445422f-9995-4e11-88d9-b896c2070032-kube-api-access-2q4m5\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:08.573737 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.573685    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a445422f-9995-4e11-88d9-b896c2070032-service-ca-bundle\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:08.573737 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:08.573712    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 07 23:01:08.573959 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:08.573785    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a445422f-9995-4e11-88d9-b896c2070032-metrics-certs podName:a445422f-9995-4e11-88d9-b896c2070032 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:09.073765922 +0000 UTC m=+260.702248252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a445422f-9995-4e11-88d9-b896c2070032-metrics-certs") pod "router-default-79fdf4c694-bqmz4" (UID: "a445422f-9995-4e11-88d9-b896c2070032") : secret "router-metrics-certs-default" not found
Sep 07 23:01:08.573959 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.573714    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzfst\" (UniqueName: \"kubernetes.io/projected/b5bbe966-bf44-4edd-8221-7c56c60a9668-kube-api-access-wzfst\") pod \"service-ca-operator-859f94c4b-mrkf4\" (UID: \"b5bbe966-bf44-4edd-8221-7c56c60a9668\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mrkf4"
Sep 07 23:01:08.574076 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:08.573956    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a445422f-9995-4e11-88d9-b896c2070032-service-ca-bundle podName:a445422f-9995-4e11-88d9-b896c2070032 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:09.073937005 +0000 UTC m=+260.702419335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a445422f-9995-4e11-88d9-b896c2070032-service-ca-bundle") pod "router-default-79fdf4c694-bqmz4" (UID: "a445422f-9995-4e11-88d9-b896c2070032") : configmap references non-existent config key: service-ca.crt
Sep 07 23:01:08.574291 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.574273    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b5bbe966-bf44-4edd-8221-7c56c60a9668-config\") pod \"service-ca-operator-859f94c4b-mrkf4\" (UID: \"b5bbe966-bf44-4edd-8221-7c56c60a9668\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mrkf4"
Sep 07 23:01:08.575880 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.575862    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b5bbe966-bf44-4edd-8221-7c56c60a9668-serving-cert\") pod \"service-ca-operator-859f94c4b-mrkf4\" (UID: \"b5bbe966-bf44-4edd-8221-7c56c60a9668\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mrkf4"
Sep 07 23:01:08.576060 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.576043    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a445422f-9995-4e11-88d9-b896c2070032-default-certificate\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:08.576123 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.576091    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a445422f-9995-4e11-88d9-b896c2070032-stats-auth\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:08.581416 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.581394    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzfst\" (UniqueName: \"kubernetes.io/projected/b5bbe966-bf44-4edd-8221-7c56c60a9668-kube-api-access-wzfst\") pod \"service-ca-operator-859f94c4b-mrkf4\" (UID: \"b5bbe966-bf44-4edd-8221-7c56c60a9668\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mrkf4"
Sep 07 23:01:08.582990 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.582972    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q4m5\" (UniqueName: \"kubernetes.io/projected/a445422f-9995-4e11-88d9-b896c2070032-kube-api-access-2q4m5\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:08.658397 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.658367    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mrkf4"
Sep 07 23:01:08.924009 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:08.923943    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-mrkf4"]
Sep 07 23:01:08.926853 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:01:08.926829    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5bbe966_bf44_4edd_8221_7c56c60a9668.slice/crio-67e956bb7681935be6b48b2cb01706d7e9035780c21cdfd5bfcdacba005e4513 WatchSource:0}: Error finding container 67e956bb7681935be6b48b2cb01706d7e9035780c21cdfd5bfcdacba005e4513: Status 404 returned error can't find the container with id 67e956bb7681935be6b48b2cb01706d7e9035780c21cdfd5bfcdacba005e4513
Sep 07 23:01:09.077314 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:09.077276    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a445422f-9995-4e11-88d9-b896c2070032-service-ca-bundle\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:09.077422 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:09.077365    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a445422f-9995-4e11-88d9-b896c2070032-metrics-certs\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:09.077466 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:09.077429    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a445422f-9995-4e11-88d9-b896c2070032-service-ca-bundle podName:a445422f-9995-4e11-88d9-b896c2070032 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:10.077411811 +0000 UTC m=+261.705894149 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a445422f-9995-4e11-88d9-b896c2070032-service-ca-bundle") pod "router-default-79fdf4c694-bqmz4" (UID: "a445422f-9995-4e11-88d9-b896c2070032") : configmap references non-existent config key: service-ca.crt
Sep 07 23:01:09.077466 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:09.077457    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 07 23:01:09.077536 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:09.077494    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a445422f-9995-4e11-88d9-b896c2070032-metrics-certs podName:a445422f-9995-4e11-88d9-b896c2070032 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:10.077482947 +0000 UTC m=+261.705965260 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a445422f-9995-4e11-88d9-b896c2070032-metrics-certs") pod "router-default-79fdf4c694-bqmz4" (UID: "a445422f-9995-4e11-88d9-b896c2070032") : secret "router-metrics-certs-default" not found
Sep 07 23:01:09.679886 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:09.679854    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mrkf4" event={"ID":"b5bbe966-bf44-4edd-8221-7c56c60a9668","Type":"ContainerStarted","Data":"67e956bb7681935be6b48b2cb01706d7e9035780c21cdfd5bfcdacba005e4513"}
Sep 07 23:01:10.085728 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:10.085649    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a445422f-9995-4e11-88d9-b896c2070032-service-ca-bundle\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:10.085898 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:10.085760    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a445422f-9995-4e11-88d9-b896c2070032-metrics-certs\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:10.085898 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:10.085832    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a445422f-9995-4e11-88d9-b896c2070032-service-ca-bundle podName:a445422f-9995-4e11-88d9-b896c2070032 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:12.085810811 +0000 UTC m=+263.714293138 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a445422f-9995-4e11-88d9-b896c2070032-service-ca-bundle") pod "router-default-79fdf4c694-bqmz4" (UID: "a445422f-9995-4e11-88d9-b896c2070032") : configmap references non-existent config key: service-ca.crt
Sep 07 23:01:10.085898 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:10.085866    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 07 23:01:10.086078 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:10.085935    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a445422f-9995-4e11-88d9-b896c2070032-metrics-certs podName:a445422f-9995-4e11-88d9-b896c2070032 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:12.085899697 +0000 UTC m=+263.714382010 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a445422f-9995-4e11-88d9-b896c2070032-metrics-certs") pod "router-default-79fdf4c694-bqmz4" (UID: "a445422f-9995-4e11-88d9-b896c2070032") : secret "router-metrics-certs-default" not found
Sep 07 23:01:11.687193 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:11.687106    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mrkf4" event={"ID":"b5bbe966-bf44-4edd-8221-7c56c60a9668","Type":"ContainerStarted","Data":"dd36e22b30482e938439fd31a58a30eef16043274e8d4d62d29d88bce678d652"}
Sep 07 23:01:11.700636 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:11.700591    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mrkf4" podStartSLOduration=1.845622601 podStartE2EDuration="3.700577814s" totalImagesPullingTime="1.854955213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:01:11.700543831 +0000 UTC m=+263.329026162" watchObservedRunningTime="2026-09-07 23:01:11.700577814 +0000 UTC m=+263.329060197"
Sep 07 23:01:12.100847 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:12.100762    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a445422f-9995-4e11-88d9-b896c2070032-metrics-certs\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:12.100847 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:12.100822    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a445422f-9995-4e11-88d9-b896c2070032-service-ca-bundle\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:12.101063 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:12.100900    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 07 23:01:12.101063 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:12.100929    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a445422f-9995-4e11-88d9-b896c2070032-service-ca-bundle podName:a445422f-9995-4e11-88d9-b896c2070032 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:16.100901011 +0000 UTC m=+267.729383339 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a445422f-9995-4e11-88d9-b896c2070032-service-ca-bundle") pod "router-default-79fdf4c694-bqmz4" (UID: "a445422f-9995-4e11-88d9-b896c2070032") : configmap references non-existent config key: service-ca.crt
Sep 07 23:01:12.101063 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:12.100971    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a445422f-9995-4e11-88d9-b896c2070032-metrics-certs podName:a445422f-9995-4e11-88d9-b896c2070032 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:16.100956108 +0000 UTC m=+267.729438421 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a445422f-9995-4e11-88d9-b896c2070032-metrics-certs") pod "router-default-79fdf4c694-bqmz4" (UID: "a445422f-9995-4e11-88d9-b896c2070032") : secret "router-metrics-certs-default" not found
Sep 07 23:01:12.778073 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:12.778043    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6n8kh"]
Sep 07 23:01:12.781041 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:12.781023    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:12.783291 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:12.783264    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 07 23:01:12.783404 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:12.783299    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s9lzk\""
Sep 07 23:01:12.783404 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:12.783307    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 07 23:01:12.784391 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:12.784375    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 07 23:01:12.784391 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:12.784384    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 07 23:01:12.791250 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:12.791231    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6n8kh"]
Sep 07 23:01:12.907529 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:12.907505    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:12.907640 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:12.907554    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-crio-socket\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:12.907640 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:12.907599    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-data-volume\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:12.907725 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:12.907656    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j47hh\" (UniqueName: \"kubernetes.io/projected/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-kube-api-access-j47hh\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:12.907725 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:12.907698    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:13.008364 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:13.008336    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-crio-socket\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:13.008458 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:13.008372    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-data-volume\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:13.008458 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:13.008398    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j47hh\" (UniqueName: \"kubernetes.io/projected/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-kube-api-access-j47hh\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:13.008535 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:13.008455    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-crio-socket\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:13.008535 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:13.008458    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:13.008535 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:13.008510    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 23:01:13.008535 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:13.008523    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:13.008685 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:13.008565    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-kube-rbac-proxy-cm podName:3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f nodeName:}" failed. No retries permitted until 2026-09-07 23:01:13.508546083 +0000 UTC m=+265.137028399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6n8kh" (UID: "3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f") : configmap "kube-rbac-proxy" not found
Sep 07 23:01:13.008685 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:13.008606    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 23:01:13.008685 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:13.008648    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-insights-runtime-extractor-tls podName:3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f nodeName:}" failed. No retries permitted until 2026-09-07 23:01:13.508639288 +0000 UTC m=+265.137121615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6n8kh" (UID: "3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f") : secret "insights-runtime-extractor-tls" not found
Sep 07 23:01:13.008814 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:13.008745    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-data-volume\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:13.019712 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:13.019692    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j47hh\" (UniqueName: \"kubernetes.io/projected/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-kube-api-access-j47hh\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:13.325063 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:13.325033    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-pv274"]
Sep 07 23:01:13.328049 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:13.328025    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-pv274"
Sep 07 23:01:13.330251 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:13.330230    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 07 23:01:13.330365 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:13.330230    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-nlt2z\""
Sep 07 23:01:13.331403 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:13.331381    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 07 23:01:13.336033 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:13.336010    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-pv274"]
Sep 07 23:01:13.411453 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:13.411426    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tztk7\" (UniqueName: \"kubernetes.io/projected/170e899e-0597-4720-ba11-64ee6f4588b0-kube-api-access-tztk7\") pod \"migrator-fdbb8fdff-pv274\" (UID: \"170e899e-0597-4720-ba11-64ee6f4588b0\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-pv274"
Sep 07 23:01:13.511790 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:13.511761    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:13.511905 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:13.511814    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:13.511905 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:13.511874    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 23:01:13.511905 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:13.511890    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tztk7\" (UniqueName: \"kubernetes.io/projected/170e899e-0597-4720-ba11-64ee6f4588b0-kube-api-access-tztk7\") pod \"migrator-fdbb8fdff-pv274\" (UID: \"170e899e-0597-4720-ba11-64ee6f4588b0\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-pv274"
Sep 07 23:01:13.512114 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:13.511948    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-kube-rbac-proxy-cm podName:3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f nodeName:}" failed. No retries permitted until 2026-09-07 23:01:14.511933248 +0000 UTC m=+266.140415587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6n8kh" (UID: "3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f") : configmap "kube-rbac-proxy" not found
Sep 07 23:01:13.512114 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:13.511971    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 23:01:13.512114 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:13.512017    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-insights-runtime-extractor-tls podName:3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f nodeName:}" failed. No retries permitted until 2026-09-07 23:01:14.51200574 +0000 UTC m=+266.140488054 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6n8kh" (UID: "3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f") : secret "insights-runtime-extractor-tls" not found
Sep 07 23:01:13.521481 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:13.521458    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tztk7\" (UniqueName: \"kubernetes.io/projected/170e899e-0597-4720-ba11-64ee6f4588b0-kube-api-access-tztk7\") pod \"migrator-fdbb8fdff-pv274\" (UID: \"170e899e-0597-4720-ba11-64ee6f4588b0\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-pv274"
Sep 07 23:01:13.637477 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:13.637454    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-pv274"
Sep 07 23:01:13.901127 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:13.900947    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-pv274"]
Sep 07 23:01:13.903242 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:01:13.903215    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod170e899e_0597_4720_ba11_64ee6f4588b0.slice/crio-1d5553bcfda2143df06e7d3373563d7eb9d845b519196384b3e29283a661c377 WatchSource:0}: Error finding container 1d5553bcfda2143df06e7d3373563d7eb9d845b519196384b3e29283a661c377: Status 404 returned error can't find the container with id 1d5553bcfda2143df06e7d3373563d7eb9d845b519196384b3e29283a661c377
Sep 07 23:01:14.519584 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:14.519554    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:14.519768 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:14.519598    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:14.519768 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:14.519674    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 23:01:14.519768 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:14.519742    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-kube-rbac-proxy-cm podName:3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f nodeName:}" failed. No retries permitted until 2026-09-07 23:01:16.519723985 +0000 UTC m=+268.148206313 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6n8kh" (UID: "3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f") : configmap "kube-rbac-proxy" not found
Sep 07 23:01:14.519768 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:14.519684    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 23:01:14.520011 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:14.519803    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-insights-runtime-extractor-tls podName:3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f nodeName:}" failed. No retries permitted until 2026-09-07 23:01:16.519790853 +0000 UTC m=+268.148273166 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6n8kh" (UID: "3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f") : secret "insights-runtime-extractor-tls" not found
Sep 07 23:01:14.641054 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:14.641033    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9fnns_15cf1f7c-7686-47db-83a3-431fa37e2050/dns-node-resolver/0.log"
Sep 07 23:01:14.700386 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:14.700356    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-pv274" event={"ID":"170e899e-0597-4720-ba11-64ee6f4588b0","Type":"ContainerStarted","Data":"1d5553bcfda2143df06e7d3373563d7eb9d845b519196384b3e29283a661c377"}
Sep 07 23:01:15.641071 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:15.641043    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6c8dw_be6f18f7-5628-458a-93fe-962199c8f623/node-ca/0.log"
Sep 07 23:01:15.704316 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:15.704246    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-pv274" event={"ID":"170e899e-0597-4720-ba11-64ee6f4588b0","Type":"ContainerStarted","Data":"26e3501a1b3ccea08f8780049538978844dd1d7152bf7b04a6e1237e2390a94d"}
Sep 07 23:01:15.704316 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:15.704298    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-pv274" event={"ID":"170e899e-0597-4720-ba11-64ee6f4588b0","Type":"ContainerStarted","Data":"9c21fba584a88097f6ecb3a159690e69637dce484bc0d47ab28e6977d60dc925"}
Sep 07 23:01:15.722054 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:15.722002    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-pv274" podStartSLOduration=1.214140955 podStartE2EDuration="2.721986265s" totalImagesPullingTime="1.50784531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:01:15.721797981 +0000 UTC m=+267.350280317" watchObservedRunningTime="2026-09-07 23:01:15.721986265 +0000 UTC m=+267.350468601"
Sep 07 23:01:16.131143 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:16.131115    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a445422f-9995-4e11-88d9-b896c2070032-metrics-certs\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:16.131315 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:16.131204    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a445422f-9995-4e11-88d9-b896c2070032-service-ca-bundle\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:16.131315 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:16.131251    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 07 23:01:16.131315 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:16.131308    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a445422f-9995-4e11-88d9-b896c2070032-metrics-certs podName:a445422f-9995-4e11-88d9-b896c2070032 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:24.131293497 +0000 UTC m=+275.759775809 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a445422f-9995-4e11-88d9-b896c2070032-metrics-certs") pod "router-default-79fdf4c694-bqmz4" (UID: "a445422f-9995-4e11-88d9-b896c2070032") : secret "router-metrics-certs-default" not found
Sep 07 23:01:16.131439 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:16.131343    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a445422f-9995-4e11-88d9-b896c2070032-service-ca-bundle podName:a445422f-9995-4e11-88d9-b896c2070032 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:24.131327038 +0000 UTC m=+275.759809350 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a445422f-9995-4e11-88d9-b896c2070032-service-ca-bundle") pod "router-default-79fdf4c694-bqmz4" (UID: "a445422f-9995-4e11-88d9-b896c2070032") : configmap references non-existent config key: service-ca.crt
Sep 07 23:01:16.535524 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:16.535436    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:16.535524 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:16.535480    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:16.535728 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:16.535560    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 23:01:16.535728 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:16.535572    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 23:01:16.535728 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:16.535627    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-kube-rbac-proxy-cm podName:3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f nodeName:}" failed. No retries permitted until 2026-09-07 23:01:20.535606697 +0000 UTC m=+272.164089010 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6n8kh" (UID: "3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f") : configmap "kube-rbac-proxy" not found
Sep 07 23:01:16.535728 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:16.535644    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-insights-runtime-extractor-tls podName:3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f nodeName:}" failed. No retries permitted until 2026-09-07 23:01:20.5356363 +0000 UTC m=+272.164118618 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6n8kh" (UID: "3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f") : secret "insights-runtime-extractor-tls" not found
Sep 07 23:01:16.841611 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:16.841543    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zqpbc_d155f254-2c44-4d90-97d8-e182e06fbee7/serve-healthcheck-canary/0.log"
Sep 07 23:01:20.563633 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:20.563600    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:20.564074 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:20.563651    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:20.564074 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:20.563722    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 23:01:20.564074 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:20.563788    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-kube-rbac-proxy-cm podName:3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f nodeName:}" failed. No retries permitted until 2026-09-07 23:01:28.563767736 +0000 UTC m=+280.192250069 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6n8kh" (UID: "3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f") : configmap "kube-rbac-proxy" not found
Sep 07 23:01:20.564074 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:20.563813    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 23:01:20.564074 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:20.563849    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-insights-runtime-extractor-tls podName:3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f nodeName:}" failed. No retries permitted until 2026-09-07 23:01:28.56383853 +0000 UTC m=+280.192320843 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6n8kh" (UID: "3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f") : secret "insights-runtime-extractor-tls" not found
Sep 07 23:01:24.189476 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:24.189440    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a445422f-9995-4e11-88d9-b896c2070032-service-ca-bundle\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:24.189986 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:24.189556    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a445422f-9995-4e11-88d9-b896c2070032-metrics-certs\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:24.189986 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:24.189609    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a445422f-9995-4e11-88d9-b896c2070032-service-ca-bundle podName:a445422f-9995-4e11-88d9-b896c2070032 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:40.189587983 +0000 UTC m=+291.818070307 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a445422f-9995-4e11-88d9-b896c2070032-service-ca-bundle") pod "router-default-79fdf4c694-bqmz4" (UID: "a445422f-9995-4e11-88d9-b896c2070032") : configmap references non-existent config key: service-ca.crt
Sep 07 23:01:24.191893 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:24.191865    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a445422f-9995-4e11-88d9-b896c2070032-metrics-certs\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:28.625679 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:28.625626    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:28.626090 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:28.625704    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:28.626090 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:28.625818    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 23:01:28.626090 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:28.625896    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-insights-runtime-extractor-tls podName:3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f nodeName:}" failed. No retries permitted until 2026-09-07 23:01:44.625877235 +0000 UTC m=+296.254359566 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6n8kh" (UID: "3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f") : secret "insights-runtime-extractor-tls" not found
Sep 07 23:01:28.626301 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:28.626277    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:29.426403 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:29.426363    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-79977f9844-dtxv7" podUID="d6c9a39c-171b-4644-9e98-c5dd3ae84d3b"
Sep 07 23:01:29.426403 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:29.426374    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw" podUID="39023548-2a42-458f-adba-bc61a7cd6955"
Sep 07 23:01:29.426403 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:29.426378    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-d8gbl" podUID="e5b50755-c1fd-418a-9291-74b579b6c4a4"
Sep 07 23:01:29.749152 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:29.749076    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d8gbl"
Sep 07 23:01:29.749501 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:29.749076    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-dtxv7"
Sep 07 23:01:29.749501 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:29.749081    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 23:01:32.655228 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:32.655188    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 23:01:32.655735 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:32.655257    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls\") pod \"dns-default-d8gbl\" (UID: \"e5b50755-c1fd-418a-9291-74b579b6c4a4\") " pod="openshift-dns/dns-default-d8gbl"
Sep 07 23:01:32.655735 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:32.655286    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-dtxv7\" (UID: \"d6c9a39c-171b-4644-9e98-c5dd3ae84d3b\") " pod="openshift-network-console/networking-console-plugin-79977f9844-dtxv7"
Sep 07 23:01:32.657601 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:32.657575    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5b50755-c1fd-418a-9291-74b579b6c4a4-metrics-tls\") pod \"dns-default-d8gbl\" (UID: \"e5b50755-c1fd-418a-9291-74b579b6c4a4\") " pod="openshift-dns/dns-default-d8gbl"
Sep 07 23:01:32.657708 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:32.657627    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls\") pod \"image-registry-b6f776cf4-ptqxw\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") " pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 23:01:32.657708 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:32.657650    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6c9a39c-171b-4644-9e98-c5dd3ae84d3b-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-dtxv7\" (UID: \"d6c9a39c-171b-4644-9e98-c5dd3ae84d3b\") " pod="openshift-network-console/networking-console-plugin-79977f9844-dtxv7"
Sep 07 23:01:32.753422 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:32.753396    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nflgb\""
Sep 07 23:01:32.753422 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:32.753417    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nrmp6\""
Sep 07 23:01:32.753556 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:32.753417    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8zwjz\""
Sep 07 23:01:32.760780 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:32.760763    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-dtxv7"
Sep 07 23:01:32.760878 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:32.760783    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d8gbl"
Sep 07 23:01:32.760878 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:32.760866    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 23:01:33.041944 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:33.041752    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b6f776cf4-ptqxw"]
Sep 07 23:01:33.048440 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:33.048117    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d8gbl"]
Sep 07 23:01:33.049940 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:33.049377    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-dtxv7"]
Sep 07 23:01:33.763467 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:33.763430    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw" event={"ID":"39023548-2a42-458f-adba-bc61a7cd6955","Type":"ContainerStarted","Data":"396e07a2e722b1afa870fdabb49c178cd7d00bcf0e202b679be26976c12d1ce6"}
Sep 07 23:01:33.763979 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:33.763492    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw" event={"ID":"39023548-2a42-458f-adba-bc61a7cd6955","Type":"ContainerStarted","Data":"9e3b0ddc05781913f10ad8da5583d9fe97523f7404ac77d187a8bec6dcdf3e36"}
Sep 07 23:01:33.763979 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:33.763713    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 23:01:33.765202 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:33.765152    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-dtxv7" event={"ID":"d6c9a39c-171b-4644-9e98-c5dd3ae84d3b","Type":"ContainerStarted","Data":"0b42eb0080aeee0dc1997f9b302fa553c572c0ed45ff45dae1fcdd74cdededa4"}
Sep 07 23:01:33.766472 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:33.766448    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d8gbl" event={"ID":"e5b50755-c1fd-418a-9291-74b579b6c4a4","Type":"ContainerStarted","Data":"6fe1e49a98658b1a55e8b7ff220ec1470a0b4ab65e44c15f6ef4af01d872c794"}
Sep 07 23:01:33.784023 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:33.783800    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw" podStartSLOduration=284.783780717 podStartE2EDuration="4m44.783780717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 22:56:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:01:33.781823154 +0000 UTC m=+285.410305488" watchObservedRunningTime="2026-09-07 23:01:33.783780717 +0000 UTC m=+285.412263055"
Sep 07 23:01:35.773688 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:35.773651    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-dtxv7" event={"ID":"d6c9a39c-171b-4644-9e98-c5dd3ae84d3b","Type":"ContainerStarted","Data":"79f521b7d215599ba8278a762a3d3d5522765f83f25a414478b118278528a8f0"}
Sep 07 23:01:35.775377 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:35.775348    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d8gbl" event={"ID":"e5b50755-c1fd-418a-9291-74b579b6c4a4","Type":"ContainerStarted","Data":"2cf86e30cc5fd6bf4e39776a497d0004cd260f516a164ab95d6f70c9dc31f745"}
Sep 07 23:01:35.775483 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:35.775397    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d8gbl" event={"ID":"e5b50755-c1fd-418a-9291-74b579b6c4a4","Type":"ContainerStarted","Data":"fafa2fde3efa60635c385b576199364ffbf185a525985a1c2c3b28eec6b28231"}
Sep 07 23:01:35.775483 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:35.775427    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d8gbl"
Sep 07 23:01:35.791523 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:35.791477    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-dtxv7" podStartSLOduration=259.110070427 podStartE2EDuration="4m20.791462179s" totalImagesPullingTime="1.681391752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 22:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:01:35.790441817 +0000 UTC m=+287.418924164" watchObservedRunningTime="2026-09-07 23:01:35.791462179 +0000 UTC m=+287.419944514"
Sep 07 23:01:35.807677 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:35.807630    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-d8gbl" podStartSLOduration=252.084375965 podStartE2EDuration="4m13.807617088s" totalImagesPullingTime="1.723241123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 22:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:01:35.806610701 +0000 UTC m=+287.435093040" watchObservedRunningTime="2026-09-07 23:01:35.807617088 +0000 UTC m=+287.436099468"
Sep 07 23:01:40.207689 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:40.207655    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a445422f-9995-4e11-88d9-b896c2070032-service-ca-bundle\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:40.208273 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:40.208252    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a445422f-9995-4e11-88d9-b896c2070032-service-ca-bundle\") pod \"router-default-79fdf4c694-bqmz4\" (UID: \"a445422f-9995-4e11-88d9-b896c2070032\") " pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:40.462813 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:40.462735    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:40.731486 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:40.731418    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79fdf4c694-bqmz4"]
Sep 07 23:01:40.734654 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:01:40.734626    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda445422f_9995_4e11_88d9_b896c2070032.slice/crio-4a97990d81602075dcf75fe1146870668afc9195e52058b00d955e50254aa89c WatchSource:0}: Error finding container 4a97990d81602075dcf75fe1146870668afc9195e52058b00d955e50254aa89c: Status 404 returned error can't find the container with id 4a97990d81602075dcf75fe1146870668afc9195e52058b00d955e50254aa89c
Sep 07 23:01:40.791758 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:40.791721    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79fdf4c694-bqmz4" event={"ID":"a445422f-9995-4e11-88d9-b896c2070032","Type":"ContainerStarted","Data":"d26c227c09b04129a7e3588cc04deb614cab34b7757b1f4c2a9e43762359ac2d"}
Sep 07 23:01:40.791864 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:40.791764    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79fdf4c694-bqmz4" event={"ID":"a445422f-9995-4e11-88d9-b896c2070032","Type":"ContainerStarted","Data":"4a97990d81602075dcf75fe1146870668afc9195e52058b00d955e50254aa89c"}
Sep 07 23:01:40.807974 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:40.807929    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-79fdf4c694-bqmz4" podStartSLOduration=32.807900967 podStartE2EDuration="32.807900967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:01:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:01:40.807213319 +0000 UTC m=+292.435695653" watchObservedRunningTime="2026-09-07 23:01:40.807900967 +0000 UTC m=+292.436383301"
Sep 07 23:01:41.463669 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:41.463637    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:41.466282 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:41.466260    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:41.795357 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:41.795253    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:41.796514 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:41.796489    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-79fdf4c694-bqmz4"
Sep 07 23:01:41.873384 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:41.873356    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9wwxc" podUID="a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff"
Sep 07 23:01:44.638600 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:44.638561    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:44.640825 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:44.640799    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6n8kh\" (UID: \"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f\") " pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:44.889605 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:44.889543    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6n8kh"
Sep 07 23:01:45.155634 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:45.155554    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6n8kh"]
Sep 07 23:01:45.158203 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:01:45.158174    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b6ea64b_8b0b_4c8c_ab99_bbbb6166356f.slice/crio-9ba4baeb35649051ea7f93e1eec2bc25d68098b025fda816bbda49f5eb8c596f WatchSource:0}: Error finding container 9ba4baeb35649051ea7f93e1eec2bc25d68098b025fda816bbda49f5eb8c596f: Status 404 returned error can't find the container with id 9ba4baeb35649051ea7f93e1eec2bc25d68098b025fda816bbda49f5eb8c596f
Sep 07 23:01:45.780601 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:45.780569    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d8gbl"
Sep 07 23:01:45.811070 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:45.811025    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6n8kh" event={"ID":"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f","Type":"ContainerStarted","Data":"17029b25cd6982bfb612f27983e793016a6352054086f3415511f93f11fefb1b"}
Sep 07 23:01:45.811234 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:45.811089    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6n8kh" event={"ID":"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f","Type":"ContainerStarted","Data":"9ba4baeb35649051ea7f93e1eec2bc25d68098b025fda816bbda49f5eb8c596f"}
Sep 07 23:01:46.373678 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:46.373647    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-mq6gt"]
Sep 07 23:01:46.376678 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:46.376662    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-mq6gt"
Sep 07 23:01:46.378823 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:46.378794    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 07 23:01:46.379011 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:46.378800    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-v6qqs\""
Sep 07 23:01:46.379011 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:46.378809    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 07 23:01:46.379011 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:46.378844    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 07 23:01:46.379683 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:46.379666    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 07 23:01:46.379732 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:46.379686    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 07 23:01:46.385578 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:46.385556    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-mq6gt"]
Sep 07 23:01:46.449675 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:46.449653    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5028c95-12ed-45c7-8da2-c321bee5bc65-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-mq6gt\" (UID: \"c5028c95-12ed-45c7-8da2-c321bee5bc65\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mq6gt"
Sep 07 23:01:46.449771 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:46.449706    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5028c95-12ed-45c7-8da2-c321bee5bc65-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-mq6gt\" (UID: \"c5028c95-12ed-45c7-8da2-c321bee5bc65\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mq6gt"
Sep 07 23:01:46.449771 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:46.449758    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdcdg\" (UniqueName: \"kubernetes.io/projected/c5028c95-12ed-45c7-8da2-c321bee5bc65-kube-api-access-pdcdg\") pod \"prometheus-operator-6f4946db56-mq6gt\" (UID: \"c5028c95-12ed-45c7-8da2-c321bee5bc65\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mq6gt"
Sep 07 23:01:46.449845 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:46.449798    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5028c95-12ed-45c7-8da2-c321bee5bc65-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-mq6gt\" (UID: \"c5028c95-12ed-45c7-8da2-c321bee5bc65\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mq6gt"
Sep 07 23:01:46.550527 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:46.550464    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5028c95-12ed-45c7-8da2-c321bee5bc65-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-mq6gt\" (UID: \"c5028c95-12ed-45c7-8da2-c321bee5bc65\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mq6gt"
Sep 07 23:01:46.550527 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:46.550504    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdcdg\" (UniqueName: \"kubernetes.io/projected/c5028c95-12ed-45c7-8da2-c321bee5bc65-kube-api-access-pdcdg\") pod \"prometheus-operator-6f4946db56-mq6gt\" (UID: \"c5028c95-12ed-45c7-8da2-c321bee5bc65\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mq6gt"
Sep 07 23:01:46.550527 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:46.550530    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5028c95-12ed-45c7-8da2-c321bee5bc65-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-mq6gt\" (UID: \"c5028c95-12ed-45c7-8da2-c321bee5bc65\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mq6gt"
Sep 07 23:01:46.550678 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:46.550557    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5028c95-12ed-45c7-8da2-c321bee5bc65-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-mq6gt\" (UID: \"c5028c95-12ed-45c7-8da2-c321bee5bc65\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mq6gt"
Sep 07 23:01:46.550678 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:46.550657    2557 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 07 23:01:46.550746 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:46.550708    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5028c95-12ed-45c7-8da2-c321bee5bc65-prometheus-operator-tls podName:c5028c95-12ed-45c7-8da2-c321bee5bc65 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:47.050692028 +0000 UTC m=+298.679174357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/c5028c95-12ed-45c7-8da2-c321bee5bc65-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-mq6gt" (UID: "c5028c95-12ed-45c7-8da2-c321bee5bc65") : secret "prometheus-operator-tls" not found
Sep 07 23:01:46.551218 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:46.551203    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5028c95-12ed-45c7-8da2-c321bee5bc65-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-mq6gt\" (UID: \"c5028c95-12ed-45c7-8da2-c321bee5bc65\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mq6gt"
Sep 07 23:01:46.552836 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:46.552817    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5028c95-12ed-45c7-8da2-c321bee5bc65-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-mq6gt\" (UID: \"c5028c95-12ed-45c7-8da2-c321bee5bc65\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mq6gt"
Sep 07 23:01:46.558697 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:46.558680    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdcdg\" (UniqueName: \"kubernetes.io/projected/c5028c95-12ed-45c7-8da2-c321bee5bc65-kube-api-access-pdcdg\") pod \"prometheus-operator-6f4946db56-mq6gt\" (UID: \"c5028c95-12ed-45c7-8da2-c321bee5bc65\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mq6gt"
Sep 07 23:01:46.817697 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:46.817618    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6n8kh" event={"ID":"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f","Type":"ContainerStarted","Data":"c31dfa152c896c49825429d081b42f3365f462584d943751024bfc364d750a24"}
Sep 07 23:01:47.054066 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:47.054030    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5028c95-12ed-45c7-8da2-c321bee5bc65-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-mq6gt\" (UID: \"c5028c95-12ed-45c7-8da2-c321bee5bc65\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mq6gt"
Sep 07 23:01:47.056693 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:47.056668    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5028c95-12ed-45c7-8da2-c321bee5bc65-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-mq6gt\" (UID: \"c5028c95-12ed-45c7-8da2-c321bee5bc65\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mq6gt"
Sep 07 23:01:47.285347 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:47.285312    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-mq6gt"
Sep 07 23:01:47.772612 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:47.770024    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-mq6gt"]
Sep 07 23:01:47.776002 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:01:47.775974    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5028c95_12ed_45c7_8da2_c321bee5bc65.slice/crio-3e920882ad047f7f7025d8d65ceba49e604c41d2d058f8a892a6b3f19cb5f84d WatchSource:0}: Error finding container 3e920882ad047f7f7025d8d65ceba49e604c41d2d058f8a892a6b3f19cb5f84d: Status 404 returned error can't find the container with id 3e920882ad047f7f7025d8d65ceba49e604c41d2d058f8a892a6b3f19cb5f84d
Sep 07 23:01:47.821807 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:47.821745    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-mq6gt" event={"ID":"c5028c95-12ed-45c7-8da2-c321bee5bc65","Type":"ContainerStarted","Data":"3e920882ad047f7f7025d8d65ceba49e604c41d2d058f8a892a6b3f19cb5f84d"}
Sep 07 23:01:47.823759 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:47.823736    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6n8kh" event={"ID":"3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f","Type":"ContainerStarted","Data":"36e1d5d38ef27efc1c36c28734420b1861d6cac2aca6c12ca92e353d1a26c2bc"}
Sep 07 23:01:47.839258 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:47.839221    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6n8kh" podStartSLOduration=33.554348272 podStartE2EDuration="35.839210727s" totalImagesPullingTime="2.284862455s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 23:01:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:01:47.837723628 +0000 UTC m=+299.466205964" watchObservedRunningTime="2026-09-07 23:01:47.839210727 +0000 UTC m=+299.467693061"
Sep 07 23:01:48.794360 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:48.794329    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/ovn-acl-logging/0.log"
Sep 07 23:01:48.795317 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:48.795290    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/ovn-acl-logging/0.log"
Sep 07 23:01:48.803338 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:48.803318    2557 kubelet.go:1648] "Image garbage collection succeeded"
Sep 07 23:01:49.833315 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:49.833275    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-mq6gt" event={"ID":"c5028c95-12ed-45c7-8da2-c321bee5bc65","Type":"ContainerStarted","Data":"851663510c7414cb5cf3cdd7e2a614c63ca2439e30f473476a80803dfb1f4183"}
Sep 07 23:01:49.833719 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:49.833367    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-mq6gt" event={"ID":"c5028c95-12ed-45c7-8da2-c321bee5bc65","Type":"ContainerStarted","Data":"47842d92ccc1c074a773464514c575d5915fbda7a245742a6ba6ede4127e9751"}
Sep 07 23:01:49.848424 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:49.848378    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-mq6gt" podStartSLOduration=2.406989943 podStartE2EDuration="3.848364439s" totalImagesPullingTime="1.441374496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:01:49.847194096 +0000 UTC m=+301.475676432" watchObservedRunningTime="2026-09-07 23:01:49.848364439 +0000 UTC m=+301.476846774"
Sep 07 23:01:51.723447 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.723416    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-q2djh"]
Sep 07 23:01:51.726791 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.726771    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.729070 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.729048    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-876zr\""
Sep 07 23:01:51.729608 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.729342    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 07 23:01:51.729697 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.729383    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 07 23:01:51.729697 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.729426    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 07 23:01:51.785533 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.785514    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64f45b57-271c-4bdf-b3fc-35852e273be2-sys\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.785629 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.785544    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/64f45b57-271c-4bdf-b3fc-35852e273be2-node-exporter-accelerators-collector-config\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.785629 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.785561    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/64f45b57-271c-4bdf-b3fc-35852e273be2-node-exporter-tls\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.785629 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.785613    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64f45b57-271c-4bdf-b3fc-35852e273be2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.785756 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.785653    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/64f45b57-271c-4bdf-b3fc-35852e273be2-root\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.785756 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.785692    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64f45b57-271c-4bdf-b3fc-35852e273be2-metrics-client-ca\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.785756 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.785709    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/64f45b57-271c-4bdf-b3fc-35852e273be2-node-exporter-wtmp\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.785756 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.785733    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/64f45b57-271c-4bdf-b3fc-35852e273be2-node-exporter-textfile\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.785888 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.785764    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj22q\" (UniqueName: \"kubernetes.io/projected/64f45b57-271c-4bdf-b3fc-35852e273be2-kube-api-access-cj22q\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.886735 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.886705    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64f45b57-271c-4bdf-b3fc-35852e273be2-metrics-client-ca\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.886735 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.886737    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/64f45b57-271c-4bdf-b3fc-35852e273be2-node-exporter-wtmp\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.886953 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.886755    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/64f45b57-271c-4bdf-b3fc-35852e273be2-node-exporter-textfile\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.886953 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.886769    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj22q\" (UniqueName: \"kubernetes.io/projected/64f45b57-271c-4bdf-b3fc-35852e273be2-kube-api-access-cj22q\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.886953 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.886801    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64f45b57-271c-4bdf-b3fc-35852e273be2-sys\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.886953 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.886860    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64f45b57-271c-4bdf-b3fc-35852e273be2-sys\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.886953 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.886891    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/64f45b57-271c-4bdf-b3fc-35852e273be2-node-exporter-accelerators-collector-config\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.886953 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.886896    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/64f45b57-271c-4bdf-b3fc-35852e273be2-node-exporter-wtmp\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.886953 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.886941    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/64f45b57-271c-4bdf-b3fc-35852e273be2-node-exporter-tls\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.887283 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.887000    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64f45b57-271c-4bdf-b3fc-35852e273be2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.887283 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:51.887020    2557 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 07 23:01:51.887283 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.887047    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/64f45b57-271c-4bdf-b3fc-35852e273be2-root\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.887283 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:01:51.887075    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64f45b57-271c-4bdf-b3fc-35852e273be2-node-exporter-tls podName:64f45b57-271c-4bdf-b3fc-35852e273be2 nodeName:}" failed. No retries permitted until 2026-09-07 23:01:52.38705593 +0000 UTC m=+304.015538245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/64f45b57-271c-4bdf-b3fc-35852e273be2-node-exporter-tls") pod "node-exporter-q2djh" (UID: "64f45b57-271c-4bdf-b3fc-35852e273be2") : secret "node-exporter-tls" not found
Sep 07 23:01:51.887283 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.887087    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/64f45b57-271c-4bdf-b3fc-35852e273be2-root\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.887283 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.887155    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/64f45b57-271c-4bdf-b3fc-35852e273be2-node-exporter-textfile\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.887481 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.887369    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64f45b57-271c-4bdf-b3fc-35852e273be2-metrics-client-ca\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.887563 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.887542    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/64f45b57-271c-4bdf-b3fc-35852e273be2-node-exporter-accelerators-collector-config\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.889229 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.889213    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64f45b57-271c-4bdf-b3fc-35852e273be2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:51.894960 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:51.894936    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj22q\" (UniqueName: \"kubernetes.io/projected/64f45b57-271c-4bdf-b3fc-35852e273be2-kube-api-access-cj22q\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:52.390780 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:52.390748    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/64f45b57-271c-4bdf-b3fc-35852e273be2-node-exporter-tls\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:52.393053 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:52.393025    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/64f45b57-271c-4bdf-b3fc-35852e273be2-node-exporter-tls\") pod \"node-exporter-q2djh\" (UID: \"64f45b57-271c-4bdf-b3fc-35852e273be2\") " pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:52.636925 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:52.636888    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q2djh"
Sep 07 23:01:52.648658 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:01:52.648630    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64f45b57_271c_4bdf_b3fc_35852e273be2.slice/crio-792022ec98174c99b75654542ed476eb58216fbd79138a35c134de0b8c71de93 WatchSource:0}: Error finding container 792022ec98174c99b75654542ed476eb58216fbd79138a35c134de0b8c71de93: Status 404 returned error can't find the container with id 792022ec98174c99b75654542ed476eb58216fbd79138a35c134de0b8c71de93
Sep 07 23:01:52.651075 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:52.651054    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 23:01:52.764819 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:52.764790    2557 patch_prober.go:28] interesting pod/image-registry-b6f776cf4-ptqxw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 07 23:01:52.765263 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:52.764837    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw" podUID="39023548-2a42-458f-adba-bc61a7cd6955" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 23:01:52.844587 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:52.844552    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q2djh" event={"ID":"64f45b57-271c-4bdf-b3fc-35852e273be2","Type":"ContainerStarted","Data":"792022ec98174c99b75654542ed476eb58216fbd79138a35c134de0b8c71de93"}
Sep 07 23:01:52.871047 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:52.871018    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 23:01:53.849800 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:53.849764    2557 generic.go:356] "Generic (PLEG): container finished" podID="64f45b57-271c-4bdf-b3fc-35852e273be2" containerID="22f76c53bf6625747fcfe8d8ef9f69b9515c2f7950788ef0a7d9e725280cf090" exitCode=0
Sep 07 23:01:53.850134 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:53.849838    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q2djh" event={"ID":"64f45b57-271c-4bdf-b3fc-35852e273be2","Type":"ContainerDied","Data":"22f76c53bf6625747fcfe8d8ef9f69b9515c2f7950788ef0a7d9e725280cf090"}
Sep 07 23:01:54.773311 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:54.773284    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 23:01:54.855235 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:54.855200    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q2djh" event={"ID":"64f45b57-271c-4bdf-b3fc-35852e273be2","Type":"ContainerStarted","Data":"71df1ad3d5e88c1af6da80349f3c349f6e60a881c807e014048d7a276fa1fdbb"}
Sep 07 23:01:54.855681 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:54.855251    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q2djh" event={"ID":"64f45b57-271c-4bdf-b3fc-35852e273be2","Type":"ContainerStarted","Data":"18521721b645595919933ee136922304987dd41be85cd0136eb30661aaffc5b7"}
Sep 07 23:01:54.876196 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:54.876152    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-q2djh" podStartSLOduration=2.81306004 podStartE2EDuration="3.876138511s" totalImagesPullingTime="1.003484974s" totalInitContainerRuntime="59.593497ms" isStatefulPod=true podCreationTimestamp="2026-09-07 23:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:01:54.875350786 +0000 UTC m=+306.503833133" watchObservedRunningTime="2026-09-07 23:01:54.876138511 +0000 UTC m=+306.504620846"
Sep 07 23:01:56.126883 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.126850    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6478f78969-ccntq"]
Sep 07 23:01:56.129982 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.129966    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:01:56.132207 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.132183    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 07 23:01:56.132320 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.132226    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 07 23:01:56.133213 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.133188    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1evoubhqfruml\""
Sep 07 23:01:56.133331 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.133228    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-pw2sf\""
Sep 07 23:01:56.133331 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.133279    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 07 23:01:56.133442 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.133384    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 07 23:01:56.137510 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.137488    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6478f78969-ccntq"]
Sep 07 23:01:56.220824 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.220797    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6436db55-918b-4fac-8921-31480283cfc8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6478f78969-ccntq\" (UID: \"6436db55-918b-4fac-8921-31480283cfc8\") " pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:01:56.220824 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.220826    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfc4m\" (UniqueName: \"kubernetes.io/projected/6436db55-918b-4fac-8921-31480283cfc8-kube-api-access-zfc4m\") pod \"metrics-server-6478f78969-ccntq\" (UID: \"6436db55-918b-4fac-8921-31480283cfc8\") " pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:01:56.221028 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.220853    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6436db55-918b-4fac-8921-31480283cfc8-secret-metrics-server-client-certs\") pod \"metrics-server-6478f78969-ccntq\" (UID: \"6436db55-918b-4fac-8921-31480283cfc8\") " pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:01:56.221028 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.220869    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6436db55-918b-4fac-8921-31480283cfc8-audit-log\") pod \"metrics-server-6478f78969-ccntq\" (UID: \"6436db55-918b-4fac-8921-31480283cfc8\") " pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:01:56.221028 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.220890    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6436db55-918b-4fac-8921-31480283cfc8-metrics-server-audit-profiles\") pod \"metrics-server-6478f78969-ccntq\" (UID: \"6436db55-918b-4fac-8921-31480283cfc8\") " pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:01:56.221028 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.220963    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6436db55-918b-4fac-8921-31480283cfc8-secret-metrics-server-tls\") pod \"metrics-server-6478f78969-ccntq\" (UID: \"6436db55-918b-4fac-8921-31480283cfc8\") " pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:01:56.221028 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.220978    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6436db55-918b-4fac-8921-31480283cfc8-client-ca-bundle\") pod \"metrics-server-6478f78969-ccntq\" (UID: \"6436db55-918b-4fac-8921-31480283cfc8\") " pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:01:56.322224 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.322197    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6436db55-918b-4fac-8921-31480283cfc8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6478f78969-ccntq\" (UID: \"6436db55-918b-4fac-8921-31480283cfc8\") " pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:01:56.322365 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.322226    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfc4m\" (UniqueName: \"kubernetes.io/projected/6436db55-918b-4fac-8921-31480283cfc8-kube-api-access-zfc4m\") pod \"metrics-server-6478f78969-ccntq\" (UID: \"6436db55-918b-4fac-8921-31480283cfc8\") " pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:01:56.322365 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.322255    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6436db55-918b-4fac-8921-31480283cfc8-secret-metrics-server-client-certs\") pod \"metrics-server-6478f78969-ccntq\" (UID: \"6436db55-918b-4fac-8921-31480283cfc8\") " pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:01:56.322365 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.322278    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6436db55-918b-4fac-8921-31480283cfc8-audit-log\") pod \"metrics-server-6478f78969-ccntq\" (UID: \"6436db55-918b-4fac-8921-31480283cfc8\") " pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:01:56.322491 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.322392    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6436db55-918b-4fac-8921-31480283cfc8-metrics-server-audit-profiles\") pod \"metrics-server-6478f78969-ccntq\" (UID: \"6436db55-918b-4fac-8921-31480283cfc8\") " pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:01:56.322565 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.322546    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6436db55-918b-4fac-8921-31480283cfc8-secret-metrics-server-tls\") pod \"metrics-server-6478f78969-ccntq\" (UID: \"6436db55-918b-4fac-8921-31480283cfc8\") " pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:01:56.322620 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.322580    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6436db55-918b-4fac-8921-31480283cfc8-client-ca-bundle\") pod \"metrics-server-6478f78969-ccntq\" (UID: \"6436db55-918b-4fac-8921-31480283cfc8\") " pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:01:56.322769 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.322749    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6436db55-918b-4fac-8921-31480283cfc8-audit-log\") pod \"metrics-server-6478f78969-ccntq\" (UID: \"6436db55-918b-4fac-8921-31480283cfc8\") " pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:01:56.323070 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.323050    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6436db55-918b-4fac-8921-31480283cfc8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6478f78969-ccntq\" (UID: \"6436db55-918b-4fac-8921-31480283cfc8\") " pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:01:56.323445 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.323421    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6436db55-918b-4fac-8921-31480283cfc8-metrics-server-audit-profiles\") pod \"metrics-server-6478f78969-ccntq\" (UID: \"6436db55-918b-4fac-8921-31480283cfc8\") " pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:01:56.324985 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.324964    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6436db55-918b-4fac-8921-31480283cfc8-secret-metrics-server-client-certs\") pod \"metrics-server-6478f78969-ccntq\" (UID: \"6436db55-918b-4fac-8921-31480283cfc8\") " pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:01:56.325054 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.325007    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6436db55-918b-4fac-8921-31480283cfc8-secret-metrics-server-tls\") pod \"metrics-server-6478f78969-ccntq\" (UID: \"6436db55-918b-4fac-8921-31480283cfc8\") " pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:01:56.325054 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.325038    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6436db55-918b-4fac-8921-31480283cfc8-client-ca-bundle\") pod \"metrics-server-6478f78969-ccntq\" (UID: \"6436db55-918b-4fac-8921-31480283cfc8\") " pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:01:56.329091 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.329069    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfc4m\" (UniqueName: \"kubernetes.io/projected/6436db55-918b-4fac-8921-31480283cfc8-kube-api-access-zfc4m\") pod \"metrics-server-6478f78969-ccntq\" (UID: \"6436db55-918b-4fac-8921-31480283cfc8\") " pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:01:56.439653 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.439597    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:01:56.712556 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.712491    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6478f78969-ccntq"]
Sep 07 23:01:56.715604 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:01:56.715575    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6436db55_918b_4fac_8921_31480283cfc8.slice/crio-32d1ccc8d92e548ef4b2da982711802baae10070ad3994b8a4d4d2d5d32ee76b WatchSource:0}: Error finding container 32d1ccc8d92e548ef4b2da982711802baae10070ad3994b8a4d4d2d5d32ee76b: Status 404 returned error can't find the container with id 32d1ccc8d92e548ef4b2da982711802baae10070ad3994b8a4d4d2d5d32ee76b
Sep 07 23:01:56.866116 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:56.866086    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6478f78969-ccntq" event={"ID":"6436db55-918b-4fac-8921-31480283cfc8","Type":"ContainerStarted","Data":"32d1ccc8d92e548ef4b2da982711802baae10070ad3994b8a4d4d2d5d32ee76b"}
Sep 07 23:01:57.608866 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:57.608833    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b6f776cf4-ptqxw"]
Sep 07 23:01:58.876784 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:58.876751    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6478f78969-ccntq" event={"ID":"6436db55-918b-4fac-8921-31480283cfc8","Type":"ContainerStarted","Data":"ed262c1a8964edb1bc570da6ea7c9ef4098ab8f8ec674e7b2f3cb6db6816667a"}
Sep 07 23:01:58.891793 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:01:58.891749    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6478f78969-ccntq" podStartSLOduration=1.294151926 podStartE2EDuration="2.891733028s" totalImagesPullingTime="1.597581102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:01:58.890373453 +0000 UTC m=+310.518855788" watchObservedRunningTime="2026-09-07 23:01:58.891733028 +0000 UTC m=+310.520215401"
Sep 07 23:02:16.440230 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:16.440192    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:02:16.440699 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:16.440254    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:02:18.771858 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.771828    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6555f954d5-d2c4m"]
Sep 07 23:02:18.775025 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.775008    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:02:18.777276 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.777258    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 07 23:02:18.778201 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.778185    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 07 23:02:18.778316 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.778297    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 07 23:02:18.778383 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.778303    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 07 23:02:18.778383 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.778303    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 07 23:02:18.778383 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.778355    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 07 23:02:18.778528 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.778418    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 07 23:02:18.778664 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.778650    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-d246v\""
Sep 07 23:02:18.784507 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.784487    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6555f954d5-d2c4m"]
Sep 07 23:02:18.893798 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.893769    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c27a0998-4d06-4d4e-96e2-d92bcdca217c-console-oauth-config\") pod \"console-6555f954d5-d2c4m\" (UID: \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\") " pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:02:18.893798 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.893802    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82ww4\" (UniqueName: \"kubernetes.io/projected/c27a0998-4d06-4d4e-96e2-d92bcdca217c-kube-api-access-82ww4\") pod \"console-6555f954d5-d2c4m\" (UID: \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\") " pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:02:18.894056 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.893885    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c27a0998-4d06-4d4e-96e2-d92bcdca217c-console-config\") pod \"console-6555f954d5-d2c4m\" (UID: \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\") " pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:02:18.894056 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.893970    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c27a0998-4d06-4d4e-96e2-d92bcdca217c-console-serving-cert\") pod \"console-6555f954d5-d2c4m\" (UID: \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\") " pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:02:18.894056 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.893999    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c27a0998-4d06-4d4e-96e2-d92bcdca217c-oauth-serving-cert\") pod \"console-6555f954d5-d2c4m\" (UID: \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\") " pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:02:18.894056 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.894046    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c27a0998-4d06-4d4e-96e2-d92bcdca217c-service-ca\") pod \"console-6555f954d5-d2c4m\" (UID: \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\") " pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:02:18.995066 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.995033    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c27a0998-4d06-4d4e-96e2-d92bcdca217c-console-oauth-config\") pod \"console-6555f954d5-d2c4m\" (UID: \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\") " pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:02:18.995066 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.995066    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82ww4\" (UniqueName: \"kubernetes.io/projected/c27a0998-4d06-4d4e-96e2-d92bcdca217c-kube-api-access-82ww4\") pod \"console-6555f954d5-d2c4m\" (UID: \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\") " pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:02:18.995254 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.995094    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c27a0998-4d06-4d4e-96e2-d92bcdca217c-console-config\") pod \"console-6555f954d5-d2c4m\" (UID: \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\") " pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:02:18.995254 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.995240    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c27a0998-4d06-4d4e-96e2-d92bcdca217c-console-serving-cert\") pod \"console-6555f954d5-d2c4m\" (UID: \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\") " pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:02:18.995333 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.995281    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c27a0998-4d06-4d4e-96e2-d92bcdca217c-oauth-serving-cert\") pod \"console-6555f954d5-d2c4m\" (UID: \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\") " pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:02:18.995333 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.995307    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c27a0998-4d06-4d4e-96e2-d92bcdca217c-service-ca\") pod \"console-6555f954d5-d2c4m\" (UID: \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\") " pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:02:18.995819 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.995793    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c27a0998-4d06-4d4e-96e2-d92bcdca217c-console-config\") pod \"console-6555f954d5-d2c4m\" (UID: \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\") " pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:02:18.995971 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.995833    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c27a0998-4d06-4d4e-96e2-d92bcdca217c-service-ca\") pod \"console-6555f954d5-d2c4m\" (UID: \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\") " pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:02:18.996055 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.996008    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c27a0998-4d06-4d4e-96e2-d92bcdca217c-oauth-serving-cert\") pod \"console-6555f954d5-d2c4m\" (UID: \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\") " pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:02:18.997543 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.997514    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c27a0998-4d06-4d4e-96e2-d92bcdca217c-console-oauth-config\") pod \"console-6555f954d5-d2c4m\" (UID: \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\") " pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:02:18.997647 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:18.997609    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c27a0998-4d06-4d4e-96e2-d92bcdca217c-console-serving-cert\") pod \"console-6555f954d5-d2c4m\" (UID: \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\") " pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:02:19.002097 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:19.002080    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82ww4\" (UniqueName: \"kubernetes.io/projected/c27a0998-4d06-4d4e-96e2-d92bcdca217c-kube-api-access-82ww4\") pod \"console-6555f954d5-d2c4m\" (UID: \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\") " pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:02:19.084304 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:19.084245    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:02:19.354849 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:19.354827    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6555f954d5-d2c4m"]
Sep 07 23:02:19.357440 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:02:19.357414    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc27a0998_4d06_4d4e_96e2_d92bcdca217c.slice/crio-dbf5a513b8f8a0ba1647650a38ab5421ba6160701cc4dd96a86f2c532bca64a1 WatchSource:0}: Error finding container dbf5a513b8f8a0ba1647650a38ab5421ba6160701cc4dd96a86f2c532bca64a1: Status 404 returned error can't find the container with id dbf5a513b8f8a0ba1647650a38ab5421ba6160701cc4dd96a86f2c532bca64a1
Sep 07 23:02:19.945356 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:19.945323    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6555f954d5-d2c4m" event={"ID":"c27a0998-4d06-4d4e-96e2-d92bcdca217c","Type":"ContainerStarted","Data":"dbf5a513b8f8a0ba1647650a38ab5421ba6160701cc4dd96a86f2c532bca64a1"}
Sep 07 23:02:22.632343 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:22.632304    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw" podUID="39023548-2a42-458f-adba-bc61a7cd6955" containerName="registry" containerID="cri-o://396e07a2e722b1afa870fdabb49c178cd7d00bcf0e202b679be26976c12d1ce6" gracePeriod=30
Sep 07 23:02:22.861120 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:22.861096    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 23:02:22.956272 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:22.956210    2557 generic.go:356] "Generic (PLEG): container finished" podID="39023548-2a42-458f-adba-bc61a7cd6955" containerID="396e07a2e722b1afa870fdabb49c178cd7d00bcf0e202b679be26976c12d1ce6" exitCode=0
Sep 07 23:02:22.956272 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:22.956248    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw"
Sep 07 23:02:22.956437 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:22.956294    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw" event={"ID":"39023548-2a42-458f-adba-bc61a7cd6955","Type":"ContainerDied","Data":"396e07a2e722b1afa870fdabb49c178cd7d00bcf0e202b679be26976c12d1ce6"}
Sep 07 23:02:22.956437 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:22.956348    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b6f776cf4-ptqxw" event={"ID":"39023548-2a42-458f-adba-bc61a7cd6955","Type":"ContainerDied","Data":"9e3b0ddc05781913f10ad8da5583d9fe97523f7404ac77d187a8bec6dcdf3e36"}
Sep 07 23:02:22.956437 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:22.956393    2557 scope.go:117] "RemoveContainer" containerID="396e07a2e722b1afa870fdabb49c178cd7d00bcf0e202b679be26976c12d1ce6"
Sep 07 23:02:22.957827 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:22.957809    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6555f954d5-d2c4m" event={"ID":"c27a0998-4d06-4d4e-96e2-d92bcdca217c","Type":"ContainerStarted","Data":"e7780c3d34d308af94613bf8539b5c929204d02556670d61c561e3937c7c5ae9"}
Sep 07 23:02:22.963992 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:22.963970    2557 scope.go:117] "RemoveContainer" containerID="396e07a2e722b1afa870fdabb49c178cd7d00bcf0e202b679be26976c12d1ce6"
Sep 07 23:02:22.964244 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:02:22.964217    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"396e07a2e722b1afa870fdabb49c178cd7d00bcf0e202b679be26976c12d1ce6\": container with ID starting with 396e07a2e722b1afa870fdabb49c178cd7d00bcf0e202b679be26976c12d1ce6 not found: ID does not exist" containerID="396e07a2e722b1afa870fdabb49c178cd7d00bcf0e202b679be26976c12d1ce6"
Sep 07 23:02:22.964301 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:22.964248    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"396e07a2e722b1afa870fdabb49c178cd7d00bcf0e202b679be26976c12d1ce6"} err="failed to get container status \"396e07a2e722b1afa870fdabb49c178cd7d00bcf0e202b679be26976c12d1ce6\": rpc error: code = NotFound desc = could not find container \"396e07a2e722b1afa870fdabb49c178cd7d00bcf0e202b679be26976c12d1ce6\": container with ID starting with 396e07a2e722b1afa870fdabb49c178cd7d00bcf0e202b679be26976c12d1ce6 not found: ID does not exist"
Sep 07 23:02:22.975357 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:22.975306    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6555f954d5-d2c4m" podStartSLOduration=2.076703198 podStartE2EDuration="4.975294376s" totalImagesPullingTime="2.898591178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:02:22.974554318 +0000 UTC m=+334.603036653" watchObservedRunningTime="2026-09-07 23:02:22.975294376 +0000 UTC m=+334.603776710"
Sep 07 23:02:23.029929 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.029891    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/39023548-2a42-458f-adba-bc61a7cd6955-registry-certificates\") pod \"39023548-2a42-458f-adba-bc61a7cd6955\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") "
Sep 07 23:02:23.030018 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.029947    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrcz4\" (UniqueName: \"kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-kube-api-access-zrcz4\") pod \"39023548-2a42-458f-adba-bc61a7cd6955\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") "
Sep 07 23:02:23.030018 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.029974    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/39023548-2a42-458f-adba-bc61a7cd6955-image-registry-private-configuration\") pod \"39023548-2a42-458f-adba-bc61a7cd6955\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") "
Sep 07 23:02:23.030101 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.030082    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/39023548-2a42-458f-adba-bc61a7cd6955-ca-trust-extracted\") pod \"39023548-2a42-458f-adba-bc61a7cd6955\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") "
Sep 07 23:02:23.030145 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.030134    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39023548-2a42-458f-adba-bc61a7cd6955-trusted-ca\") pod \"39023548-2a42-458f-adba-bc61a7cd6955\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") "
Sep 07 23:02:23.030182 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.030173    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/39023548-2a42-458f-adba-bc61a7cd6955-installation-pull-secrets\") pod \"39023548-2a42-458f-adba-bc61a7cd6955\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") "
Sep 07 23:02:23.030227 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.030208    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-bound-sa-token\") pod \"39023548-2a42-458f-adba-bc61a7cd6955\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") "
Sep 07 23:02:23.030279 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.030241    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls\") pod \"39023548-2a42-458f-adba-bc61a7cd6955\" (UID: \"39023548-2a42-458f-adba-bc61a7cd6955\") "
Sep 07 23:02:23.030443 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.030403    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39023548-2a42-458f-adba-bc61a7cd6955-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "39023548-2a42-458f-adba-bc61a7cd6955" (UID: "39023548-2a42-458f-adba-bc61a7cd6955"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 23:02:23.030523 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.030506    2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/39023548-2a42-458f-adba-bc61a7cd6955-registry-certificates\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:02:23.030578 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.030559    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39023548-2a42-458f-adba-bc61a7cd6955-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "39023548-2a42-458f-adba-bc61a7cd6955" (UID: "39023548-2a42-458f-adba-bc61a7cd6955"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 23:02:23.032598 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.032557    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-kube-api-access-zrcz4" (OuterVolumeSpecName: "kube-api-access-zrcz4") pod "39023548-2a42-458f-adba-bc61a7cd6955" (UID: "39023548-2a42-458f-adba-bc61a7cd6955"). InnerVolumeSpecName "kube-api-access-zrcz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 23:02:23.032710 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.032675    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39023548-2a42-458f-adba-bc61a7cd6955-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "39023548-2a42-458f-adba-bc61a7cd6955" (UID: "39023548-2a42-458f-adba-bc61a7cd6955"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 23:02:23.032777 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.032746    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "39023548-2a42-458f-adba-bc61a7cd6955" (UID: "39023548-2a42-458f-adba-bc61a7cd6955"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 23:02:23.032833 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.032796    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39023548-2a42-458f-adba-bc61a7cd6955-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "39023548-2a42-458f-adba-bc61a7cd6955" (UID: "39023548-2a42-458f-adba-bc61a7cd6955"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 23:02:23.032911 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.032895    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "39023548-2a42-458f-adba-bc61a7cd6955" (UID: "39023548-2a42-458f-adba-bc61a7cd6955"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 23:02:23.038581 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.038560    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39023548-2a42-458f-adba-bc61a7cd6955-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "39023548-2a42-458f-adba-bc61a7cd6955" (UID: "39023548-2a42-458f-adba-bc61a7cd6955"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 23:02:23.131568 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.131537    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrcz4\" (UniqueName: \"kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-kube-api-access-zrcz4\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:02:23.131568 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.131567    2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/39023548-2a42-458f-adba-bc61a7cd6955-image-registry-private-configuration\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:02:23.131741 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.131583    2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/39023548-2a42-458f-adba-bc61a7cd6955-ca-trust-extracted\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:02:23.131741 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.131596    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39023548-2a42-458f-adba-bc61a7cd6955-trusted-ca\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:02:23.131741 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.131609    2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/39023548-2a42-458f-adba-bc61a7cd6955-installation-pull-secrets\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:02:23.131741 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.131621    2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-bound-sa-token\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:02:23.131741 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.131634    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39023548-2a42-458f-adba-bc61a7cd6955-registry-tls\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:02:23.280477 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.280449    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b6f776cf4-ptqxw"]
Sep 07 23:02:23.283477 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:23.283451    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b6f776cf4-ptqxw"]
Sep 07 23:02:24.875284 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:24.875247    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39023548-2a42-458f-adba-bc61a7cd6955" path="/var/lib/kubelet/pods/39023548-2a42-458f-adba-bc61a7cd6955/volumes"
Sep 07 23:02:26.973785 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:26.973753    2557 generic.go:356] "Generic (PLEG): container finished" podID="b5bbe966-bf44-4edd-8221-7c56c60a9668" containerID="dd36e22b30482e938439fd31a58a30eef16043274e8d4d62d29d88bce678d652" exitCode=0
Sep 07 23:02:26.974273 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:26.973823    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mrkf4" event={"ID":"b5bbe966-bf44-4edd-8221-7c56c60a9668","Type":"ContainerDied","Data":"dd36e22b30482e938439fd31a58a30eef16043274e8d4d62d29d88bce678d652"}
Sep 07 23:02:26.974273 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:26.974111    2557 scope.go:117] "RemoveContainer" containerID="dd36e22b30482e938439fd31a58a30eef16043274e8d4d62d29d88bce678d652"
Sep 07 23:02:27.569702 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.569667    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56b796fc48-56l55"]
Sep 07 23:02:27.569946 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.569931    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39023548-2a42-458f-adba-bc61a7cd6955" containerName="registry"
Sep 07 23:02:27.570002 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.569950    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="39023548-2a42-458f-adba-bc61a7cd6955" containerName="registry"
Sep 07 23:02:27.570036 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.570004    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="39023548-2a42-458f-adba-bc61a7cd6955" containerName="registry"
Sep 07 23:02:27.572743 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.572727    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:27.580417 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.580393    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 07 23:02:27.582215 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.582197    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56b796fc48-56l55"]
Sep 07 23:02:27.662275 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.662244    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmqn5\" (UniqueName: \"kubernetes.io/projected/6e188de8-683a-4dca-8e93-c750028cdc18-kube-api-access-pmqn5\") pod \"console-56b796fc48-56l55\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") " pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:27.662398 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.662284    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e188de8-683a-4dca-8e93-c750028cdc18-service-ca\") pod \"console-56b796fc48-56l55\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") " pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:27.662398 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.662308    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e188de8-683a-4dca-8e93-c750028cdc18-console-serving-cert\") pod \"console-56b796fc48-56l55\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") " pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:27.662398 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.662365    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e188de8-683a-4dca-8e93-c750028cdc18-oauth-serving-cert\") pod \"console-56b796fc48-56l55\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") " pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:27.662565 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.662462    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e188de8-683a-4dca-8e93-c750028cdc18-console-oauth-config\") pod \"console-56b796fc48-56l55\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") " pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:27.662565 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.662492    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e188de8-683a-4dca-8e93-c750028cdc18-console-config\") pod \"console-56b796fc48-56l55\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") " pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:27.662565 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.662524    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e188de8-683a-4dca-8e93-c750028cdc18-trusted-ca-bundle\") pod \"console-56b796fc48-56l55\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") " pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:27.763529 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.763502    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e188de8-683a-4dca-8e93-c750028cdc18-console-oauth-config\") pod \"console-56b796fc48-56l55\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") " pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:27.763529 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.763529    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e188de8-683a-4dca-8e93-c750028cdc18-console-config\") pod \"console-56b796fc48-56l55\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") " pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:27.763696 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.763550    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e188de8-683a-4dca-8e93-c750028cdc18-trusted-ca-bundle\") pod \"console-56b796fc48-56l55\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") " pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:27.763696 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.763668    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmqn5\" (UniqueName: \"kubernetes.io/projected/6e188de8-683a-4dca-8e93-c750028cdc18-kube-api-access-pmqn5\") pod \"console-56b796fc48-56l55\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") " pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:27.763802 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.763737    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e188de8-683a-4dca-8e93-c750028cdc18-service-ca\") pod \"console-56b796fc48-56l55\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") " pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:27.763802 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.763777    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e188de8-683a-4dca-8e93-c750028cdc18-console-serving-cert\") pod \"console-56b796fc48-56l55\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") " pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:27.763896 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.763809    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e188de8-683a-4dca-8e93-c750028cdc18-oauth-serving-cert\") pod \"console-56b796fc48-56l55\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") " pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:27.764286 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.764261    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e188de8-683a-4dca-8e93-c750028cdc18-console-config\") pod \"console-56b796fc48-56l55\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") " pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:27.764450 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.764431    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e188de8-683a-4dca-8e93-c750028cdc18-oauth-serving-cert\") pod \"console-56b796fc48-56l55\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") " pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:27.764526 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.764469    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e188de8-683a-4dca-8e93-c750028cdc18-service-ca\") pod \"console-56b796fc48-56l55\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") " pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:27.764695 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.764679    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e188de8-683a-4dca-8e93-c750028cdc18-trusted-ca-bundle\") pod \"console-56b796fc48-56l55\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") " pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:27.766033 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.766015    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e188de8-683a-4dca-8e93-c750028cdc18-console-oauth-config\") pod \"console-56b796fc48-56l55\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") " pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:27.766116 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.766099    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e188de8-683a-4dca-8e93-c750028cdc18-console-serving-cert\") pod \"console-56b796fc48-56l55\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") " pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:27.770868 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.770852    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmqn5\" (UniqueName: \"kubernetes.io/projected/6e188de8-683a-4dca-8e93-c750028cdc18-kube-api-access-pmqn5\") pod \"console-56b796fc48-56l55\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") " pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:27.880872 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.880851    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:27.978892 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:27.978862    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mrkf4" event={"ID":"b5bbe966-bf44-4edd-8221-7c56c60a9668","Type":"ContainerStarted","Data":"ec26cf2cae867aa60cb35c9767a01e70d69358d1e964f3473f978e4303b1f698"}
Sep 07 23:02:28.148562 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:28.148499    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56b796fc48-56l55"]
Sep 07 23:02:28.151448 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:02:28.151425    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e188de8_683a_4dca_8e93_c750028cdc18.slice/crio-7c0ee8355ef1399a5bc8a41a59d97164df7aa63aba058918e9a6c7bd47443b75 WatchSource:0}: Error finding container 7c0ee8355ef1399a5bc8a41a59d97164df7aa63aba058918e9a6c7bd47443b75: Status 404 returned error can't find the container with id 7c0ee8355ef1399a5bc8a41a59d97164df7aa63aba058918e9a6c7bd47443b75
Sep 07 23:02:28.982929 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:28.982892    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b796fc48-56l55" event={"ID":"6e188de8-683a-4dca-8e93-c750028cdc18","Type":"ContainerStarted","Data":"4b5246a1406f3f8c29f2dbf42bf71244d80f986c9fff1e041bb07769ff65c68a"}
Sep 07 23:02:28.983288 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:28.982961    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b796fc48-56l55" event={"ID":"6e188de8-683a-4dca-8e93-c750028cdc18","Type":"ContainerStarted","Data":"7c0ee8355ef1399a5bc8a41a59d97164df7aa63aba058918e9a6c7bd47443b75"}
Sep 07 23:02:28.999389 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:28.999340    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56b796fc48-56l55" podStartSLOduration=1.999325636 podStartE2EDuration="1.999325636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:02:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:02:28.998323137 +0000 UTC m=+340.626805473" watchObservedRunningTime="2026-09-07 23:02:28.999325636 +0000 UTC m=+340.627808023"
Sep 07 23:02:29.085346 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:29.085318    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:02:29.085469 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:29.085378    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:02:29.090023 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:29.090005    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:02:29.990308 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:29.990273    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:02:36.445108 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:36.445077    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:02:36.448732 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:36.448708    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6478f78969-ccntq"
Sep 07 23:02:37.881641 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:37.881602    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:37.881641 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:37.881648    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:37.886119 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:37.886097    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:38.015815 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:38.015788    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:02:38.059608 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:02:38.059581    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6555f954d5-d2c4m"]
Sep 07 23:03:02.708731 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:02.708698    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs\") pod \"network-metrics-daemon-9wwxc\" (UID: \"a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff\") " pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 23:03:02.711008 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:02.710984    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff-metrics-certs\") pod \"network-metrics-daemon-9wwxc\" (UID: \"a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff\") " pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 23:03:02.774443 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:02.774422    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-247hl\""
Sep 07 23:03:02.783172 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:02.783153    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wwxc"
Sep 07 23:03:03.056147 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:03.055972    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9wwxc"]
Sep 07 23:03:03.058824 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:03:03.058796    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda476ffa2_ceeb_4fee_b5b9_8e3ab2fd93ff.slice/crio-5fc0b599771c43c30ba26292356784e579f04633452ca92ad5b568de27f76d9c WatchSource:0}: Error finding container 5fc0b599771c43c30ba26292356784e579f04633452ca92ad5b568de27f76d9c: Status 404 returned error can't find the container with id 5fc0b599771c43c30ba26292356784e579f04633452ca92ad5b568de27f76d9c
Sep 07 23:03:03.079550 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:03.079507    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6555f954d5-d2c4m" podUID="c27a0998-4d06-4d4e-96e2-d92bcdca217c" containerName="console" containerID="cri-o://e7780c3d34d308af94613bf8539b5c929204d02556670d61c561e3937c7c5ae9" gracePeriod=15
Sep 07 23:03:03.101615 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:03.101593    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9wwxc" event={"ID":"a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff","Type":"ContainerStarted","Data":"5fc0b599771c43c30ba26292356784e579f04633452ca92ad5b568de27f76d9c"}
Sep 07 23:03:03.306547 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:03.306487    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:03:03.415020 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:03.414983    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c27a0998-4d06-4d4e-96e2-d92bcdca217c-console-serving-cert\") pod \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\" (UID: \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\") "
Sep 07 23:03:03.415020 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:03.415021    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c27a0998-4d06-4d4e-96e2-d92bcdca217c-console-config\") pod \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\" (UID: \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\") "
Sep 07 23:03:03.415223 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:03.415042    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c27a0998-4d06-4d4e-96e2-d92bcdca217c-console-oauth-config\") pod \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\" (UID: \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\") "
Sep 07 23:03:03.415223 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:03.415057    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c27a0998-4d06-4d4e-96e2-d92bcdca217c-service-ca\") pod \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\" (UID: \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\") "
Sep 07 23:03:03.415300 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:03.415270    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c27a0998-4d06-4d4e-96e2-d92bcdca217c-oauth-serving-cert\") pod \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\" (UID: \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\") "
Sep 07 23:03:03.415347 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:03.415322    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82ww4\" (UniqueName: \"kubernetes.io/projected/c27a0998-4d06-4d4e-96e2-d92bcdca217c-kube-api-access-82ww4\") pod \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\" (UID: \"c27a0998-4d06-4d4e-96e2-d92bcdca217c\") "
Sep 07 23:03:03.415456 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:03.415431    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c27a0998-4d06-4d4e-96e2-d92bcdca217c-console-config" (OuterVolumeSpecName: "console-config") pod "c27a0998-4d06-4d4e-96e2-d92bcdca217c" (UID: "c27a0998-4d06-4d4e-96e2-d92bcdca217c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 23:03:03.415456 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:03.415446    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c27a0998-4d06-4d4e-96e2-d92bcdca217c-service-ca" (OuterVolumeSpecName: "service-ca") pod "c27a0998-4d06-4d4e-96e2-d92bcdca217c" (UID: "c27a0998-4d06-4d4e-96e2-d92bcdca217c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 23:03:03.415583 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:03.415550    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c27a0998-4d06-4d4e-96e2-d92bcdca217c-console-config\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:03:03.415583 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:03.415563    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c27a0998-4d06-4d4e-96e2-d92bcdca217c-service-ca\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:03:03.415668 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:03.415606    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c27a0998-4d06-4d4e-96e2-d92bcdca217c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c27a0998-4d06-4d4e-96e2-d92bcdca217c" (UID: "c27a0998-4d06-4d4e-96e2-d92bcdca217c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 23:03:03.417407 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:03.417384    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c27a0998-4d06-4d4e-96e2-d92bcdca217c-kube-api-access-82ww4" (OuterVolumeSpecName: "kube-api-access-82ww4") pod "c27a0998-4d06-4d4e-96e2-d92bcdca217c" (UID: "c27a0998-4d06-4d4e-96e2-d92bcdca217c"). InnerVolumeSpecName "kube-api-access-82ww4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 23:03:03.417482 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:03.417410    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c27a0998-4d06-4d4e-96e2-d92bcdca217c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c27a0998-4d06-4d4e-96e2-d92bcdca217c" (UID: "c27a0998-4d06-4d4e-96e2-d92bcdca217c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 23:03:03.417482 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:03.417429    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c27a0998-4d06-4d4e-96e2-d92bcdca217c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c27a0998-4d06-4d4e-96e2-d92bcdca217c" (UID: "c27a0998-4d06-4d4e-96e2-d92bcdca217c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 23:03:03.516185 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:03.516161    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c27a0998-4d06-4d4e-96e2-d92bcdca217c-oauth-serving-cert\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:03:03.516185 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:03.516186    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82ww4\" (UniqueName: \"kubernetes.io/projected/c27a0998-4d06-4d4e-96e2-d92bcdca217c-kube-api-access-82ww4\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:03:03.516309 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:03.516196    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c27a0998-4d06-4d4e-96e2-d92bcdca217c-console-serving-cert\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:03:03.516309 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:03.516204    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c27a0998-4d06-4d4e-96e2-d92bcdca217c-console-oauth-config\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:03:04.105876 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:04.105793    2557 generic.go:356] "Generic (PLEG): container finished" podID="c27a0998-4d06-4d4e-96e2-d92bcdca217c" containerID="e7780c3d34d308af94613bf8539b5c929204d02556670d61c561e3937c7c5ae9" exitCode=0
Sep 07 23:03:04.105876 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:04.105833    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6555f954d5-d2c4m"
Sep 07 23:03:04.105876 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:04.105865    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6555f954d5-d2c4m" event={"ID":"c27a0998-4d06-4d4e-96e2-d92bcdca217c","Type":"ContainerDied","Data":"e7780c3d34d308af94613bf8539b5c929204d02556670d61c561e3937c7c5ae9"}
Sep 07 23:03:04.106378 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:04.105936    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6555f954d5-d2c4m" event={"ID":"c27a0998-4d06-4d4e-96e2-d92bcdca217c","Type":"ContainerDied","Data":"dbf5a513b8f8a0ba1647650a38ab5421ba6160701cc4dd96a86f2c532bca64a1"}
Sep 07 23:03:04.106378 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:04.105942    2557 scope.go:117] "RemoveContainer" containerID="e7780c3d34d308af94613bf8539b5c929204d02556670d61c561e3937c7c5ae9"
Sep 07 23:03:04.116932 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:04.116903    2557 scope.go:117] "RemoveContainer" containerID="e7780c3d34d308af94613bf8539b5c929204d02556670d61c561e3937c7c5ae9"
Sep 07 23:03:04.117211 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:03:04.117187    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7780c3d34d308af94613bf8539b5c929204d02556670d61c561e3937c7c5ae9\": container with ID starting with e7780c3d34d308af94613bf8539b5c929204d02556670d61c561e3937c7c5ae9 not found: ID does not exist" containerID="e7780c3d34d308af94613bf8539b5c929204d02556670d61c561e3937c7c5ae9"
Sep 07 23:03:04.117313 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:04.117219    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7780c3d34d308af94613bf8539b5c929204d02556670d61c561e3937c7c5ae9"} err="failed to get container status \"e7780c3d34d308af94613bf8539b5c929204d02556670d61c561e3937c7c5ae9\": rpc error: code = NotFound desc = could not find container \"e7780c3d34d308af94613bf8539b5c929204d02556670d61c561e3937c7c5ae9\": container with ID starting with e7780c3d34d308af94613bf8539b5c929204d02556670d61c561e3937c7c5ae9 not found: ID does not exist"
Sep 07 23:03:04.126559 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:04.126538    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6555f954d5-d2c4m"]
Sep 07 23:03:04.129546 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:04.129529    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6555f954d5-d2c4m"]
Sep 07 23:03:04.876114 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:04.876074    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c27a0998-4d06-4d4e-96e2-d92bcdca217c" path="/var/lib/kubelet/pods/c27a0998-4d06-4d4e-96e2-d92bcdca217c/volumes"
Sep 07 23:03:05.112243 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:05.112209    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9wwxc" event={"ID":"a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff","Type":"ContainerStarted","Data":"63754c04da77155d1478eeb2fe1917599a13d5c88b2bfbbeeff2b760a97e8fe6"}
Sep 07 23:03:05.112632 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:05.112270    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9wwxc" event={"ID":"a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff","Type":"ContainerStarted","Data":"df89ffb5144bbbee3aebfd25a04253a2bb818d0c4d53c0c659e3e48c434d6f63"}
Sep 07 23:03:05.127752 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:05.127668    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9wwxc" podStartSLOduration=374.735585426 podStartE2EDuration="6m16.12765455s" totalImagesPullingTime="1.392069124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 22:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:03:05.126510554 +0000 UTC m=+376.754992890" watchObservedRunningTime="2026-09-07 23:03:05.12765455 +0000 UTC m=+376.756136885"
Sep 07 23:03:27.285091 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.285061    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64c88fbdfd-rbh64"]
Sep 07 23:03:27.285514 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.285327    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c27a0998-4d06-4d4e-96e2-d92bcdca217c" containerName="console"
Sep 07 23:03:27.285514 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.285339    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c27a0998-4d06-4d4e-96e2-d92bcdca217c" containerName="console"
Sep 07 23:03:27.285514 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.285383    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c27a0998-4d06-4d4e-96e2-d92bcdca217c" containerName="console"
Sep 07 23:03:27.289182 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.289164    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:27.297262 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.297239    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64c88fbdfd-rbh64"]
Sep 07 23:03:27.376333 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.376308    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f93e25a5-5352-4c72-a91b-460e6c457da3-service-ca\") pod \"console-64c88fbdfd-rbh64\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") " pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:27.376454 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.376336    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f93e25a5-5352-4c72-a91b-460e6c457da3-console-config\") pod \"console-64c88fbdfd-rbh64\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") " pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:27.376454 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.376366    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f93e25a5-5352-4c72-a91b-460e6c457da3-console-serving-cert\") pod \"console-64c88fbdfd-rbh64\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") " pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:27.376454 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.376414    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f93e25a5-5352-4c72-a91b-460e6c457da3-oauth-serving-cert\") pod \"console-64c88fbdfd-rbh64\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") " pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:27.376454 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.376451    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4r9m\" (UniqueName: \"kubernetes.io/projected/f93e25a5-5352-4c72-a91b-460e6c457da3-kube-api-access-c4r9m\") pod \"console-64c88fbdfd-rbh64\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") " pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:27.376638 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.376500    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f93e25a5-5352-4c72-a91b-460e6c457da3-console-oauth-config\") pod \"console-64c88fbdfd-rbh64\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") " pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:27.376638 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.376562    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f93e25a5-5352-4c72-a91b-460e6c457da3-trusted-ca-bundle\") pod \"console-64c88fbdfd-rbh64\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") " pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:27.477102 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.477076    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f93e25a5-5352-4c72-a91b-460e6c457da3-trusted-ca-bundle\") pod \"console-64c88fbdfd-rbh64\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") " pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:27.477206 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.477111    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f93e25a5-5352-4c72-a91b-460e6c457da3-service-ca\") pod \"console-64c88fbdfd-rbh64\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") " pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:27.477206 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.477137    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f93e25a5-5352-4c72-a91b-460e6c457da3-console-config\") pod \"console-64c88fbdfd-rbh64\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") " pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:27.477206 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.477189    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f93e25a5-5352-4c72-a91b-460e6c457da3-console-serving-cert\") pod \"console-64c88fbdfd-rbh64\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") " pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:27.477359 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.477214    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f93e25a5-5352-4c72-a91b-460e6c457da3-oauth-serving-cert\") pod \"console-64c88fbdfd-rbh64\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") " pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:27.477359 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.477238    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4r9m\" (UniqueName: \"kubernetes.io/projected/f93e25a5-5352-4c72-a91b-460e6c457da3-kube-api-access-c4r9m\") pod \"console-64c88fbdfd-rbh64\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") " pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:27.477359 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.477285    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f93e25a5-5352-4c72-a91b-460e6c457da3-console-oauth-config\") pod \"console-64c88fbdfd-rbh64\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") " pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:27.477903 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.477880    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f93e25a5-5352-4c72-a91b-460e6c457da3-service-ca\") pod \"console-64c88fbdfd-rbh64\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") " pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:27.478086 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.478001    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f93e25a5-5352-4c72-a91b-460e6c457da3-console-config\") pod \"console-64c88fbdfd-rbh64\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") " pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:27.478086 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.478068    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f93e25a5-5352-4c72-a91b-460e6c457da3-oauth-serving-cert\") pod \"console-64c88fbdfd-rbh64\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") " pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:27.478212 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.478110    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f93e25a5-5352-4c72-a91b-460e6c457da3-trusted-ca-bundle\") pod \"console-64c88fbdfd-rbh64\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") " pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:27.479602 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.479584    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f93e25a5-5352-4c72-a91b-460e6c457da3-console-oauth-config\") pod \"console-64c88fbdfd-rbh64\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") " pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:27.479698 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.479680    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f93e25a5-5352-4c72-a91b-460e6c457da3-console-serving-cert\") pod \"console-64c88fbdfd-rbh64\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") " pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:27.484443 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.484425    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4r9m\" (UniqueName: \"kubernetes.io/projected/f93e25a5-5352-4c72-a91b-460e6c457da3-kube-api-access-c4r9m\") pod \"console-64c88fbdfd-rbh64\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") " pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:27.598578 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.598514    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:27.865839 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:27.865816    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64c88fbdfd-rbh64"]
Sep 07 23:03:27.868177 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:03:27.868141    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf93e25a5_5352_4c72_a91b_460e6c457da3.slice/crio-167bfc86a04d27de0349c78216f965fff03e377682c5ab9def810c9ab780d118 WatchSource:0}: Error finding container 167bfc86a04d27de0349c78216f965fff03e377682c5ab9def810c9ab780d118: Status 404 returned error can't find the container with id 167bfc86a04d27de0349c78216f965fff03e377682c5ab9def810c9ab780d118
Sep 07 23:03:28.196397 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:28.196365    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c88fbdfd-rbh64" event={"ID":"f93e25a5-5352-4c72-a91b-460e6c457da3","Type":"ContainerStarted","Data":"ad57f20f0c1d771697716a3148d84a91d258984be97d4c2430667fc50e7055f1"}
Sep 07 23:03:28.196541 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:28.196429    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c88fbdfd-rbh64" event={"ID":"f93e25a5-5352-4c72-a91b-460e6c457da3","Type":"ContainerStarted","Data":"167bfc86a04d27de0349c78216f965fff03e377682c5ab9def810c9ab780d118"}
Sep 07 23:03:28.212994 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:28.212949    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64c88fbdfd-rbh64" podStartSLOduration=1.212931896 podStartE2EDuration="1.212931896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:03:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:03:28.211778216 +0000 UTC m=+399.840260551" watchObservedRunningTime="2026-09-07 23:03:28.212931896 +0000 UTC m=+399.841414222"
Sep 07 23:03:37.598630 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:37.598586    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:37.598630 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:37.598639    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:37.603589 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:37.603561    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:38.235455 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:38.235426    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:03:38.278360 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:03:38.278329    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56b796fc48-56l55"]
Sep 07 23:04:03.124394 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.124361    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8"]
Sep 07 23:04:03.128977 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.128960    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8"
Sep 07 23:04:03.131368 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.131348    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 23:04:03.132192 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.132176    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ffs26\""
Sep 07 23:04:03.132289 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.132179    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 23:04:03.138092 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.138069    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8"]
Sep 07 23:04:03.211519 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.211483    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8\" (UID: \"ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8"
Sep 07 23:04:03.211519 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.211520    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8\" (UID: \"ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8"
Sep 07 23:04:03.211706 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.211542    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjn67\" (UniqueName: \"kubernetes.io/projected/ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc-kube-api-access-rjn67\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8\" (UID: \"ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8"
Sep 07 23:04:03.301189 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.301153    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56b796fc48-56l55" podUID="6e188de8-683a-4dca-8e93-c750028cdc18" containerName="console" containerID="cri-o://4b5246a1406f3f8c29f2dbf42bf71244d80f986c9fff1e041bb07769ff65c68a" gracePeriod=15
Sep 07 23:04:03.312830 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.312809    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8\" (UID: \"ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8"
Sep 07 23:04:03.312887 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.312840    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8\" (UID: \"ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8"
Sep 07 23:04:03.312887 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.312867    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjn67\" (UniqueName: \"kubernetes.io/projected/ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc-kube-api-access-rjn67\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8\" (UID: \"ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8"
Sep 07 23:04:03.313180 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.313160    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8\" (UID: \"ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8"
Sep 07 23:04:03.313252 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.313237    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8\" (UID: \"ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8"
Sep 07 23:04:03.333639 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.333615    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjn67\" (UniqueName: \"kubernetes.io/projected/ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc-kube-api-access-rjn67\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8\" (UID: \"ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8"
Sep 07 23:04:03.437872 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.437845    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8"
Sep 07 23:04:03.546299 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.546278    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:04:03.615289 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.615261    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmqn5\" (UniqueName: \"kubernetes.io/projected/6e188de8-683a-4dca-8e93-c750028cdc18-kube-api-access-pmqn5\") pod \"6e188de8-683a-4dca-8e93-c750028cdc18\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") "
Sep 07 23:04:03.615450 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.615300    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e188de8-683a-4dca-8e93-c750028cdc18-console-oauth-config\") pod \"6e188de8-683a-4dca-8e93-c750028cdc18\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") "
Sep 07 23:04:03.615450 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.615328    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e188de8-683a-4dca-8e93-c750028cdc18-console-serving-cert\") pod \"6e188de8-683a-4dca-8e93-c750028cdc18\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") "
Sep 07 23:04:03.615450 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.615346    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e188de8-683a-4dca-8e93-c750028cdc18-oauth-serving-cert\") pod \"6e188de8-683a-4dca-8e93-c750028cdc18\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") "
Sep 07 23:04:03.615450 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.615366    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e188de8-683a-4dca-8e93-c750028cdc18-trusted-ca-bundle\") pod \"6e188de8-683a-4dca-8e93-c750028cdc18\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") "
Sep 07 23:04:03.615450 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.615401    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e188de8-683a-4dca-8e93-c750028cdc18-service-ca\") pod \"6e188de8-683a-4dca-8e93-c750028cdc18\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") "
Sep 07 23:04:03.615450 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.615419    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e188de8-683a-4dca-8e93-c750028cdc18-console-config\") pod \"6e188de8-683a-4dca-8e93-c750028cdc18\" (UID: \"6e188de8-683a-4dca-8e93-c750028cdc18\") "
Sep 07 23:04:03.615840 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.615807    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e188de8-683a-4dca-8e93-c750028cdc18-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6e188de8-683a-4dca-8e93-c750028cdc18" (UID: "6e188de8-683a-4dca-8e93-c750028cdc18"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 23:04:03.615907 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.615876    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e188de8-683a-4dca-8e93-c750028cdc18-console-config" (OuterVolumeSpecName: "console-config") pod "6e188de8-683a-4dca-8e93-c750028cdc18" (UID: "6e188de8-683a-4dca-8e93-c750028cdc18"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 23:04:03.615907 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.615889    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e188de8-683a-4dca-8e93-c750028cdc18-service-ca" (OuterVolumeSpecName: "service-ca") pod "6e188de8-683a-4dca-8e93-c750028cdc18" (UID: "6e188de8-683a-4dca-8e93-c750028cdc18"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 23:04:03.616039 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.615900    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e188de8-683a-4dca-8e93-c750028cdc18-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6e188de8-683a-4dca-8e93-c750028cdc18" (UID: "6e188de8-683a-4dca-8e93-c750028cdc18"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 23:04:03.617486 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.617457    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e188de8-683a-4dca-8e93-c750028cdc18-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6e188de8-683a-4dca-8e93-c750028cdc18" (UID: "6e188de8-683a-4dca-8e93-c750028cdc18"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 23:04:03.617574 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.617488    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e188de8-683a-4dca-8e93-c750028cdc18-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6e188de8-683a-4dca-8e93-c750028cdc18" (UID: "6e188de8-683a-4dca-8e93-c750028cdc18"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 23:04:03.617574 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.617500    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e188de8-683a-4dca-8e93-c750028cdc18-kube-api-access-pmqn5" (OuterVolumeSpecName: "kube-api-access-pmqn5") pod "6e188de8-683a-4dca-8e93-c750028cdc18" (UID: "6e188de8-683a-4dca-8e93-c750028cdc18"). InnerVolumeSpecName "kube-api-access-pmqn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 23:04:03.716559 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.716487    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e188de8-683a-4dca-8e93-c750028cdc18-service-ca\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:03.716559 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.716513    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e188de8-683a-4dca-8e93-c750028cdc18-console-config\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:03.716559 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.716523    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmqn5\" (UniqueName: \"kubernetes.io/projected/6e188de8-683a-4dca-8e93-c750028cdc18-kube-api-access-pmqn5\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:03.716559 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.716532    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e188de8-683a-4dca-8e93-c750028cdc18-console-oauth-config\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:03.716559 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.716540    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e188de8-683a-4dca-8e93-c750028cdc18-console-serving-cert\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:03.716559 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.716548    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e188de8-683a-4dca-8e93-c750028cdc18-oauth-serving-cert\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:03.716559 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.716556    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e188de8-683a-4dca-8e93-c750028cdc18-trusted-ca-bundle\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:03.721107 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:03.721077    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8"]
Sep 07 23:04:03.723900 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:04:03.723876    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad4db9a4_66fe_48ad_94f2_ea5253dd8ebc.slice/crio-3deac2e1701240abf4a87cb8b10f82f4a8a6781a93f15882048c8fc31d08cb53 WatchSource:0}: Error finding container 3deac2e1701240abf4a87cb8b10f82f4a8a6781a93f15882048c8fc31d08cb53: Status 404 returned error can't find the container with id 3deac2e1701240abf4a87cb8b10f82f4a8a6781a93f15882048c8fc31d08cb53
Sep 07 23:04:04.325141 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.325105    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8" event={"ID":"ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc","Type":"ContainerStarted","Data":"3deac2e1701240abf4a87cb8b10f82f4a8a6781a93f15882048c8fc31d08cb53"}
Sep 07 23:04:04.326393 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.326371    2557 generic.go:356] "Generic (PLEG): container finished" podID="6e188de8-683a-4dca-8e93-c750028cdc18" containerID="4b5246a1406f3f8c29f2dbf42bf71244d80f986c9fff1e041bb07769ff65c68a" exitCode=0
Sep 07 23:04:04.326511 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.326410    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b796fc48-56l55" event={"ID":"6e188de8-683a-4dca-8e93-c750028cdc18","Type":"ContainerDied","Data":"4b5246a1406f3f8c29f2dbf42bf71244d80f986c9fff1e041bb07769ff65c68a"}
Sep 07 23:04:04.326511 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.326416    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b796fc48-56l55"
Sep 07 23:04:04.326511 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.326438    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b796fc48-56l55" event={"ID":"6e188de8-683a-4dca-8e93-c750028cdc18","Type":"ContainerDied","Data":"7c0ee8355ef1399a5bc8a41a59d97164df7aa63aba058918e9a6c7bd47443b75"}
Sep 07 23:04:04.326511 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.326457    2557 scope.go:117] "RemoveContainer" containerID="4b5246a1406f3f8c29f2dbf42bf71244d80f986c9fff1e041bb07769ff65c68a"
Sep 07 23:04:04.334308 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.334291    2557 scope.go:117] "RemoveContainer" containerID="4b5246a1406f3f8c29f2dbf42bf71244d80f986c9fff1e041bb07769ff65c68a"
Sep 07 23:04:04.334547 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:04:04.334528    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b5246a1406f3f8c29f2dbf42bf71244d80f986c9fff1e041bb07769ff65c68a\": container with ID starting with 4b5246a1406f3f8c29f2dbf42bf71244d80f986c9fff1e041bb07769ff65c68a not found: ID does not exist" containerID="4b5246a1406f3f8c29f2dbf42bf71244d80f986c9fff1e041bb07769ff65c68a"
Sep 07 23:04:04.334589 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.334555    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b5246a1406f3f8c29f2dbf42bf71244d80f986c9fff1e041bb07769ff65c68a"} err="failed to get container status \"4b5246a1406f3f8c29f2dbf42bf71244d80f986c9fff1e041bb07769ff65c68a\": rpc error: code = NotFound desc = could not find container \"4b5246a1406f3f8c29f2dbf42bf71244d80f986c9fff1e041bb07769ff65c68a\": container with ID starting with 4b5246a1406f3f8c29f2dbf42bf71244d80f986c9fff1e041bb07769ff65c68a not found: ID does not exist"
Sep 07 23:04:04.336776 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.336755    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf"]
Sep 07 23:04:04.337013 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.337001    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e188de8-683a-4dca-8e93-c750028cdc18" containerName="console"
Sep 07 23:04:04.337058 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.337016    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e188de8-683a-4dca-8e93-c750028cdc18" containerName="console"
Sep 07 23:04:04.337092 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.337069    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e188de8-683a-4dca-8e93-c750028cdc18" containerName="console"
Sep 07 23:04:04.341211 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.341196    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf"
Sep 07 23:04:04.347262 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.347167    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf"]
Sep 07 23:04:04.349885 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.349866    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56b796fc48-56l55"]
Sep 07 23:04:04.353145 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.353125    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56b796fc48-56l55"]
Sep 07 23:04:04.420494 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.420464    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf\" (UID: \"c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf"
Sep 07 23:04:04.420632 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.420501    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf\" (UID: \"c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf"
Sep 07 23:04:04.420632 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.420562    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6s5q\" (UniqueName: \"kubernetes.io/projected/c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6-kube-api-access-v6s5q\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf\" (UID: \"c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf"
Sep 07 23:04:04.522024 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.521970    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6s5q\" (UniqueName: \"kubernetes.io/projected/c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6-kube-api-access-v6s5q\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf\" (UID: \"c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf"
Sep 07 23:04:04.522188 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.522058    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf\" (UID: \"c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf"
Sep 07 23:04:04.522188 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.522088    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf\" (UID: \"c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf"
Sep 07 23:04:04.522517 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.522473    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf\" (UID: \"c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf"
Sep 07 23:04:04.522635 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.522532    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf\" (UID: \"c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf"
Sep 07 23:04:04.529723 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.529696    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6s5q\" (UniqueName: \"kubernetes.io/projected/c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6-kube-api-access-v6s5q\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf\" (UID: \"c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf"
Sep 07 23:04:04.649991 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.649957    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf"
Sep 07 23:04:04.877337 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.877295    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e188de8-683a-4dca-8e93-c750028cdc18" path="/var/lib/kubelet/pods/6e188de8-683a-4dca-8e93-c750028cdc18/volumes"
Sep 07 23:04:04.930042 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:04.929947    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf"]
Sep 07 23:04:04.933722 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:04:04.933692    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3733ccb_cf8e_46ba_b792_ff44b7f8e6c6.slice/crio-7cd2f01eb179a6e8d3aba9f7eed15a826e63496c4aa7e7ac48e2e0c64d9049ba WatchSource:0}: Error finding container 7cd2f01eb179a6e8d3aba9f7eed15a826e63496c4aa7e7ac48e2e0c64d9049ba: Status 404 returned error can't find the container with id 7cd2f01eb179a6e8d3aba9f7eed15a826e63496c4aa7e7ac48e2e0c64d9049ba
Sep 07 23:04:05.332259 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.332179    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf" event={"ID":"c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6","Type":"ContainerStarted","Data":"7cd2f01eb179a6e8d3aba9f7eed15a826e63496c4aa7e7ac48e2e0c64d9049ba"}
Sep 07 23:04:05.416375 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.416338    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt"]
Sep 07 23:04:05.419775 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.419750    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt"
Sep 07 23:04:05.427045 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.427023    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt"]
Sep 07 23:04:05.529447 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.529408    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqj2x\" (UniqueName: \"kubernetes.io/projected/11a76a56-fbf5-42cf-a11f-6309f7bbb210-kube-api-access-qqj2x\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt\" (UID: \"11a76a56-fbf5-42cf-a11f-6309f7bbb210\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt"
Sep 07 23:04:05.529642 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.529467    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11a76a56-fbf5-42cf-a11f-6309f7bbb210-bundle\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt\" (UID: \"11a76a56-fbf5-42cf-a11f-6309f7bbb210\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt"
Sep 07 23:04:05.529642 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.529534    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11a76a56-fbf5-42cf-a11f-6309f7bbb210-util\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt\" (UID: \"11a76a56-fbf5-42cf-a11f-6309f7bbb210\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt"
Sep 07 23:04:05.630961 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.630809    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqj2x\" (UniqueName: \"kubernetes.io/projected/11a76a56-fbf5-42cf-a11f-6309f7bbb210-kube-api-access-qqj2x\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt\" (UID: \"11a76a56-fbf5-42cf-a11f-6309f7bbb210\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt"
Sep 07 23:04:05.630961 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.630862    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11a76a56-fbf5-42cf-a11f-6309f7bbb210-bundle\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt\" (UID: \"11a76a56-fbf5-42cf-a11f-6309f7bbb210\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt"
Sep 07 23:04:05.631197 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.631009    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11a76a56-fbf5-42cf-a11f-6309f7bbb210-util\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt\" (UID: \"11a76a56-fbf5-42cf-a11f-6309f7bbb210\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt"
Sep 07 23:04:05.631357 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.631333    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11a76a56-fbf5-42cf-a11f-6309f7bbb210-bundle\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt\" (UID: \"11a76a56-fbf5-42cf-a11f-6309f7bbb210\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt"
Sep 07 23:04:05.631438 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.631371    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11a76a56-fbf5-42cf-a11f-6309f7bbb210-util\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt\" (UID: \"11a76a56-fbf5-42cf-a11f-6309f7bbb210\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt"
Sep 07 23:04:05.639393 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.639351    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqj2x\" (UniqueName: \"kubernetes.io/projected/11a76a56-fbf5-42cf-a11f-6309f7bbb210-kube-api-access-qqj2x\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt\" (UID: \"11a76a56-fbf5-42cf-a11f-6309f7bbb210\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt"
Sep 07 23:04:05.707703 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.707669    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv"]
Sep 07 23:04:05.711603 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.711579    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv"
Sep 07 23:04:05.717799 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.717776    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv"]
Sep 07 23:04:05.732024 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.731992    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt"
Sep 07 23:04:05.803730 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.802905    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s"]
Sep 07 23:04:05.807577 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.807155    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s"
Sep 07 23:04:05.814853 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.814794    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s"]
Sep 07 23:04:05.833711 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.833673    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38e6b79b-e09d-44b3-b1e9-896a8e385abc-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv\" (UID: \"38e6b79b-e09d-44b3-b1e9-896a8e385abc\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv"
Sep 07 23:04:05.833872 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.833748    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlwtw\" (UniqueName: \"kubernetes.io/projected/38e6b79b-e09d-44b3-b1e9-896a8e385abc-kube-api-access-rlwtw\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv\" (UID: \"38e6b79b-e09d-44b3-b1e9-896a8e385abc\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv"
Sep 07 23:04:05.833872 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.833781    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38e6b79b-e09d-44b3-b1e9-896a8e385abc-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv\" (UID: \"38e6b79b-e09d-44b3-b1e9-896a8e385abc\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv"
Sep 07 23:04:05.905852 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.905783    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd"]
Sep 07 23:04:05.909362 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.909332    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd"
Sep 07 23:04:05.917444 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.917383    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd"]
Sep 07 23:04:05.934473 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.934436    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b0db969-30cf-48f1-b5a7-19b25cf4eea0-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s\" (UID: \"8b0db969-30cf-48f1-b5a7-19b25cf4eea0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s"
Sep 07 23:04:05.934590 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.934502    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlwtw\" (UniqueName: \"kubernetes.io/projected/38e6b79b-e09d-44b3-b1e9-896a8e385abc-kube-api-access-rlwtw\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv\" (UID: \"38e6b79b-e09d-44b3-b1e9-896a8e385abc\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv"
Sep 07 23:04:05.934590 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.934531    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jx4n\" (UniqueName: \"kubernetes.io/projected/8b0db969-30cf-48f1-b5a7-19b25cf4eea0-kube-api-access-8jx4n\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s\" (UID: \"8b0db969-30cf-48f1-b5a7-19b25cf4eea0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s"
Sep 07 23:04:05.934590 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.934566    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38e6b79b-e09d-44b3-b1e9-896a8e385abc-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv\" (UID: \"38e6b79b-e09d-44b3-b1e9-896a8e385abc\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv"
Sep 07 23:04:05.934716 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.934659    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38e6b79b-e09d-44b3-b1e9-896a8e385abc-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv\" (UID: \"38e6b79b-e09d-44b3-b1e9-896a8e385abc\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv"
Sep 07 23:04:05.934716 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.934676    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b0db969-30cf-48f1-b5a7-19b25cf4eea0-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s\" (UID: \"8b0db969-30cf-48f1-b5a7-19b25cf4eea0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s"
Sep 07 23:04:05.935090 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.935068    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38e6b79b-e09d-44b3-b1e9-896a8e385abc-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv\" (UID: \"38e6b79b-e09d-44b3-b1e9-896a8e385abc\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv"
Sep 07 23:04:05.935196 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.935099    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38e6b79b-e09d-44b3-b1e9-896a8e385abc-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv\" (UID: \"38e6b79b-e09d-44b3-b1e9-896a8e385abc\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv"
Sep 07 23:04:05.944105 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:05.944081    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlwtw\" (UniqueName: \"kubernetes.io/projected/38e6b79b-e09d-44b3-b1e9-896a8e385abc-kube-api-access-rlwtw\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv\" (UID: \"38e6b79b-e09d-44b3-b1e9-896a8e385abc\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv"
Sep 07 23:04:06.012844 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.012816    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v"]
Sep 07 23:04:06.015811 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:04:06.015773    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11a76a56_fbf5_42cf_a11f_6309f7bbb210.slice/crio-6a01139bb6926455493f4d8b428a397b3514db31a346042d142bfa5a98d74f3d WatchSource:0}: Error finding container 6a01139bb6926455493f4d8b428a397b3514db31a346042d142bfa5a98d74f3d: Status 404 returned error can't find the container with id 6a01139bb6926455493f4d8b428a397b3514db31a346042d142bfa5a98d74f3d
Sep 07 23:04:06.016911 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.016878    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt"]
Sep 07 23:04:06.017037 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.017016    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v"
Sep 07 23:04:06.023185 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.023165    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v"]
Sep 07 23:04:06.023795 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.023776    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv"
Sep 07 23:04:06.035184 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.035162    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jx4n\" (UniqueName: \"kubernetes.io/projected/8b0db969-30cf-48f1-b5a7-19b25cf4eea0-kube-api-access-8jx4n\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s\" (UID: \"8b0db969-30cf-48f1-b5a7-19b25cf4eea0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s"
Sep 07 23:04:06.035282 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.035213    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4smsz\" (UniqueName: \"kubernetes.io/projected/c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875-kube-api-access-4smsz\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd\" (UID: \"c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd"
Sep 07 23:04:06.035282 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.035247    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd\" (UID: \"c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd"
Sep 07 23:04:06.035380 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.035294    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b0db969-30cf-48f1-b5a7-19b25cf4eea0-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s\" (UID: \"8b0db969-30cf-48f1-b5a7-19b25cf4eea0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s"
Sep 07 23:04:06.035380 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.035316    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd\" (UID: \"c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd"
Sep 07 23:04:06.035380 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.035355    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b0db969-30cf-48f1-b5a7-19b25cf4eea0-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s\" (UID: \"8b0db969-30cf-48f1-b5a7-19b25cf4eea0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s"
Sep 07 23:04:06.035771 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.035671    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b0db969-30cf-48f1-b5a7-19b25cf4eea0-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s\" (UID: \"8b0db969-30cf-48f1-b5a7-19b25cf4eea0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s"
Sep 07 23:04:06.035771 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.035709    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b0db969-30cf-48f1-b5a7-19b25cf4eea0-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s\" (UID: \"8b0db969-30cf-48f1-b5a7-19b25cf4eea0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s"
Sep 07 23:04:06.042770 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.042746    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jx4n\" (UniqueName: \"kubernetes.io/projected/8b0db969-30cf-48f1-b5a7-19b25cf4eea0-kube-api-access-8jx4n\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s\" (UID: \"8b0db969-30cf-48f1-b5a7-19b25cf4eea0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s"
Sep 07 23:04:06.121717 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.121669    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s"
Sep 07 23:04:06.136324 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.136263    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4smsz\" (UniqueName: \"kubernetes.io/projected/c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875-kube-api-access-4smsz\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd\" (UID: \"c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd"
Sep 07 23:04:06.136324 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.136315    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd\" (UID: \"c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd"
Sep 07 23:04:06.136496 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.136365    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd\" (UID: \"c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd"
Sep 07 23:04:06.136496 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.136393    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef1d0753-dbe4-48a7-9c49-9afc9facf0ed-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v\" (UID: \"ef1d0753-dbe4-48a7-9c49-9afc9facf0ed\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v"
Sep 07 23:04:06.136496 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.136420    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef1d0753-dbe4-48a7-9c49-9afc9facf0ed-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v\" (UID: \"ef1d0753-dbe4-48a7-9c49-9afc9facf0ed\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v"
Sep 07 23:04:06.136640 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.136494    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tct2b\" (UniqueName: \"kubernetes.io/projected/ef1d0753-dbe4-48a7-9c49-9afc9facf0ed-kube-api-access-tct2b\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v\" (UID: \"ef1d0753-dbe4-48a7-9c49-9afc9facf0ed\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v"
Sep 07 23:04:06.137218 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.137120    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd\" (UID: \"c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd"
Sep 07 23:04:06.137218 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.137129    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd\" (UID: \"c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd"
Sep 07 23:04:06.144696 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.144651    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4smsz\" (UniqueName: \"kubernetes.io/projected/c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875-kube-api-access-4smsz\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd\" (UID: \"c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd"
Sep 07 23:04:06.221450 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.221417    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd"
Sep 07 23:04:06.237848 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.237824    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tct2b\" (UniqueName: \"kubernetes.io/projected/ef1d0753-dbe4-48a7-9c49-9afc9facf0ed-kube-api-access-tct2b\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v\" (UID: \"ef1d0753-dbe4-48a7-9c49-9afc9facf0ed\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v"
Sep 07 23:04:06.237977 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.237880    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef1d0753-dbe4-48a7-9c49-9afc9facf0ed-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v\" (UID: \"ef1d0753-dbe4-48a7-9c49-9afc9facf0ed\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v"
Sep 07 23:04:06.237977 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.237901    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef1d0753-dbe4-48a7-9c49-9afc9facf0ed-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v\" (UID: \"ef1d0753-dbe4-48a7-9c49-9afc9facf0ed\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v"
Sep 07 23:04:06.238290 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.238261    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef1d0753-dbe4-48a7-9c49-9afc9facf0ed-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v\" (UID: \"ef1d0753-dbe4-48a7-9c49-9afc9facf0ed\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v"
Sep 07 23:04:06.238441 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.238423    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef1d0753-dbe4-48a7-9c49-9afc9facf0ed-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v\" (UID: \"ef1d0753-dbe4-48a7-9c49-9afc9facf0ed\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v"
Sep 07 23:04:06.245566 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.245544    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tct2b\" (UniqueName: \"kubernetes.io/projected/ef1d0753-dbe4-48a7-9c49-9afc9facf0ed-kube-api-access-tct2b\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v\" (UID: \"ef1d0753-dbe4-48a7-9c49-9afc9facf0ed\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v"
Sep 07 23:04:06.305767 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.304813    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv"]
Sep 07 23:04:06.310237 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:04:06.310190    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38e6b79b_e09d_44b3_b1e9_896a8e385abc.slice/crio-f31131c19ed6038ca4215e21e435a7d7c6f64187e25060f6ffd9598986b465a0 WatchSource:0}: Error finding container f31131c19ed6038ca4215e21e435a7d7c6f64187e25060f6ffd9598986b465a0: Status 404 returned error can't find the container with id f31131c19ed6038ca4215e21e435a7d7c6f64187e25060f6ffd9598986b465a0
Sep 07 23:04:06.335016 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.334778    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v"
Sep 07 23:04:06.339771 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.339705    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv" event={"ID":"38e6b79b-e09d-44b3-b1e9-896a8e385abc","Type":"ContainerStarted","Data":"f31131c19ed6038ca4215e21e435a7d7c6f64187e25060f6ffd9598986b465a0"}
Sep 07 23:04:06.341152 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.341128    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt" event={"ID":"11a76a56-fbf5-42cf-a11f-6309f7bbb210","Type":"ContainerStarted","Data":"6a01139bb6926455493f4d8b428a397b3514db31a346042d142bfa5a98d74f3d"}
Sep 07 23:04:06.403362 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.403271    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s"]
Sep 07 23:04:06.408691 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:04:06.408657    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b0db969_30cf_48f1_b5a7_19b25cf4eea0.slice/crio-4c4de9bc098e1b2c5dbaee57c7ef26fa28ea1431b757a2e5e40842ebb4cc4bb8 WatchSource:0}: Error finding container 4c4de9bc098e1b2c5dbaee57c7ef26fa28ea1431b757a2e5e40842ebb4cc4bb8: Status 404 returned error can't find the container with id 4c4de9bc098e1b2c5dbaee57c7ef26fa28ea1431b757a2e5e40842ebb4cc4bb8
Sep 07 23:04:06.506208 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.506123    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd"]
Sep 07 23:04:06.507881 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:04:06.507850    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5f39f02_a6e6_4eb4_bda9_9ddc4aed0875.slice/crio-9acb86dc03a84363a59f418826189c20d69d4c84e02e47794a078640a4aa5622 WatchSource:0}: Error finding container 9acb86dc03a84363a59f418826189c20d69d4c84e02e47794a078640a4aa5622: Status 404 returned error can't find the container with id 9acb86dc03a84363a59f418826189c20d69d4c84e02e47794a078640a4aa5622
Sep 07 23:04:06.617902 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:06.617822    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v"]
Sep 07 23:04:06.622534 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:04:06.622504    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef1d0753_dbe4_48a7_9c49_9afc9facf0ed.slice/crio-c123c3eed32705b29c3457779842e833a8111fa9c88bd0004338068219024f6e WatchSource:0}: Error finding container c123c3eed32705b29c3457779842e833a8111fa9c88bd0004338068219024f6e: Status 404 returned error can't find the container with id c123c3eed32705b29c3457779842e833a8111fa9c88bd0004338068219024f6e
Sep 07 23:04:07.350413 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.350332    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd" event={"ID":"c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875","Type":"ContainerStarted","Data":"9acb86dc03a84363a59f418826189c20d69d4c84e02e47794a078640a4aa5622"}
Sep 07 23:04:07.352823 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.352744    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v" event={"ID":"ef1d0753-dbe4-48a7-9c49-9afc9facf0ed","Type":"ContainerStarted","Data":"c123c3eed32705b29c3457779842e833a8111fa9c88bd0004338068219024f6e"}
Sep 07 23:04:07.356348 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.356322    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s" event={"ID":"8b0db969-30cf-48f1-b5a7-19b25cf4eea0","Type":"ContainerStarted","Data":"4c4de9bc098e1b2c5dbaee57c7ef26fa28ea1431b757a2e5e40842ebb4cc4bb8"}
Sep 07 23:04:07.408732 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.407245    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"]
Sep 07 23:04:07.411672 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.410862    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.417299 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.417004    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 07 23:04:07.417299 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.417007    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-tn927\""
Sep 07 23:04:07.418187 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.418168    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"]
Sep 07 23:04:07.549306 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.549272    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.549484 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.549319    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.549484 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.549353    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sk26\" (UniqueName: \"kubernetes.io/projected/5c0d6b03-b4bf-4e4c-ab79-566560f83031-kube-api-access-8sk26\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.549484 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.549405    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.549484 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.549444    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.549484 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.549467    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.549734 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.549494    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.549734 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.549518    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.549734 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.549551    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.650245 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.650208    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.650450 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.650273    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.650450 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.650300    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.650450 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.650326    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.650450 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.650349    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.650450 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.650387    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.650749 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.650477    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.650749 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.650507    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.650749 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.650536    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sk26\" (UniqueName: \"kubernetes.io/projected/5c0d6b03-b4bf-4e4c-ab79-566560f83031-kube-api-access-8sk26\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.651250 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.651225    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.653592 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.651469    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.653592 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.652637    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.653592 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.653268    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.653592 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.653515    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.655313 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.655227    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.668134 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.668071    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sk26\" (UniqueName: \"kubernetes.io/projected/5c0d6b03-b4bf-4e4c-ab79-566560f83031-kube-api-access-8sk26\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.669841 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.669818    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.673405 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.673308    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:07.728043 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:07.727807    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:08.042177 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:08.042054    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"]
Sep 07 23:04:08.048349 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:04:08.048312    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c0d6b03_b4bf_4e4c_ab79_566560f83031.slice/crio-d5d50811d8d3946029d00388d7980208d3ca44e15bdfca386b1a229d16971896 WatchSource:0}: Error finding container d5d50811d8d3946029d00388d7980208d3ca44e15bdfca386b1a229d16971896: Status 404 returned error can't find the container with id d5d50811d8d3946029d00388d7980208d3ca44e15bdfca386b1a229d16971896
Sep 07 23:04:08.365737 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:08.365613    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf" event={"ID":"5c0d6b03-b4bf-4e4c-ab79-566560f83031","Type":"ContainerStarted","Data":"d5d50811d8d3946029d00388d7980208d3ca44e15bdfca386b1a229d16971896"}
Sep 07 23:04:10.326219 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.325821    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"]
Sep 07 23:04:10.342438 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.342414    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"]
Sep 07 23:04:10.342697 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.342682    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.478269 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.478221    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53830593-eb6a-4d68-aaed-97e53c51a711-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.478269 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.478270    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53830593-eb6a-4d68-aaed-97e53c51a711-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.478494 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.478305    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53830593-eb6a-4d68-aaed-97e53c51a711-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.478494 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.478354    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53830593-eb6a-4d68-aaed-97e53c51a711-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.478494 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.478377    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53830593-eb6a-4d68-aaed-97e53c51a711-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.478494 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.478401    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmtns\" (UniqueName: \"kubernetes.io/projected/53830593-eb6a-4d68-aaed-97e53c51a711-kube-api-access-lmtns\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.478494 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.478431    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53830593-eb6a-4d68-aaed-97e53c51a711-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.478494 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.478492    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53830593-eb6a-4d68-aaed-97e53c51a711-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.478793 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.478515    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53830593-eb6a-4d68-aaed-97e53c51a711-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.579549 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.579465    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53830593-eb6a-4d68-aaed-97e53c51a711-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.579549 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.579516    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53830593-eb6a-4d68-aaed-97e53c51a711-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.579775 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.579560    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53830593-eb6a-4d68-aaed-97e53c51a711-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.579775 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.579588    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53830593-eb6a-4d68-aaed-97e53c51a711-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.579775 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.579620    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53830593-eb6a-4d68-aaed-97e53c51a711-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.579775 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.579712    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53830593-eb6a-4d68-aaed-97e53c51a711-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.579775 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.579757    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53830593-eb6a-4d68-aaed-97e53c51a711-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.580034 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.579798    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmtns\" (UniqueName: \"kubernetes.io/projected/53830593-eb6a-4d68-aaed-97e53c51a711-kube-api-access-lmtns\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.580034 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.579830    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53830593-eb6a-4d68-aaed-97e53c51a711-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.582750 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.581232    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53830593-eb6a-4d68-aaed-97e53c51a711-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.582750 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.581534    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53830593-eb6a-4d68-aaed-97e53c51a711-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.582750 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.581592    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53830593-eb6a-4d68-aaed-97e53c51a711-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.582750 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.581758    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53830593-eb6a-4d68-aaed-97e53c51a711-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.582750 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.582264    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53830593-eb6a-4d68-aaed-97e53c51a711-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.586456 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.586432    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53830593-eb6a-4d68-aaed-97e53c51a711-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.593080 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.593016    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53830593-eb6a-4d68-aaed-97e53c51a711-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.594075 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.594053    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmtns\" (UniqueName: \"kubernetes.io/projected/53830593-eb6a-4d68-aaed-97e53c51a711-kube-api-access-lmtns\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.596506 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.596467    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53830593-eb6a-4d68-aaed-97e53c51a711-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g\" (UID: \"53830593-eb6a-4d68-aaed-97e53c51a711\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:10.661790 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:10.661529    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:15.534712 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:15.534023    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 07 23:04:15.534712 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:15.534121    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 07 23:04:15.534712 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:15.534163    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 07 23:04:15.767743 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:15.767620    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"]
Sep 07 23:04:15.897780 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:04:15.897749    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53830593_eb6a_4d68_aaed_97e53c51a711.slice/crio-57f8d0adf446a96d700e4d4e9d87279d74c32f956fdfc84a0b4128559e2c67ec WatchSource:0}: Error finding container 57f8d0adf446a96d700e4d4e9d87279d74c32f956fdfc84a0b4128559e2c67ec: Status 404 returned error can't find the container with id 57f8d0adf446a96d700e4d4e9d87279d74c32f956fdfc84a0b4128559e2c67ec
Sep 07 23:04:15.901399 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:15.901362    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 07 23:04:15.901490 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:15.901446    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 07 23:04:15.901558 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:15.901498    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 07 23:04:16.442036 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:16.441998    2557 generic.go:356] "Generic (PLEG): container finished" podID="11a76a56-fbf5-42cf-a11f-6309f7bbb210" containerID="3f887b81640421d6f37c5eea02e23d8fba6bcacc037e3efad498554613df67b5" exitCode=0
Sep 07 23:04:16.442217 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:16.442086    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt" event={"ID":"11a76a56-fbf5-42cf-a11f-6309f7bbb210","Type":"ContainerDied","Data":"3f887b81640421d6f37c5eea02e23d8fba6bcacc037e3efad498554613df67b5"}
Sep 07 23:04:16.444101 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:16.444072    2557 generic.go:356] "Generic (PLEG): container finished" podID="c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875" containerID="0a06ba3dcd933ab9cfa1984e09592377e398dec967f49a5e0af34e447f282900" exitCode=0
Sep 07 23:04:16.444313 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:16.444159    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd" event={"ID":"c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875","Type":"ContainerDied","Data":"0a06ba3dcd933ab9cfa1984e09592377e398dec967f49a5e0af34e447f282900"}
Sep 07 23:04:16.446096 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:16.446064    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g" event={"ID":"53830593-eb6a-4d68-aaed-97e53c51a711","Type":"ContainerStarted","Data":"80ef97368287d21fe453deb08aef52d047edf630b9ac9ec9a69bc1133fc9bc33"}
Sep 07 23:04:16.446204 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:16.446120    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g" event={"ID":"53830593-eb6a-4d68-aaed-97e53c51a711","Type":"ContainerStarted","Data":"57f8d0adf446a96d700e4d4e9d87279d74c32f956fdfc84a0b4128559e2c67ec"}
Sep 07 23:04:16.447786 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:16.447766    2557 generic.go:356] "Generic (PLEG): container finished" podID="ef1d0753-dbe4-48a7-9c49-9afc9facf0ed" containerID="bab29937190464249101bd6d655aad09c1c19528917273c386bf38224c713bd2" exitCode=0
Sep 07 23:04:16.447883 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:16.447837    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v" event={"ID":"ef1d0753-dbe4-48a7-9c49-9afc9facf0ed","Type":"ContainerDied","Data":"bab29937190464249101bd6d655aad09c1c19528917273c386bf38224c713bd2"}
Sep 07 23:04:16.449603 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:16.449584    2557 generic.go:356] "Generic (PLEG): container finished" podID="ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc" containerID="0c8d8d60f48e8a26142e2e2d900fdbd5f0c0405d09d34f6a9c17b49432760b15" exitCode=0
Sep 07 23:04:16.449684 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:16.449644    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8" event={"ID":"ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc","Type":"ContainerDied","Data":"0c8d8d60f48e8a26142e2e2d900fdbd5f0c0405d09d34f6a9c17b49432760b15"}
Sep 07 23:04:16.451445 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:16.451417    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf" event={"ID":"5c0d6b03-b4bf-4e4c-ab79-566560f83031","Type":"ContainerStarted","Data":"7544751c7c6388631001ccecfebe4daaf57886ccf5c2327539b77a073bd45446"}
Sep 07 23:04:16.452839 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:16.452820    2557 generic.go:356] "Generic (PLEG): container finished" podID="c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6" containerID="9e00797121159824a9b928fc70ffaa1476a47b7c92f0195d114aee8ff4533974" exitCode=0
Sep 07 23:04:16.452955 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:16.452878    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf" event={"ID":"c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6","Type":"ContainerDied","Data":"9e00797121159824a9b928fc70ffaa1476a47b7c92f0195d114aee8ff4533974"}
Sep 07 23:04:16.454637 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:16.454615    2557 generic.go:356] "Generic (PLEG): container finished" podID="8b0db969-30cf-48f1-b5a7-19b25cf4eea0" containerID="69791599f166e92792de19303caa0c69f31230e07ddd97c0fa3f6c2479873edc" exitCode=0
Sep 07 23:04:16.454730 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:16.454687    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s" event={"ID":"8b0db969-30cf-48f1-b5a7-19b25cf4eea0","Type":"ContainerDied","Data":"69791599f166e92792de19303caa0c69f31230e07ddd97c0fa3f6c2479873edc"}
Sep 07 23:04:16.456462 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:16.456445    2557 generic.go:356] "Generic (PLEG): container finished" podID="38e6b79b-e09d-44b3-b1e9-896a8e385abc" containerID="17df599c9d586d45033f2eb16fa5330cb38646afb08cc21eee6623fddae2dc35" exitCode=0
Sep 07 23:04:16.456548 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:16.456470    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv" event={"ID":"38e6b79b-e09d-44b3-b1e9-896a8e385abc","Type":"ContainerDied","Data":"17df599c9d586d45033f2eb16fa5330cb38646afb08cc21eee6623fddae2dc35"}
Sep 07 23:04:16.503327 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:16.503290    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g" podStartSLOduration=6.503277712 podStartE2EDuration="6.503277712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:04:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:04:16.502179531 +0000 UTC m=+448.130661864" watchObservedRunningTime="2026-09-07 23:04:16.503277712 +0000 UTC m=+448.131760045"
Sep 07 23:04:16.544408 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:16.544369    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf" podStartSLOduration=2.061706489 podStartE2EDuration="9.544357615s" totalImagesPullingTime="7.482651126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:04:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:04:16.544015318 +0000 UTC m=+448.172497667" watchObservedRunningTime="2026-09-07 23:04:16.544357615 +0000 UTC m=+448.172839950"
Sep 07 23:04:16.662811 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:16.662782    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:16.728207 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:16.728116    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:16.729462 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:16.729440    2557 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Sep 07 23:04:16.729556 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:16.729492    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf" podUID="5c0d6b03-b4bf-4e4c-ab79-566560f83031" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Sep 07 23:04:17.465308 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:17.465278    2557 generic.go:356] "Generic (PLEG): container finished" podID="11a76a56-fbf5-42cf-a11f-6309f7bbb210" containerID="ead9264e1fbf1765f2aa2d5a5161791186e4ad052ffcfabe3467989418f36bc0" exitCode=0
Sep 07 23:04:17.465450 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:17.465387    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt" event={"ID":"11a76a56-fbf5-42cf-a11f-6309f7bbb210","Type":"ContainerDied","Data":"ead9264e1fbf1765f2aa2d5a5161791186e4ad052ffcfabe3467989418f36bc0"}
Sep 07 23:04:17.468963 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:17.468403    2557 generic.go:356] "Generic (PLEG): container finished" podID="ef1d0753-dbe4-48a7-9c49-9afc9facf0ed" containerID="4e678133bdc81a9a9bb54db2f64ae962e86af07ff64a7b86739f33c6a1a498df" exitCode=0
Sep 07 23:04:17.469146 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:17.468959    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v" event={"ID":"ef1d0753-dbe4-48a7-9c49-9afc9facf0ed","Type":"ContainerDied","Data":"4e678133bdc81a9a9bb54db2f64ae962e86af07ff64a7b86739f33c6a1a498df"}
Sep 07 23:04:17.668152 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:17.668128    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:17.728361 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:17.728332    2557 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Sep 07 23:04:17.728466 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:17.728382    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf" podUID="5c0d6b03-b4bf-4e4c-ab79-566560f83031" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Sep 07 23:04:18.475700 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:18.475661    2557 generic.go:356] "Generic (PLEG): container finished" podID="8b0db969-30cf-48f1-b5a7-19b25cf4eea0" containerID="f334952a87dd1db2795fe0f4937373a53a522a4a59da430608c88f91956dd736" exitCode=0
Sep 07 23:04:18.475853 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:18.475741    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s" event={"ID":"8b0db969-30cf-48f1-b5a7-19b25cf4eea0","Type":"ContainerDied","Data":"f334952a87dd1db2795fe0f4937373a53a522a4a59da430608c88f91956dd736"}
Sep 07 23:04:18.477961 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:18.477940    2557 generic.go:356] "Generic (PLEG): container finished" podID="38e6b79b-e09d-44b3-b1e9-896a8e385abc" containerID="bf2a9edc8ddcc0eb1aed5c2c9d2f904fca7456c0f4e2037760dae16e06d53d24" exitCode=0
Sep 07 23:04:18.478056 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:18.478024    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv" event={"ID":"38e6b79b-e09d-44b3-b1e9-896a8e385abc","Type":"ContainerDied","Data":"bf2a9edc8ddcc0eb1aed5c2c9d2f904fca7456c0f4e2037760dae16e06d53d24"}
Sep 07 23:04:18.480433 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:18.480412    2557 generic.go:356] "Generic (PLEG): container finished" podID="c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875" containerID="e855dbbe1326597d0ddd477af6336eb0945095fa7c4b433073dafa8af8861a70" exitCode=0
Sep 07 23:04:18.480631 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:18.480525    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd" event={"ID":"c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875","Type":"ContainerDied","Data":"e855dbbe1326597d0ddd477af6336eb0945095fa7c4b433073dafa8af8861a70"}
Sep 07 23:04:18.480865 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:18.480845    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:18.481980 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:18.481938    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g"
Sep 07 23:04:18.542561 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:18.542532    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"]
Sep 07 23:04:18.728423 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:18.728382    2557 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Sep 07 23:04:18.728875 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:18.728460    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf" podUID="5c0d6b03-b4bf-4e4c-ab79-566560f83031" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Sep 07 23:04:19.490633 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:19.490596    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf" podUID="5c0d6b03-b4bf-4e4c-ab79-566560f83031" containerName="istio-proxy" containerID="cri-o://7544751c7c6388631001ccecfebe4daaf57886ccf5c2327539b77a073bd45446" gracePeriod=30
Sep 07 23:04:20.502940 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:20.502031    2557 generic.go:356] "Generic (PLEG): container finished" podID="ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc" containerID="6ecc9db3c4334f789c6a0b1b544eaa6a69fd2318a19e4a2e1449617e8825c3e2" exitCode=0
Sep 07 23:04:20.502940 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:20.502145    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8" event={"ID":"ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc","Type":"ContainerDied","Data":"6ecc9db3c4334f789c6a0b1b544eaa6a69fd2318a19e4a2e1449617e8825c3e2"}
Sep 07 23:04:20.513591 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:20.512480    2557 generic.go:356] "Generic (PLEG): container finished" podID="c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6" containerID="e6659f19988afc18548ed88699e3c567c5f04df8618171571dfb225b9a26c259" exitCode=0
Sep 07 23:04:20.513591 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:20.512665    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf" event={"ID":"c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6","Type":"ContainerDied","Data":"e6659f19988afc18548ed88699e3c567c5f04df8618171571dfb225b9a26c259"}
Sep 07 23:04:22.728808 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:22.728774    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:24.940688 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:24.940662    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:25.119962 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.119868    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8sk26\" (UniqueName: \"kubernetes.io/projected/5c0d6b03-b4bf-4e4c-ab79-566560f83031-kube-api-access-8sk26\") pod \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") "
Sep 07 23:04:25.120180 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.119979    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istio-envoy\") pod \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") "
Sep 07 23:04:25.120180 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.120013    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istio-data\") pod \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") "
Sep 07 23:04:25.120180 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.120047    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istiod-ca-cert\") pod \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") "
Sep 07 23:04:25.120180 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.120076    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istio-podinfo\") pod \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") "
Sep 07 23:04:25.120180 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.120113    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istio-token\") pod \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") "
Sep 07 23:04:25.120180 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.120145    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-workload-certs\") pod \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") "
Sep 07 23:04:25.120544 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.120199    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-credential-socket\") pod \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") "
Sep 07 23:04:25.120544 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.120229    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-workload-socket\") pod \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\" (UID: \"5c0d6b03-b4bf-4e4c-ab79-566560f83031\") "
Sep 07 23:04:25.121053 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.121024    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5c0d6b03-b4bf-4e4c-ab79-566560f83031" (UID: "5c0d6b03-b4bf-4e4c-ab79-566560f83031"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 23:04:25.121388 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.121363    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istio-data" (OuterVolumeSpecName: "istio-data") pod "5c0d6b03-b4bf-4e4c-ab79-566560f83031" (UID: "5c0d6b03-b4bf-4e4c-ab79-566560f83031"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 23:04:25.121784 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.121537    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5c0d6b03-b4bf-4e4c-ab79-566560f83031" (UID: "5c0d6b03-b4bf-4e4c-ab79-566560f83031"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 23:04:25.121784 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.121694    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5c0d6b03-b4bf-4e4c-ab79-566560f83031" (UID: "5c0d6b03-b4bf-4e4c-ab79-566560f83031"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 23:04:25.121784 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.121734    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5c0d6b03-b4bf-4e4c-ab79-566560f83031" (UID: "5c0d6b03-b4bf-4e4c-ab79-566560f83031"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 23:04:25.126025 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.125904    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5c0d6b03-b4bf-4e4c-ab79-566560f83031" (UID: "5c0d6b03-b4bf-4e4c-ab79-566560f83031"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 23:04:25.128821 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.128715    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5c0d6b03-b4bf-4e4c-ab79-566560f83031" (UID: "5c0d6b03-b4bf-4e4c-ab79-566560f83031"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 23:04:25.128977 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.128944    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istio-token" (OuterVolumeSpecName: "istio-token") pod "5c0d6b03-b4bf-4e4c-ab79-566560f83031" (UID: "5c0d6b03-b4bf-4e4c-ab79-566560f83031"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 23:04:25.130005 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.129910    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c0d6b03-b4bf-4e4c-ab79-566560f83031-kube-api-access-8sk26" (OuterVolumeSpecName: "kube-api-access-8sk26") pod "5c0d6b03-b4bf-4e4c-ab79-566560f83031" (UID: "5c0d6b03-b4bf-4e4c-ab79-566560f83031"). InnerVolumeSpecName "kube-api-access-8sk26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 23:04:25.221389 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.221230    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istio-envoy\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:25.221389 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.221263    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istio-data\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:25.221389 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.221278    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istiod-ca-cert\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:25.221389 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.221291    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istio-podinfo\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:25.221389 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.221303    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c0d6b03-b4bf-4e4c-ab79-566560f83031-istio-token\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:25.221389 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.221317    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-workload-certs\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:25.221389 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.221330    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-credential-socket\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:25.221389 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.221344    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c0d6b03-b4bf-4e4c-ab79-566560f83031-workload-socket\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:25.221389 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.221357    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sk26\" (UniqueName: \"kubernetes.io/projected/5c0d6b03-b4bf-4e4c-ab79-566560f83031-kube-api-access-8sk26\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:25.579216 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.579172    2557 generic.go:356] "Generic (PLEG): container finished" podID="5c0d6b03-b4bf-4e4c-ab79-566560f83031" containerID="7544751c7c6388631001ccecfebe4daaf57886ccf5c2327539b77a073bd45446" exitCode=0
Sep 07 23:04:25.579372 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.579227    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"
Sep 07 23:04:25.579372 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.579267    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf" event={"ID":"5c0d6b03-b4bf-4e4c-ab79-566560f83031","Type":"ContainerDied","Data":"7544751c7c6388631001ccecfebe4daaf57886ccf5c2327539b77a073bd45446"}
Sep 07 23:04:25.579372 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.579311    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf" event={"ID":"5c0d6b03-b4bf-4e4c-ab79-566560f83031","Type":"ContainerDied","Data":"d5d50811d8d3946029d00388d7980208d3ca44e15bdfca386b1a229d16971896"}
Sep 07 23:04:25.579372 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.579341    2557 scope.go:117] "RemoveContainer" containerID="7544751c7c6388631001ccecfebe4daaf57886ccf5c2327539b77a073bd45446"
Sep 07 23:04:25.601232 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.601210    2557 scope.go:117] "RemoveContainer" containerID="7544751c7c6388631001ccecfebe4daaf57886ccf5c2327539b77a073bd45446"
Sep 07 23:04:25.601929 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:04:25.601838    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7544751c7c6388631001ccecfebe4daaf57886ccf5c2327539b77a073bd45446\": container with ID starting with 7544751c7c6388631001ccecfebe4daaf57886ccf5c2327539b77a073bd45446 not found: ID does not exist" containerID="7544751c7c6388631001ccecfebe4daaf57886ccf5c2327539b77a073bd45446"
Sep 07 23:04:25.601929 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.601876    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7544751c7c6388631001ccecfebe4daaf57886ccf5c2327539b77a073bd45446"} err="failed to get container status \"7544751c7c6388631001ccecfebe4daaf57886ccf5c2327539b77a073bd45446\": rpc error: code = NotFound desc = could not find container \"7544751c7c6388631001ccecfebe4daaf57886ccf5c2327539b77a073bd45446\": container with ID starting with 7544751c7c6388631001ccecfebe4daaf57886ccf5c2327539b77a073bd45446 not found: ID does not exist"
Sep 07 23:04:25.607644 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.607614    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"]
Sep 07 23:04:25.610714 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:25.610692    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-42bkf"]
Sep 07 23:04:26.881519 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:26.881155    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c0d6b03-b4bf-4e4c-ab79-566560f83031" path="/var/lib/kubelet/pods/5c0d6b03-b4bf-4e4c-ab79-566560f83031/volumes"
Sep 07 23:04:29.607151 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:29.607110    2557 generic.go:356] "Generic (PLEG): container finished" podID="ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc" containerID="3e37c7312a3dfbd9b01a98a68ea84cff8ddc3b3a265f76da61bb6de6ae7b30e6" exitCode=0
Sep 07 23:04:29.607599 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:29.607270    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8" event={"ID":"ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc","Type":"ContainerDied","Data":"3e37c7312a3dfbd9b01a98a68ea84cff8ddc3b3a265f76da61bb6de6ae7b30e6"}
Sep 07 23:04:29.609648 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:29.609624    2557 generic.go:356] "Generic (PLEG): container finished" podID="38e6b79b-e09d-44b3-b1e9-896a8e385abc" containerID="38f2a6492de8208df409ede9ff98002aab6af8e559321036b6254833eca71f7b" exitCode=0
Sep 07 23:04:29.609742 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:29.609713    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv" event={"ID":"38e6b79b-e09d-44b3-b1e9-896a8e385abc","Type":"ContainerDied","Data":"38f2a6492de8208df409ede9ff98002aab6af8e559321036b6254833eca71f7b"}
Sep 07 23:04:29.612104 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:29.612081    2557 generic.go:356] "Generic (PLEG): container finished" podID="11a76a56-fbf5-42cf-a11f-6309f7bbb210" containerID="f5695f19bbff6a0b9e01a01094ad6d6327471868c5cce27e87a47905e68d2062" exitCode=0
Sep 07 23:04:29.612221 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:29.612141    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt" event={"ID":"11a76a56-fbf5-42cf-a11f-6309f7bbb210","Type":"ContainerDied","Data":"f5695f19bbff6a0b9e01a01094ad6d6327471868c5cce27e87a47905e68d2062"}
Sep 07 23:04:30.623969 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.623933    2557 generic.go:356] "Generic (PLEG): container finished" podID="c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6" containerID="057bd0f15c6767df2e7edae57c02b5dc5a2f681e8efce56cff7370ead25773c7" exitCode=0
Sep 07 23:04:30.624410 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.624007    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf" event={"ID":"c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6","Type":"ContainerDied","Data":"057bd0f15c6767df2e7edae57c02b5dc5a2f681e8efce56cff7370ead25773c7"}
Sep 07 23:04:30.626007 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.625987    2557 generic.go:356] "Generic (PLEG): container finished" podID="8b0db969-30cf-48f1-b5a7-19b25cf4eea0" containerID="79665c08574ab2d3583091ca974f5df4cb52a2e3713c8faec0813fa09187968e" exitCode=0
Sep 07 23:04:30.626104 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.626067    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s" event={"ID":"8b0db969-30cf-48f1-b5a7-19b25cf4eea0","Type":"ContainerDied","Data":"79665c08574ab2d3583091ca974f5df4cb52a2e3713c8faec0813fa09187968e"}
Sep 07 23:04:30.627969 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.627950    2557 generic.go:356] "Generic (PLEG): container finished" podID="c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875" containerID="ca9a2b1fd082b07e223696a3a11a92177df9f1100e7bcdfb8cf138be266cdee9" exitCode=0
Sep 07 23:04:30.628041 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.628013    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd" event={"ID":"c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875","Type":"ContainerDied","Data":"ca9a2b1fd082b07e223696a3a11a92177df9f1100e7bcdfb8cf138be266cdee9"}
Sep 07 23:04:30.629906 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.629887    2557 generic.go:356] "Generic (PLEG): container finished" podID="ef1d0753-dbe4-48a7-9c49-9afc9facf0ed" containerID="b552800e87cd667004729e1204dea5ee36ccef2d803c61a6b43a1cd89610f43c" exitCode=0
Sep 07 23:04:30.629983 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.629940    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v" event={"ID":"ef1d0753-dbe4-48a7-9c49-9afc9facf0ed","Type":"ContainerDied","Data":"b552800e87cd667004729e1204dea5ee36ccef2d803c61a6b43a1cd89610f43c"}
Sep 07 23:04:30.766875 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.766844    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv"
Sep 07 23:04:30.769052 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.769029    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38e6b79b-e09d-44b3-b1e9-896a8e385abc-util\") pod \"38e6b79b-e09d-44b3-b1e9-896a8e385abc\" (UID: \"38e6b79b-e09d-44b3-b1e9-896a8e385abc\") "
Sep 07 23:04:30.769163 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.769080    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlwtw\" (UniqueName: \"kubernetes.io/projected/38e6b79b-e09d-44b3-b1e9-896a8e385abc-kube-api-access-rlwtw\") pod \"38e6b79b-e09d-44b3-b1e9-896a8e385abc\" (UID: \"38e6b79b-e09d-44b3-b1e9-896a8e385abc\") "
Sep 07 23:04:30.771610 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.771584    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38e6b79b-e09d-44b3-b1e9-896a8e385abc-kube-api-access-rlwtw" (OuterVolumeSpecName: "kube-api-access-rlwtw") pod "38e6b79b-e09d-44b3-b1e9-896a8e385abc" (UID: "38e6b79b-e09d-44b3-b1e9-896a8e385abc"). InnerVolumeSpecName "kube-api-access-rlwtw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 23:04:30.776449 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.776426    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38e6b79b-e09d-44b3-b1e9-896a8e385abc-util" (OuterVolumeSpecName: "util") pod "38e6b79b-e09d-44b3-b1e9-896a8e385abc" (UID: "38e6b79b-e09d-44b3-b1e9-896a8e385abc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 23:04:30.791186 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.791165    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt"
Sep 07 23:04:30.810621 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.810601    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8"
Sep 07 23:04:30.869987 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.869966    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38e6b79b-e09d-44b3-b1e9-896a8e385abc-bundle\") pod \"38e6b79b-e09d-44b3-b1e9-896a8e385abc\" (UID: \"38e6b79b-e09d-44b3-b1e9-896a8e385abc\") "
Sep 07 23:04:30.870111 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.870006    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc-bundle\") pod \"ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc\" (UID: \"ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc\") "
Sep 07 23:04:30.870111 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.870025    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc-util\") pod \"ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc\" (UID: \"ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc\") "
Sep 07 23:04:30.870111 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.870058    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11a76a56-fbf5-42cf-a11f-6309f7bbb210-util\") pod \"11a76a56-fbf5-42cf-a11f-6309f7bbb210\" (UID: \"11a76a56-fbf5-42cf-a11f-6309f7bbb210\") "
Sep 07 23:04:30.870111 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.870091    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11a76a56-fbf5-42cf-a11f-6309f7bbb210-bundle\") pod \"11a76a56-fbf5-42cf-a11f-6309f7bbb210\" (UID: \"11a76a56-fbf5-42cf-a11f-6309f7bbb210\") "
Sep 07 23:04:30.870329 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.870118    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjn67\" (UniqueName: \"kubernetes.io/projected/ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc-kube-api-access-rjn67\") pod \"ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc\" (UID: \"ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc\") "
Sep 07 23:04:30.870329 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.870149    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqj2x\" (UniqueName: \"kubernetes.io/projected/11a76a56-fbf5-42cf-a11f-6309f7bbb210-kube-api-access-qqj2x\") pod \"11a76a56-fbf5-42cf-a11f-6309f7bbb210\" (UID: \"11a76a56-fbf5-42cf-a11f-6309f7bbb210\") "
Sep 07 23:04:30.870430 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.870354    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38e6b79b-e09d-44b3-b1e9-896a8e385abc-util\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:30.870430 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.870373    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlwtw\" (UniqueName: \"kubernetes.io/projected/38e6b79b-e09d-44b3-b1e9-896a8e385abc-kube-api-access-rlwtw\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:30.870999 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.870974    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38e6b79b-e09d-44b3-b1e9-896a8e385abc-bundle" (OuterVolumeSpecName: "bundle") pod "38e6b79b-e09d-44b3-b1e9-896a8e385abc" (UID: "38e6b79b-e09d-44b3-b1e9-896a8e385abc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 23:04:30.871093 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.871029    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc-bundle" (OuterVolumeSpecName: "bundle") pod "ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc" (UID: "ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 23:04:30.871093 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.871051    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11a76a56-fbf5-42cf-a11f-6309f7bbb210-bundle" (OuterVolumeSpecName: "bundle") pod "11a76a56-fbf5-42cf-a11f-6309f7bbb210" (UID: "11a76a56-fbf5-42cf-a11f-6309f7bbb210"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 23:04:30.873688 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.873662    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11a76a56-fbf5-42cf-a11f-6309f7bbb210-kube-api-access-qqj2x" (OuterVolumeSpecName: "kube-api-access-qqj2x") pod "11a76a56-fbf5-42cf-a11f-6309f7bbb210" (UID: "11a76a56-fbf5-42cf-a11f-6309f7bbb210"). InnerVolumeSpecName "kube-api-access-qqj2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 23:04:30.873872 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.873847    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc-kube-api-access-rjn67" (OuterVolumeSpecName: "kube-api-access-rjn67") pod "ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc" (UID: "ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc"). InnerVolumeSpecName "kube-api-access-rjn67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 23:04:30.877046 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.876998    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11a76a56-fbf5-42cf-a11f-6309f7bbb210-util" (OuterVolumeSpecName: "util") pod "11a76a56-fbf5-42cf-a11f-6309f7bbb210" (UID: "11a76a56-fbf5-42cf-a11f-6309f7bbb210"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 23:04:30.877120 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.877065    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc-util" (OuterVolumeSpecName: "util") pod "ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc" (UID: "ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 23:04:30.970965 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.970937    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11a76a56-fbf5-42cf-a11f-6309f7bbb210-bundle\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:30.971048 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.970967    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjn67\" (UniqueName: \"kubernetes.io/projected/ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc-kube-api-access-rjn67\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:30.971048 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.970981    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqj2x\" (UniqueName: \"kubernetes.io/projected/11a76a56-fbf5-42cf-a11f-6309f7bbb210-kube-api-access-qqj2x\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:30.971048 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.970994    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38e6b79b-e09d-44b3-b1e9-896a8e385abc-bundle\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:30.971048 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.971007    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc-bundle\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:30.971048 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.971017    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc-util\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:30.971048 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:30.971028    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11a76a56-fbf5-42cf-a11f-6309f7bbb210-util\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:31.636682 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.636651    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv"
Sep 07 23:04:31.637116 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.636650    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cz6vnv" event={"ID":"38e6b79b-e09d-44b3-b1e9-896a8e385abc","Type":"ContainerDied","Data":"f31131c19ed6038ca4215e21e435a7d7c6f64187e25060f6ffd9598986b465a0"}
Sep 07 23:04:31.637116 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.636771    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f31131c19ed6038ca4215e21e435a7d7c6f64187e25060f6ffd9598986b465a0"
Sep 07 23:04:31.638839 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.638813    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt"
Sep 07 23:04:31.638839 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.638821    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e89tdt" event={"ID":"11a76a56-fbf5-42cf-a11f-6309f7bbb210","Type":"ContainerDied","Data":"6a01139bb6926455493f4d8b428a397b3514db31a346042d142bfa5a98d74f3d"}
Sep 07 23:04:31.639056 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.638863    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a01139bb6926455493f4d8b428a397b3514db31a346042d142bfa5a98d74f3d"
Sep 07 23:04:31.640808 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.640789    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8"
Sep 07 23:04:31.640947 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.640823    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406h4p8" event={"ID":"ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc","Type":"ContainerDied","Data":"3deac2e1701240abf4a87cb8b10f82f4a8a6781a93f15882048c8fc31d08cb53"}
Sep 07 23:04:31.640947 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.640857    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3deac2e1701240abf4a87cb8b10f82f4a8a6781a93f15882048c8fc31d08cb53"
Sep 07 23:04:31.845223 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.845201    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v"
Sep 07 23:04:31.864853 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.864825    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf"
Sep 07 23:04:31.876881 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.876859    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef1d0753-dbe4-48a7-9c49-9afc9facf0ed-bundle\") pod \"ef1d0753-dbe4-48a7-9c49-9afc9facf0ed\" (UID: \"ef1d0753-dbe4-48a7-9c49-9afc9facf0ed\") "
Sep 07 23:04:31.877009 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.876890    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef1d0753-dbe4-48a7-9c49-9afc9facf0ed-util\") pod \"ef1d0753-dbe4-48a7-9c49-9afc9facf0ed\" (UID: \"ef1d0753-dbe4-48a7-9c49-9afc9facf0ed\") "
Sep 07 23:04:31.877009 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.876949    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tct2b\" (UniqueName: \"kubernetes.io/projected/ef1d0753-dbe4-48a7-9c49-9afc9facf0ed-kube-api-access-tct2b\") pod \"ef1d0753-dbe4-48a7-9c49-9afc9facf0ed\" (UID: \"ef1d0753-dbe4-48a7-9c49-9afc9facf0ed\") "
Sep 07 23:04:31.877009 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.876973    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6-util\") pod \"c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6\" (UID: \"c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6\") "
Sep 07 23:04:31.877009 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.876988    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6-bundle\") pod \"c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6\" (UID: \"c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6\") "
Sep 07 23:04:31.877225 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.877018    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6s5q\" (UniqueName: \"kubernetes.io/projected/c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6-kube-api-access-v6s5q\") pod \"c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6\" (UID: \"c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6\") "
Sep 07 23:04:31.877492 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.877466    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6-bundle" (OuterVolumeSpecName: "bundle") pod "c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6" (UID: "c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 23:04:31.877492 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.877475    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef1d0753-dbe4-48a7-9c49-9afc9facf0ed-bundle" (OuterVolumeSpecName: "bundle") pod "ef1d0753-dbe4-48a7-9c49-9afc9facf0ed" (UID: "ef1d0753-dbe4-48a7-9c49-9afc9facf0ed"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 23:04:31.879115 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.879088    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef1d0753-dbe4-48a7-9c49-9afc9facf0ed-kube-api-access-tct2b" (OuterVolumeSpecName: "kube-api-access-tct2b") pod "ef1d0753-dbe4-48a7-9c49-9afc9facf0ed" (UID: "ef1d0753-dbe4-48a7-9c49-9afc9facf0ed"). InnerVolumeSpecName "kube-api-access-tct2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 23:04:31.879195 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.879143    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6-kube-api-access-v6s5q" (OuterVolumeSpecName: "kube-api-access-v6s5q") pod "c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6" (UID: "c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6"). InnerVolumeSpecName "kube-api-access-v6s5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 23:04:31.883110 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.883088    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6-util" (OuterVolumeSpecName: "util") pod "c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6" (UID: "c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 23:04:31.884682 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.884667    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s"
Sep 07 23:04:31.885095 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.885072    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef1d0753-dbe4-48a7-9c49-9afc9facf0ed-util" (OuterVolumeSpecName: "util") pod "ef1d0753-dbe4-48a7-9c49-9afc9facf0ed" (UID: "ef1d0753-dbe4-48a7-9c49-9afc9facf0ed"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 23:04:31.912213 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.912165    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd"
Sep 07 23:04:31.977558 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.977529    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b0db969-30cf-48f1-b5a7-19b25cf4eea0-util\") pod \"8b0db969-30cf-48f1-b5a7-19b25cf4eea0\" (UID: \"8b0db969-30cf-48f1-b5a7-19b25cf4eea0\") "
Sep 07 23:04:31.977708 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.977584    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b0db969-30cf-48f1-b5a7-19b25cf4eea0-bundle\") pod \"8b0db969-30cf-48f1-b5a7-19b25cf4eea0\" (UID: \"8b0db969-30cf-48f1-b5a7-19b25cf4eea0\") "
Sep 07 23:04:31.977708 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.977617    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875-util\") pod \"c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875\" (UID: \"c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875\") "
Sep 07 23:04:31.977708 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.977635    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875-bundle\") pod \"c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875\" (UID: \"c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875\") "
Sep 07 23:04:31.977708 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.977672    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4smsz\" (UniqueName: \"kubernetes.io/projected/c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875-kube-api-access-4smsz\") pod \"c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875\" (UID: \"c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875\") "
Sep 07 23:04:31.977708 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.977703    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jx4n\" (UniqueName: \"kubernetes.io/projected/8b0db969-30cf-48f1-b5a7-19b25cf4eea0-kube-api-access-8jx4n\") pod \"8b0db969-30cf-48f1-b5a7-19b25cf4eea0\" (UID: \"8b0db969-30cf-48f1-b5a7-19b25cf4eea0\") "
Sep 07 23:04:31.977997 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.977880    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef1d0753-dbe4-48a7-9c49-9afc9facf0ed-util\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:31.977997 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.977898    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tct2b\" (UniqueName: \"kubernetes.io/projected/ef1d0753-dbe4-48a7-9c49-9afc9facf0ed-kube-api-access-tct2b\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:31.977997 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.977925    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6-util\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:31.977997 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.977940    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6-bundle\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:31.977997 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.977965    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6s5q\" (UniqueName: \"kubernetes.io/projected/c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6-kube-api-access-v6s5q\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:31.977997 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.977977    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef1d0753-dbe4-48a7-9c49-9afc9facf0ed-bundle\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:31.978287 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.978253    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b0db969-30cf-48f1-b5a7-19b25cf4eea0-bundle" (OuterVolumeSpecName: "bundle") pod "8b0db969-30cf-48f1-b5a7-19b25cf4eea0" (UID: "8b0db969-30cf-48f1-b5a7-19b25cf4eea0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 23:04:31.978574 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.978549    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875-bundle" (OuterVolumeSpecName: "bundle") pod "c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875" (UID: "c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 23:04:31.980413 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.980393    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875-kube-api-access-4smsz" (OuterVolumeSpecName: "kube-api-access-4smsz") pod "c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875" (UID: "c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875"). InnerVolumeSpecName "kube-api-access-4smsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 23:04:31.980484 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.980457    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b0db969-30cf-48f1-b5a7-19b25cf4eea0-kube-api-access-8jx4n" (OuterVolumeSpecName: "kube-api-access-8jx4n") pod "8b0db969-30cf-48f1-b5a7-19b25cf4eea0" (UID: "8b0db969-30cf-48f1-b5a7-19b25cf4eea0"). InnerVolumeSpecName "kube-api-access-8jx4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 23:04:31.986064 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.986040    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b0db969-30cf-48f1-b5a7-19b25cf4eea0-util" (OuterVolumeSpecName: "util") pod "8b0db969-30cf-48f1-b5a7-19b25cf4eea0" (UID: "8b0db969-30cf-48f1-b5a7-19b25cf4eea0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 23:04:31.986179 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:31.986165    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875-util" (OuterVolumeSpecName: "util") pod "c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875" (UID: "c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 23:04:32.078411 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:32.078386    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b0db969-30cf-48f1-b5a7-19b25cf4eea0-bundle\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:32.078411 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:32.078409    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875-util\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:32.078541 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:32.078419    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875-bundle\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:32.078541 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:32.078427    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4smsz\" (UniqueName: \"kubernetes.io/projected/c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875-kube-api-access-4smsz\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:32.078541 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:32.078437    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jx4n\" (UniqueName: \"kubernetes.io/projected/8b0db969-30cf-48f1-b5a7-19b25cf4eea0-kube-api-access-8jx4n\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:32.078541 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:32.078445    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b0db969-30cf-48f1-b5a7-19b25cf4eea0-util\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:04:32.648043 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:32.648008    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd" event={"ID":"c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875","Type":"ContainerDied","Data":"9acb86dc03a84363a59f418826189c20d69d4c84e02e47794a078640a4aa5622"}
Sep 07 23:04:32.648043 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:32.648038    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053pcffd"
Sep 07 23:04:32.648488 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:32.648058    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9acb86dc03a84363a59f418826189c20d69d4c84e02e47794a078640a4aa5622"
Sep 07 23:04:32.649968 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:32.649950    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v"
Sep 07 23:04:32.650082 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:32.649982    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a02w96v" event={"ID":"ef1d0753-dbe4-48a7-9c49-9afc9facf0ed","Type":"ContainerDied","Data":"c123c3eed32705b29c3457779842e833a8111fa9c88bd0004338068219024f6e"}
Sep 07 23:04:32.650082 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:32.650026    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c123c3eed32705b29c3457779842e833a8111fa9c88bd0004338068219024f6e"
Sep 07 23:04:32.651931 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:32.651901    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf"
Sep 07 23:04:32.652031 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:32.651927    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ec96rf" event={"ID":"c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6","Type":"ContainerDied","Data":"7cd2f01eb179a6e8d3aba9f7eed15a826e63496c4aa7e7ac48e2e0c64d9049ba"}
Sep 07 23:04:32.652031 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:32.651961    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7cd2f01eb179a6e8d3aba9f7eed15a826e63496c4aa7e7ac48e2e0c64d9049ba"
Sep 07 23:04:32.654077 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:32.654056    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s" event={"ID":"8b0db969-30cf-48f1-b5a7-19b25cf4eea0","Type":"ContainerDied","Data":"4c4de9bc098e1b2c5dbaee57c7ef26fa28ea1431b757a2e5e40842ebb4cc4bb8"}
Sep 07 23:04:32.654160 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:32.654093    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c4de9bc098e1b2c5dbaee57c7ef26fa28ea1431b757a2e5e40842ebb4cc4bb8"
Sep 07 23:04:32.654160 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:32.654067    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm5j7s"
Sep 07 23:04:40.995471 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995434    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"]
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995682    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6" containerName="util"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995693    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6" containerName="util"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995702    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc" containerName="pull"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995707    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc" containerName="pull"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995714    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38e6b79b-e09d-44b3-b1e9-896a8e385abc" containerName="extract"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995719    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="38e6b79b-e09d-44b3-b1e9-896a8e385abc" containerName="extract"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995725    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6" containerName="extract"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995731    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6" containerName="extract"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995738    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875" containerName="extract"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995743    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875" containerName="extract"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995751    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38e6b79b-e09d-44b3-b1e9-896a8e385abc" containerName="util"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995756    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="38e6b79b-e09d-44b3-b1e9-896a8e385abc" containerName="util"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995761    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc" containerName="extract"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995766    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc" containerName="extract"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995773    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11a76a56-fbf5-42cf-a11f-6309f7bbb210" containerName="pull"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995779    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="11a76a56-fbf5-42cf-a11f-6309f7bbb210" containerName="pull"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995784    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b0db969-30cf-48f1-b5a7-19b25cf4eea0" containerName="extract"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995789    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b0db969-30cf-48f1-b5a7-19b25cf4eea0" containerName="extract"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995795    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef1d0753-dbe4-48a7-9c49-9afc9facf0ed" containerName="pull"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995799    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef1d0753-dbe4-48a7-9c49-9afc9facf0ed" containerName="pull"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995805    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef1d0753-dbe4-48a7-9c49-9afc9facf0ed" containerName="util"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995809    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef1d0753-dbe4-48a7-9c49-9afc9facf0ed" containerName="util"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995814    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11a76a56-fbf5-42cf-a11f-6309f7bbb210" containerName="util"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995819    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="11a76a56-fbf5-42cf-a11f-6309f7bbb210" containerName="util"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995824    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6" containerName="pull"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995828    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6" containerName="pull"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995833    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11a76a56-fbf5-42cf-a11f-6309f7bbb210" containerName="extract"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995839    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="11a76a56-fbf5-42cf-a11f-6309f7bbb210" containerName="extract"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995845    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875" containerName="pull"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995850    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875" containerName="pull"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995855    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc" containerName="util"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995860    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc" containerName="util"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995869    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875" containerName="util"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995874    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875" containerName="util"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995881    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b0db969-30cf-48f1-b5a7-19b25cf4eea0" containerName="util"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995885    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b0db969-30cf-48f1-b5a7-19b25cf4eea0" containerName="util"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995891    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38e6b79b-e09d-44b3-b1e9-896a8e385abc" containerName="pull"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995896    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="38e6b79b-e09d-44b3-b1e9-896a8e385abc" containerName="pull"
Sep 07 23:04:40.995935 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995903    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef1d0753-dbe4-48a7-9c49-9afc9facf0ed" containerName="extract"
Sep 07 23:04:40.997063 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995907    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef1d0753-dbe4-48a7-9c49-9afc9facf0ed" containerName="extract"
Sep 07 23:04:40.997063 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995926    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c0d6b03-b4bf-4e4c-ab79-566560f83031" containerName="istio-proxy"
Sep 07 23:04:40.997063 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995931    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c0d6b03-b4bf-4e4c-ab79-566560f83031" containerName="istio-proxy"
Sep 07 23:04:40.997063 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995937    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b0db969-30cf-48f1-b5a7-19b25cf4eea0" containerName="pull"
Sep 07 23:04:40.997063 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.995942    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b0db969-30cf-48f1-b5a7-19b25cf4eea0" containerName="pull"
Sep 07 23:04:40.997063 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.996000    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="11a76a56-fbf5-42cf-a11f-6309f7bbb210" containerName="extract"
Sep 07 23:04:40.997063 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.996006    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef1d0753-dbe4-48a7-9c49-9afc9facf0ed" containerName="extract"
Sep 07 23:04:40.997063 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.996012    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3733ccb-cf8e-46ba-b792-ff44b7f8e6c6" containerName="extract"
Sep 07 23:04:40.997063 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.996019    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad4db9a4-66fe-48ad-94f2-ea5253dd8ebc" containerName="extract"
Sep 07 23:04:40.997063 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.996024    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b0db969-30cf-48f1-b5a7-19b25cf4eea0" containerName="extract"
Sep 07 23:04:40.997063 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.996029    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c0d6b03-b4bf-4e4c-ab79-566560f83031" containerName="istio-proxy"
Sep 07 23:04:40.997063 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.996035    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="38e6b79b-e09d-44b3-b1e9-896a8e385abc" containerName="extract"
Sep 07 23:04:40.997063 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:40.996040    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5f39f02-a6e6-4eb4-bda9-9ddc4aed0875" containerName="extract"
Sep 07 23:04:41.000751 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.000736    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"
Sep 07 23:04:41.003218 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.003196    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 07 23:04:41.003331 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.003222    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Sep 07 23:04:41.003331 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.003320    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-92cq4\""
Sep 07 23:04:41.003734 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.003588    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 07 23:04:41.003825 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.003766    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Sep 07 23:04:41.004069 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.004054    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Sep 07 23:04:41.011196 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.011179    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"]
Sep 07 23:04:41.032389 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.032363    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw7bn\" (UniqueName: \"kubernetes.io/projected/2394c2ad-992d-490b-bf4f-88007dc38651-kube-api-access-cw7bn\") pod \"opendatahub-operator-controller-manager-6f7668fc86-ddnpt\" (UID: \"2394c2ad-992d-490b-bf4f-88007dc38651\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"
Sep 07 23:04:41.032485 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.032393    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2394c2ad-992d-490b-bf4f-88007dc38651-tmp\") pod \"opendatahub-operator-controller-manager-6f7668fc86-ddnpt\" (UID: \"2394c2ad-992d-490b-bf4f-88007dc38651\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"
Sep 07 23:04:41.032485 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.032414    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2394c2ad-992d-490b-bf4f-88007dc38651-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f7668fc86-ddnpt\" (UID: \"2394c2ad-992d-490b-bf4f-88007dc38651\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"
Sep 07 23:04:41.032485 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.032432    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2394c2ad-992d-490b-bf4f-88007dc38651-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f7668fc86-ddnpt\" (UID: \"2394c2ad-992d-490b-bf4f-88007dc38651\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"
Sep 07 23:04:41.032640 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.032509    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2394c2ad-992d-490b-bf4f-88007dc38651-manifests\") pod \"opendatahub-operator-controller-manager-6f7668fc86-ddnpt\" (UID: \"2394c2ad-992d-490b-bf4f-88007dc38651\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"
Sep 07 23:04:41.032640 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.032576    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2394c2ad-992d-490b-bf4f-88007dc38651-metrics-cert\") pod \"opendatahub-operator-controller-manager-6f7668fc86-ddnpt\" (UID: \"2394c2ad-992d-490b-bf4f-88007dc38651\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"
Sep 07 23:04:41.133352 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.133320    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2394c2ad-992d-490b-bf4f-88007dc38651-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f7668fc86-ddnpt\" (UID: \"2394c2ad-992d-490b-bf4f-88007dc38651\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"
Sep 07 23:04:41.133525 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.133363    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2394c2ad-992d-490b-bf4f-88007dc38651-manifests\") pod \"opendatahub-operator-controller-manager-6f7668fc86-ddnpt\" (UID: \"2394c2ad-992d-490b-bf4f-88007dc38651\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"
Sep 07 23:04:41.133525 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.133411    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2394c2ad-992d-490b-bf4f-88007dc38651-metrics-cert\") pod \"opendatahub-operator-controller-manager-6f7668fc86-ddnpt\" (UID: \"2394c2ad-992d-490b-bf4f-88007dc38651\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"
Sep 07 23:04:41.133525 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.133457    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw7bn\" (UniqueName: \"kubernetes.io/projected/2394c2ad-992d-490b-bf4f-88007dc38651-kube-api-access-cw7bn\") pod \"opendatahub-operator-controller-manager-6f7668fc86-ddnpt\" (UID: \"2394c2ad-992d-490b-bf4f-88007dc38651\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"
Sep 07 23:04:41.133525 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.133484    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2394c2ad-992d-490b-bf4f-88007dc38651-tmp\") pod \"opendatahub-operator-controller-manager-6f7668fc86-ddnpt\" (UID: \"2394c2ad-992d-490b-bf4f-88007dc38651\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"
Sep 07 23:04:41.133525 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.133513    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2394c2ad-992d-490b-bf4f-88007dc38651-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f7668fc86-ddnpt\" (UID: \"2394c2ad-992d-490b-bf4f-88007dc38651\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"
Sep 07 23:04:41.133873 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.133840    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2394c2ad-992d-490b-bf4f-88007dc38651-manifests\") pod \"opendatahub-operator-controller-manager-6f7668fc86-ddnpt\" (UID: \"2394c2ad-992d-490b-bf4f-88007dc38651\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"
Sep 07 23:04:41.135662 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.135633    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2394c2ad-992d-490b-bf4f-88007dc38651-tmp\") pod \"opendatahub-operator-controller-manager-6f7668fc86-ddnpt\" (UID: \"2394c2ad-992d-490b-bf4f-88007dc38651\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"
Sep 07 23:04:41.135894 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.135875    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2394c2ad-992d-490b-bf4f-88007dc38651-metrics-cert\") pod \"opendatahub-operator-controller-manager-6f7668fc86-ddnpt\" (UID: \"2394c2ad-992d-490b-bf4f-88007dc38651\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"
Sep 07 23:04:41.135989 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.135976    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2394c2ad-992d-490b-bf4f-88007dc38651-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f7668fc86-ddnpt\" (UID: \"2394c2ad-992d-490b-bf4f-88007dc38651\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"
Sep 07 23:04:41.135989 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.135979    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2394c2ad-992d-490b-bf4f-88007dc38651-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f7668fc86-ddnpt\" (UID: \"2394c2ad-992d-490b-bf4f-88007dc38651\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"
Sep 07 23:04:41.140537 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.140520    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw7bn\" (UniqueName: \"kubernetes.io/projected/2394c2ad-992d-490b-bf4f-88007dc38651-kube-api-access-cw7bn\") pod \"opendatahub-operator-controller-manager-6f7668fc86-ddnpt\" (UID: \"2394c2ad-992d-490b-bf4f-88007dc38651\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"
Sep 07 23:04:41.312179 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.312080    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"
Sep 07 23:04:41.589029 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.589005    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"]
Sep 07 23:04:41.590619 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:04:41.590581    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2394c2ad_992d_490b_bf4f_88007dc38651.slice/crio-5929799d98f3018b780acc09c79e2e78e2d1560aed3f6379e0c0c59d33f10f30 WatchSource:0}: Error finding container 5929799d98f3018b780acc09c79e2e78e2d1560aed3f6379e0c0c59d33f10f30: Status 404 returned error can't find the container with id 5929799d98f3018b780acc09c79e2e78e2d1560aed3f6379e0c0c59d33f10f30
Sep 07 23:04:41.622873 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.622845    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-ffcddf5cd-snpxn"]
Sep 07 23:04:41.627045 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.627031    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-snpxn"
Sep 07 23:04:41.629376 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.629357    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 07 23:04:41.629472 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.629434    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 07 23:04:41.629523 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.629493    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-d6h5x\""
Sep 07 23:04:41.629579 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.629499    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 07 23:04:41.636741 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.636721    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qlvj\" (UniqueName: \"kubernetes.io/projected/b34bb24b-d2b1-4ae1-adfa-fcc578f26386-kube-api-access-9qlvj\") pod \"dns-operator-controller-manager-ffcddf5cd-snpxn\" (UID: \"b34bb24b-d2b1-4ae1-adfa-fcc578f26386\") " pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-snpxn"
Sep 07 23:04:41.637905 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.637885    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-ffcddf5cd-snpxn"]
Sep 07 23:04:41.696817 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.696786    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt" event={"ID":"2394c2ad-992d-490b-bf4f-88007dc38651","Type":"ContainerStarted","Data":"5929799d98f3018b780acc09c79e2e78e2d1560aed3f6379e0c0c59d33f10f30"}
Sep 07 23:04:41.737347 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.737325    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qlvj\" (UniqueName: \"kubernetes.io/projected/b34bb24b-d2b1-4ae1-adfa-fcc578f26386-kube-api-access-9qlvj\") pod \"dns-operator-controller-manager-ffcddf5cd-snpxn\" (UID: \"b34bb24b-d2b1-4ae1-adfa-fcc578f26386\") " pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-snpxn"
Sep 07 23:04:41.748322 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.748302    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qlvj\" (UniqueName: \"kubernetes.io/projected/b34bb24b-d2b1-4ae1-adfa-fcc578f26386-kube-api-access-9qlvj\") pod \"dns-operator-controller-manager-ffcddf5cd-snpxn\" (UID: \"b34bb24b-d2b1-4ae1-adfa-fcc578f26386\") " pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-snpxn"
Sep 07 23:04:41.937118 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:41.937093    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-snpxn"
Sep 07 23:04:42.212425 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:42.212310    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-ffcddf5cd-snpxn"]
Sep 07 23:04:42.217580 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:04:42.217540    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb34bb24b_d2b1_4ae1_adfa_fcc578f26386.slice/crio-e6f73c683e351dfdb1a1cd79cc24f4b5c63812c2710a882e7e1264c0ef1916c2 WatchSource:0}: Error finding container e6f73c683e351dfdb1a1cd79cc24f4b5c63812c2710a882e7e1264c0ef1916c2: Status 404 returned error can't find the container with id e6f73c683e351dfdb1a1cd79cc24f4b5c63812c2710a882e7e1264c0ef1916c2
Sep 07 23:04:42.704254 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:42.704183    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-snpxn" event={"ID":"b34bb24b-d2b1-4ae1-adfa-fcc578f26386","Type":"ContainerStarted","Data":"e6f73c683e351dfdb1a1cd79cc24f4b5c63812c2710a882e7e1264c0ef1916c2"}
Sep 07 23:04:44.718419 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:44.718379    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt" event={"ID":"2394c2ad-992d-490b-bf4f-88007dc38651","Type":"ContainerStarted","Data":"4930282855c6a1ee253dcf445abc0ce24bc773e890cdb62afb907eb3cc4b508b"}
Sep 07 23:04:45.382715 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:45.382677    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-565895c755-wg5xf"]
Sep 07 23:04:45.389306 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:45.389278    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-wg5xf"
Sep 07 23:04:45.391469 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:45.391442    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qnnx2\""
Sep 07 23:04:45.395307 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:45.395278    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-565895c755-wg5xf"]
Sep 07 23:04:45.464137 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:45.464086    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q59br\" (UniqueName: \"kubernetes.io/projected/70d63e30-af65-4ab2-a822-936e7472a5cf-kube-api-access-q59br\") pod \"limitador-operator-controller-manager-565895c755-wg5xf\" (UID: \"70d63e30-af65-4ab2-a822-936e7472a5cf\") " pod="kuadrant-system/limitador-operator-controller-manager-565895c755-wg5xf"
Sep 07 23:04:45.565589 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:45.565556    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q59br\" (UniqueName: \"kubernetes.io/projected/70d63e30-af65-4ab2-a822-936e7472a5cf-kube-api-access-q59br\") pod \"limitador-operator-controller-manager-565895c755-wg5xf\" (UID: \"70d63e30-af65-4ab2-a822-936e7472a5cf\") " pod="kuadrant-system/limitador-operator-controller-manager-565895c755-wg5xf"
Sep 07 23:04:45.574015 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:45.573981    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q59br\" (UniqueName: \"kubernetes.io/projected/70d63e30-af65-4ab2-a822-936e7472a5cf-kube-api-access-q59br\") pod \"limitador-operator-controller-manager-565895c755-wg5xf\" (UID: \"70d63e30-af65-4ab2-a822-936e7472a5cf\") " pod="kuadrant-system/limitador-operator-controller-manager-565895c755-wg5xf"
Sep 07 23:04:45.702290 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:45.702211    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-wg5xf"
Sep 07 23:04:45.725209 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:45.725171    2557 generic.go:356] "Generic (PLEG): container finished" podID="2394c2ad-992d-490b-bf4f-88007dc38651" containerID="4930282855c6a1ee253dcf445abc0ce24bc773e890cdb62afb907eb3cc4b508b" exitCode=0
Sep 07 23:04:45.725599 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:45.725213    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt" event={"ID":"2394c2ad-992d-490b-bf4f-88007dc38651","Type":"ContainerDied","Data":"4930282855c6a1ee253dcf445abc0ce24bc773e890cdb62afb907eb3cc4b508b"}
Sep 07 23:04:46.587989 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:46.587965    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-565895c755-wg5xf"]
Sep 07 23:04:46.590055 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:04:46.590023    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d63e30_af65_4ab2_a822_936e7472a5cf.slice/crio-1b81658757154c07b1448dc3a41b36bd9f7e1d5a9c6ff803e85b5202efcefacd WatchSource:0}: Error finding container 1b81658757154c07b1448dc3a41b36bd9f7e1d5a9c6ff803e85b5202efcefacd: Status 404 returned error can't find the container with id 1b81658757154c07b1448dc3a41b36bd9f7e1d5a9c6ff803e85b5202efcefacd
Sep 07 23:04:46.731437 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:46.731399    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-snpxn" event={"ID":"b34bb24b-d2b1-4ae1-adfa-fcc578f26386","Type":"ContainerStarted","Data":"b7df1443e745d4a353dadcdad246de4fdb8e45ce3d39545e76155975364ba8c9"}
Sep 07 23:04:46.731845 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:46.731467    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-snpxn"
Sep 07 23:04:46.733439 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:46.733414    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt" event={"ID":"2394c2ad-992d-490b-bf4f-88007dc38651","Type":"ContainerStarted","Data":"717c8fd1a8f2e93369fbd74fcd7235dc5ea06dfa4e20eb08bfbe99171a4817cc"}
Sep 07 23:04:46.733547 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:46.733469    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"
Sep 07 23:04:46.734841 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:46.734818    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-wg5xf" event={"ID":"70d63e30-af65-4ab2-a822-936e7472a5cf","Type":"ContainerStarted","Data":"1b81658757154c07b1448dc3a41b36bd9f7e1d5a9c6ff803e85b5202efcefacd"}
Sep 07 23:04:46.750208 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:46.750169    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-snpxn" podStartSLOduration=1.590616724 podStartE2EDuration="5.750155078s" totalImagesPullingTime="4.159538354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:04:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:04:46.749181312 +0000 UTC m=+478.377663664" watchObservedRunningTime="2026-09-07 23:04:46.750155078 +0000 UTC m=+478.378637414"
Sep 07 23:04:46.772489 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:46.772442    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt" podStartSLOduration=2.7739594910000003 podStartE2EDuration="6.772425713s" totalImagesPullingTime="3.410232959s" totalInitContainerRuntime="588.233263ms" isStatefulPod=false podCreationTimestamp="2026-09-07 23:04:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:04:46.77061519 +0000 UTC m=+478.399097535" watchObservedRunningTime="2026-09-07 23:04:46.772425713 +0000 UTC m=+478.400908048"
Sep 07 23:04:48.746220 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:48.746188    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-wg5xf" event={"ID":"70d63e30-af65-4ab2-a822-936e7472a5cf","Type":"ContainerStarted","Data":"10167d8088ca5929dea389728c237273117dbc0392b8514562c281fa085fb3de"}
Sep 07 23:04:48.746611 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:48.746251    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-wg5xf"
Sep 07 23:04:48.763265 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:48.763220    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-wg5xf" podStartSLOduration=2.261699107 podStartE2EDuration="3.763203998s" totalImagesPullingTime="1.501504891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:04:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:04:48.76138215 +0000 UTC m=+480.389864485" watchObservedRunningTime="2026-09-07 23:04:48.763203998 +0000 UTC m=+480.391686333"
Sep 07 23:04:49.973418 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:49.973382    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-84d9bfc694-7s8bm"]
Sep 07 23:04:49.980187 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:49.980170    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-84d9bfc694-7s8bm"
Sep 07 23:04:49.982689 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:49.982673    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-ffg6x\""
Sep 07 23:04:49.993201 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:49.993178    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-84d9bfc694-7s8bm"]
Sep 07 23:04:49.999534 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:49.999510    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjq8v\" (UniqueName: \"kubernetes.io/projected/4b7683d3-7b29-4fb2-ab28-2b7169f2e03d-kube-api-access-xjq8v\") pod \"authorino-operator-84d9bfc694-7s8bm\" (UID: \"4b7683d3-7b29-4fb2-ab28-2b7169f2e03d\") " pod="kuadrant-system/authorino-operator-84d9bfc694-7s8bm"
Sep 07 23:04:50.100655 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:50.100621    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjq8v\" (UniqueName: \"kubernetes.io/projected/4b7683d3-7b29-4fb2-ab28-2b7169f2e03d-kube-api-access-xjq8v\") pod \"authorino-operator-84d9bfc694-7s8bm\" (UID: \"4b7683d3-7b29-4fb2-ab28-2b7169f2e03d\") " pod="kuadrant-system/authorino-operator-84d9bfc694-7s8bm"
Sep 07 23:04:50.111609 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:50.111583    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjq8v\" (UniqueName: \"kubernetes.io/projected/4b7683d3-7b29-4fb2-ab28-2b7169f2e03d-kube-api-access-xjq8v\") pod \"authorino-operator-84d9bfc694-7s8bm\" (UID: \"4b7683d3-7b29-4fb2-ab28-2b7169f2e03d\") " pod="kuadrant-system/authorino-operator-84d9bfc694-7s8bm"
Sep 07 23:04:50.289113 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:50.289029    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-84d9bfc694-7s8bm"
Sep 07 23:04:50.561778 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:50.561755    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-84d9bfc694-7s8bm"]
Sep 07 23:04:50.563438 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:04:50.563409    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b7683d3_7b29_4fb2_ab28_2b7169f2e03d.slice/crio-92e20b3fb803e46ff5356580ff66907dae341db45cabba5cceb346db4ec0cef5 WatchSource:0}: Error finding container 92e20b3fb803e46ff5356580ff66907dae341db45cabba5cceb346db4ec0cef5: Status 404 returned error can't find the container with id 92e20b3fb803e46ff5356580ff66907dae341db45cabba5cceb346db4ec0cef5
Sep 07 23:04:50.756529 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:50.756495    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-84d9bfc694-7s8bm" event={"ID":"4b7683d3-7b29-4fb2-ab28-2b7169f2e03d","Type":"ContainerStarted","Data":"92e20b3fb803e46ff5356580ff66907dae341db45cabba5cceb346db4ec0cef5"}
Sep 07 23:04:52.767447 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:52.767416    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-84d9bfc694-7s8bm" event={"ID":"4b7683d3-7b29-4fb2-ab28-2b7169f2e03d","Type":"ContainerStarted","Data":"b2e1159101a40e23cc0003c822c4b4916b76092b554820cdf019b15cfa2a11c4"}
Sep 07 23:04:52.767828 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:52.767486    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-84d9bfc694-7s8bm"
Sep 07 23:04:52.798089 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:52.798043    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-84d9bfc694-7s8bm" podStartSLOduration=2.302810089 podStartE2EDuration="3.798027467s" totalImagesPullingTime="1.495217378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:04:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:04:52.796156796 +0000 UTC m=+484.424639134" watchObservedRunningTime="2026-09-07 23:04:52.798027467 +0000 UTC m=+484.426509804"
Sep 07 23:04:55.315632 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:55.315596    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-kdxjp"]
Sep 07 23:04:55.318995 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:55.318980    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-kdxjp"
Sep 07 23:04:55.321398 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:55.321371    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 07 23:04:55.321527 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:55.321502    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 07 23:04:55.321608 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:55.321527    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-fxf5x\""
Sep 07 23:04:55.332646 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:55.332626    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-kdxjp"]
Sep 07 23:04:55.341966 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:55.341944    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95b04044-dac3-4fc2-8791-384890435688-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-kdxjp\" (UID: \"95b04044-dac3-4fc2-8791-384890435688\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-kdxjp"
Sep 07 23:04:55.342062 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:55.341970    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scdzx\" (UniqueName: \"kubernetes.io/projected/95b04044-dac3-4fc2-8791-384890435688-kube-api-access-scdzx\") pod \"cert-manager-operator-controller-manager-684f79c9b9-kdxjp\" (UID: \"95b04044-dac3-4fc2-8791-384890435688\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-kdxjp"
Sep 07 23:04:55.443315 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:55.443275    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scdzx\" (UniqueName: \"kubernetes.io/projected/95b04044-dac3-4fc2-8791-384890435688-kube-api-access-scdzx\") pod \"cert-manager-operator-controller-manager-684f79c9b9-kdxjp\" (UID: \"95b04044-dac3-4fc2-8791-384890435688\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-kdxjp"
Sep 07 23:04:55.443502 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:55.443392    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95b04044-dac3-4fc2-8791-384890435688-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-kdxjp\" (UID: \"95b04044-dac3-4fc2-8791-384890435688\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-kdxjp"
Sep 07 23:04:55.443741 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:55.443721    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95b04044-dac3-4fc2-8791-384890435688-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-kdxjp\" (UID: \"95b04044-dac3-4fc2-8791-384890435688\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-kdxjp"
Sep 07 23:04:55.452318 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:55.452295    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scdzx\" (UniqueName: \"kubernetes.io/projected/95b04044-dac3-4fc2-8791-384890435688-kube-api-access-scdzx\") pod \"cert-manager-operator-controller-manager-684f79c9b9-kdxjp\" (UID: \"95b04044-dac3-4fc2-8791-384890435688\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-kdxjp"
Sep 07 23:04:55.627727 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:55.627698    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-kdxjp"
Sep 07 23:04:55.900554 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:55.900531    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-kdxjp"]
Sep 07 23:04:55.902292 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:04:55.902261    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b04044_dac3_4fc2_8791_384890435688.slice/crio-c5c688108780ffe10a8ad60d31673493087cb19f48c9bc8c4746528dcee9720d WatchSource:0}: Error finding container c5c688108780ffe10a8ad60d31673493087cb19f48c9bc8c4746528dcee9720d: Status 404 returned error can't find the container with id c5c688108780ffe10a8ad60d31673493087cb19f48c9bc8c4746528dcee9720d
Sep 07 23:04:56.788607 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:56.788570    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-kdxjp" event={"ID":"95b04044-dac3-4fc2-8791-384890435688","Type":"ContainerStarted","Data":"c5c688108780ffe10a8ad60d31673493087cb19f48c9bc8c4746528dcee9720d"}
Sep 07 23:04:57.741534 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:57.741465    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-snpxn"
Sep 07 23:04:57.741673 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:57.741540    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6f7668fc86-ddnpt"
Sep 07 23:04:57.796676 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:57.796639    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-kdxjp" event={"ID":"95b04044-dac3-4fc2-8791-384890435688","Type":"ContainerStarted","Data":"00d6b0e03e0a83c34e1e10cf9ae2bec7746efca6105260f64b196e0b523f5955"}
Sep 07 23:04:57.818692 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:57.818639    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-kdxjp" podStartSLOduration=1.297199279 podStartE2EDuration="2.818620651s" totalImagesPullingTime="1.521421372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:04:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:04:57.815546851 +0000 UTC m=+489.444029183" watchObservedRunningTime="2026-09-07 23:04:57.818620651 +0000 UTC m=+489.447102988"
Sep 07 23:04:58.383641 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:58.383608    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-5pcnj"]
Sep 07 23:04:58.386869 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:58.386854    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-5pcnj"
Sep 07 23:04:58.389183 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:58.389157    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5465s\""
Sep 07 23:04:58.399955 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:58.399933    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-5pcnj"]
Sep 07 23:04:58.468355 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:58.468329    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a5e7af8-b4e2-4ef6-98ce-40a356205e34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84995cf88c-5pcnj\" (UID: \"2a5e7af8-b4e2-4ef6-98ce-40a356205e34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-5pcnj"
Sep 07 23:04:58.468474 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:58.468368    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98mzg\" (UniqueName: \"kubernetes.io/projected/2a5e7af8-b4e2-4ef6-98ce-40a356205e34-kube-api-access-98mzg\") pod \"kuadrant-operator-controller-manager-84995cf88c-5pcnj\" (UID: \"2a5e7af8-b4e2-4ef6-98ce-40a356205e34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-5pcnj"
Sep 07 23:04:58.569155 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:58.569118    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98mzg\" (UniqueName: \"kubernetes.io/projected/2a5e7af8-b4e2-4ef6-98ce-40a356205e34-kube-api-access-98mzg\") pod \"kuadrant-operator-controller-manager-84995cf88c-5pcnj\" (UID: \"2a5e7af8-b4e2-4ef6-98ce-40a356205e34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-5pcnj"
Sep 07 23:04:58.569313 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:58.569210    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a5e7af8-b4e2-4ef6-98ce-40a356205e34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84995cf88c-5pcnj\" (UID: \"2a5e7af8-b4e2-4ef6-98ce-40a356205e34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-5pcnj"
Sep 07 23:04:58.569581 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:58.569561    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a5e7af8-b4e2-4ef6-98ce-40a356205e34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84995cf88c-5pcnj\" (UID: \"2a5e7af8-b4e2-4ef6-98ce-40a356205e34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-5pcnj"
Sep 07 23:04:58.581372 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:58.581347    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98mzg\" (UniqueName: \"kubernetes.io/projected/2a5e7af8-b4e2-4ef6-98ce-40a356205e34-kube-api-access-98mzg\") pod \"kuadrant-operator-controller-manager-84995cf88c-5pcnj\" (UID: \"2a5e7af8-b4e2-4ef6-98ce-40a356205e34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-5pcnj"
Sep 07 23:04:58.696318 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:58.696243    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-5pcnj"
Sep 07 23:04:59.000902 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:59.000873    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-5pcnj"]
Sep 07 23:04:59.001415 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:04:59.001386    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a5e7af8_b4e2_4ef6_98ce_40a356205e34.slice/crio-614fa688da849697e9f29bb66ea5cc85119f674faa289d35634a021d479fab40 WatchSource:0}: Error finding container 614fa688da849697e9f29bb66ea5cc85119f674faa289d35634a021d479fab40: Status 404 returned error can't find the container with id 614fa688da849697e9f29bb66ea5cc85119f674faa289d35634a021d479fab40
Sep 07 23:04:59.754219 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:59.754188    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-wg5xf"
Sep 07 23:04:59.815224 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:04:59.815186    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-5pcnj" event={"ID":"2a5e7af8-b4e2-4ef6-98ce-40a356205e34","Type":"ContainerStarted","Data":"614fa688da849697e9f29bb66ea5cc85119f674faa289d35634a021d479fab40"}
Sep 07 23:05:02.838202 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:02.838170    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-5pcnj" event={"ID":"2a5e7af8-b4e2-4ef6-98ce-40a356205e34","Type":"ContainerStarted","Data":"acd0a9b9ac3efd126be1d5721583f465bf929f83965da9fdfa5b486f67454198"}
Sep 07 23:05:02.838596 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:02.838332    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-5pcnj"
Sep 07 23:05:02.859636 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:02.859590    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-5pcnj" podStartSLOduration=1.117177074 podStartE2EDuration="4.859575308s" totalImagesPullingTime="3.742398234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:04:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:05:02.859261992 +0000 UTC m=+494.487744328" watchObservedRunningTime="2026-09-07 23:05:02.859575308 +0000 UTC m=+494.488057643"
Sep 07 23:05:03.774525 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:03.774494    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-84d9bfc694-7s8bm"
Sep 07 23:05:09.274171 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.274136    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-ch965"]
Sep 07 23:05:09.276525 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.276504    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-ch965"
Sep 07 23:05:09.278699 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.278677    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s972z\""
Sep 07 23:05:09.278699 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.278690    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 07 23:05:09.286753 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.286728    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-ch965"]
Sep 07 23:05:09.362025 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.361990    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpncn\" (UniqueName: \"kubernetes.io/projected/d4e397f9-f598-4d13-a683-be0c60d19118-kube-api-access-gpncn\") pod \"limitador-limitador-859c4d96d6-ch965\" (UID: \"d4e397f9-f598-4d13-a683-be0c60d19118\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-ch965"
Sep 07 23:05:09.362228 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.362037    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d4e397f9-f598-4d13-a683-be0c60d19118-config-file\") pod \"limitador-limitador-859c4d96d6-ch965\" (UID: \"d4e397f9-f598-4d13-a683-be0c60d19118\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-ch965"
Sep 07 23:05:09.375131 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.375095    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-ch965"]
Sep 07 23:05:09.419242 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.419210    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"]
Sep 07 23:05:09.421548 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.421524    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.423787 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.423765    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-lzmr2\""
Sep 07 23:05:09.437177 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.437146    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"]
Sep 07 23:05:09.463300 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.463266    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpncn\" (UniqueName: \"kubernetes.io/projected/d4e397f9-f598-4d13-a683-be0c60d19118-kube-api-access-gpncn\") pod \"limitador-limitador-859c4d96d6-ch965\" (UID: \"d4e397f9-f598-4d13-a683-be0c60d19118\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-ch965"
Sep 07 23:05:09.463512 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.463329    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d4e397f9-f598-4d13-a683-be0c60d19118-config-file\") pod \"limitador-limitador-859c4d96d6-ch965\" (UID: \"d4e397f9-f598-4d13-a683-be0c60d19118\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-ch965"
Sep 07 23:05:09.464047 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.464023    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d4e397f9-f598-4d13-a683-be0c60d19118-config-file\") pod \"limitador-limitador-859c4d96d6-ch965\" (UID: \"d4e397f9-f598-4d13-a683-be0c60d19118\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-ch965"
Sep 07 23:05:09.484819 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.484733    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpncn\" (UniqueName: \"kubernetes.io/projected/d4e397f9-f598-4d13-a683-be0c60d19118-kube-api-access-gpncn\") pod \"limitador-limitador-859c4d96d6-ch965\" (UID: \"d4e397f9-f598-4d13-a683-be0c60d19118\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-ch965"
Sep 07 23:05:09.564819 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.564735    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/403c29f1-00d6-479c-ac66-6d657f541a53-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.564819 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.564807    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/403c29f1-00d6-479c-ac66-6d657f541a53-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.565037 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.564849    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/403c29f1-00d6-479c-ac66-6d657f541a53-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.565037 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.564939    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/403c29f1-00d6-479c-ac66-6d657f541a53-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.565037 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.564977    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x6jz\" (UniqueName: \"kubernetes.io/projected/403c29f1-00d6-479c-ac66-6d657f541a53-kube-api-access-6x6jz\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.565037 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.565000    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/403c29f1-00d6-479c-ac66-6d657f541a53-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.565037 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.565022    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/403c29f1-00d6-479c-ac66-6d657f541a53-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.565246 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.565039    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/403c29f1-00d6-479c-ac66-6d657f541a53-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.565246 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.565060    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/403c29f1-00d6-479c-ac66-6d657f541a53-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.586730 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.586700    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-ch965"
Sep 07 23:05:09.665878 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.665841    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/403c29f1-00d6-479c-ac66-6d657f541a53-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.666062 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.665904    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/403c29f1-00d6-479c-ac66-6d657f541a53-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.666062 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.665947    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x6jz\" (UniqueName: \"kubernetes.io/projected/403c29f1-00d6-479c-ac66-6d657f541a53-kube-api-access-6x6jz\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.666062 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.665971    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/403c29f1-00d6-479c-ac66-6d657f541a53-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.666062 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.665997    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/403c29f1-00d6-479c-ac66-6d657f541a53-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.666062 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.666024    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/403c29f1-00d6-479c-ac66-6d657f541a53-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.666062 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.666058    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/403c29f1-00d6-479c-ac66-6d657f541a53-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.666397 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.666084    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/403c29f1-00d6-479c-ac66-6d657f541a53-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.666397 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.666169    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/403c29f1-00d6-479c-ac66-6d657f541a53-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.666397 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.666323    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/403c29f1-00d6-479c-ac66-6d657f541a53-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.666556 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.666475    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/403c29f1-00d6-479c-ac66-6d657f541a53-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.667198 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.667120    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/403c29f1-00d6-479c-ac66-6d657f541a53-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.667329 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.667223    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/403c29f1-00d6-479c-ac66-6d657f541a53-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.667329 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.667318    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/403c29f1-00d6-479c-ac66-6d657f541a53-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.668868 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.668835    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/403c29f1-00d6-479c-ac66-6d657f541a53-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.669948 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.669911    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/403c29f1-00d6-479c-ac66-6d657f541a53-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.676931 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.676891    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/403c29f1-00d6-479c-ac66-6d657f541a53-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.677320 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.677304    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x6jz\" (UniqueName: \"kubernetes.io/projected/403c29f1-00d6-479c-ac66-6d657f541a53-kube-api-access-6x6jz\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc\" (UID: \"403c29f1-00d6-479c-ac66-6d657f541a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.732173 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.732140    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:09.877276 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:09.877244    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-ch965"]
Sep 07 23:05:09.883700 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:05:09.883670    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4e397f9_f598_4d13_a683_be0c60d19118.slice/crio-428cd1c8f5e2908aa4d69a0ba3980343205384bb6f4462e6810c5324375e313f WatchSource:0}: Error finding container 428cd1c8f5e2908aa4d69a0ba3980343205384bb6f4462e6810c5324375e313f: Status 404 returned error can't find the container with id 428cd1c8f5e2908aa4d69a0ba3980343205384bb6f4462e6810c5324375e313f
Sep 07 23:05:10.019296 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.019269    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"]
Sep 07 23:05:10.021240 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:05:10.021216    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod403c29f1_00d6_479c_ac66_6d657f541a53.slice/crio-81c5bc66fb2197d89c00bc5d35c5cb906e02544bc7bd1d9d9d6b0dee64f1580c WatchSource:0}: Error finding container 81c5bc66fb2197d89c00bc5d35c5cb906e02544bc7bd1d9d9d6b0dee64f1580c: Status 404 returned error can't find the container with id 81c5bc66fb2197d89c00bc5d35c5cb906e02544bc7bd1d9d9d6b0dee64f1580c
Sep 07 23:05:10.023400 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.023372    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 07 23:05:10.023476 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.023431    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 07 23:05:10.023476 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.023458    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 07 23:05:10.285899 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.285809    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-t8zpb"]
Sep 07 23:05:10.288492 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.288468    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8zpb"
Sep 07 23:05:10.290756 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.290734    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 07 23:05:10.291110 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.291073    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 23:05:10.291226 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.291119    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-vtrbj\""
Sep 07 23:05:10.291226 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.291118    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 07 23:05:10.299887 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.299838    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-t8zpb"]
Sep 07 23:05:10.373150 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.373111    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qcgc\" (UniqueName: \"kubernetes.io/projected/bc7d5d68-d7c4-42ea-872d-3a7e6e0839d7-kube-api-access-8qcgc\") pod \"postgres-69fb4594cf-t8zpb\" (UID: \"bc7d5d68-d7c4-42ea-872d-3a7e6e0839d7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8zpb"
Sep 07 23:05:10.373309 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.373158    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bc7d5d68-d7c4-42ea-872d-3a7e6e0839d7-data\") pod \"postgres-69fb4594cf-t8zpb\" (UID: \"bc7d5d68-d7c4-42ea-872d-3a7e6e0839d7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8zpb"
Sep 07 23:05:10.380866 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.380831    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-pgr9t"]
Sep 07 23:05:10.387129 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.387095    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-pgr9t"
Sep 07 23:05:10.389885 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.389852    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-p5msm\""
Sep 07 23:05:10.396153 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.394552    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-pgr9t"]
Sep 07 23:05:10.473975 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.473943    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qcgc\" (UniqueName: \"kubernetes.io/projected/bc7d5d68-d7c4-42ea-872d-3a7e6e0839d7-kube-api-access-8qcgc\") pod \"postgres-69fb4594cf-t8zpb\" (UID: \"bc7d5d68-d7c4-42ea-872d-3a7e6e0839d7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8zpb"
Sep 07 23:05:10.473975 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.473979    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bc7d5d68-d7c4-42ea-872d-3a7e6e0839d7-data\") pod \"postgres-69fb4594cf-t8zpb\" (UID: \"bc7d5d68-d7c4-42ea-872d-3a7e6e0839d7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8zpb"
Sep 07 23:05:10.474203 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.474092    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq4x6\" (UniqueName: \"kubernetes.io/projected/17f67775-eb26-4304-9453-563ff8d4a620-kube-api-access-tq4x6\") pod \"authorino-b54df94b4-pgr9t\" (UID: \"17f67775-eb26-4304-9453-563ff8d4a620\") " pod="kuadrant-system/authorino-b54df94b4-pgr9t"
Sep 07 23:05:10.474304 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.474289    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bc7d5d68-d7c4-42ea-872d-3a7e6e0839d7-data\") pod \"postgres-69fb4594cf-t8zpb\" (UID: \"bc7d5d68-d7c4-42ea-872d-3a7e6e0839d7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8zpb"
Sep 07 23:05:10.482103 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.482082    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qcgc\" (UniqueName: \"kubernetes.io/projected/bc7d5d68-d7c4-42ea-872d-3a7e6e0839d7-kube-api-access-8qcgc\") pod \"postgres-69fb4594cf-t8zpb\" (UID: \"bc7d5d68-d7c4-42ea-872d-3a7e6e0839d7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8zpb"
Sep 07 23:05:10.575407 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.575305    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq4x6\" (UniqueName: \"kubernetes.io/projected/17f67775-eb26-4304-9453-563ff8d4a620-kube-api-access-tq4x6\") pod \"authorino-b54df94b4-pgr9t\" (UID: \"17f67775-eb26-4304-9453-563ff8d4a620\") " pod="kuadrant-system/authorino-b54df94b4-pgr9t"
Sep 07 23:05:10.583077 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.583045    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq4x6\" (UniqueName: \"kubernetes.io/projected/17f67775-eb26-4304-9453-563ff8d4a620-kube-api-access-tq4x6\") pod \"authorino-b54df94b4-pgr9t\" (UID: \"17f67775-eb26-4304-9453-563ff8d4a620\") " pod="kuadrant-system/authorino-b54df94b4-pgr9t"
Sep 07 23:05:10.601891 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.601852    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8zpb"
Sep 07 23:05:10.708981 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.708945    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-pgr9t"
Sep 07 23:05:10.881534 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.881459    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc" event={"ID":"403c29f1-00d6-479c-ac66-6d657f541a53","Type":"ContainerStarted","Data":"aef0dc660e619757a304247596e2c13aa6b866b5867f66bb527e0c3536e760db"}
Sep 07 23:05:10.881534 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.881517    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc" event={"ID":"403c29f1-00d6-479c-ac66-6d657f541a53","Type":"ContainerStarted","Data":"81c5bc66fb2197d89c00bc5d35c5cb906e02544bc7bd1d9d9d6b0dee64f1580c"}
Sep 07 23:05:10.882692 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.882667    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-t8zpb"]
Sep 07 23:05:10.882981 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.882942    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-ch965" event={"ID":"d4e397f9-f598-4d13-a683-be0c60d19118","Type":"ContainerStarted","Data":"428cd1c8f5e2908aa4d69a0ba3980343205384bb6f4462e6810c5324375e313f"}
Sep 07 23:05:10.900104 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.900059    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc" podStartSLOduration=1.900042296 podStartE2EDuration="1.900042296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:05:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:05:10.897970916 +0000 UTC m=+502.526453251" watchObservedRunningTime="2026-09-07 23:05:10.900042296 +0000 UTC m=+502.528524631"
Sep 07 23:05:10.987321 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:10.987292    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-pgr9t"]
Sep 07 23:05:11.011623 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:05:11.011576    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc7d5d68_d7c4_42ea_872d_3a7e6e0839d7.slice/crio-e0dc5c2897f05c38e821d098232e297d76621a015edb000623781543f8535c77 WatchSource:0}: Error finding container e0dc5c2897f05c38e821d098232e297d76621a015edb000623781543f8535c77: Status 404 returned error can't find the container with id e0dc5c2897f05c38e821d098232e297d76621a015edb000623781543f8535c77
Sep 07 23:05:11.012370 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:05:11.012334    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17f67775_eb26_4304_9453_563ff8d4a620.slice/crio-1d039433f20227561f787bb182b6f88e6951d11ab52e9687b7100cdd1d4271da WatchSource:0}: Error finding container 1d039433f20227561f787bb182b6f88e6951d11ab52e9687b7100cdd1d4271da: Status 404 returned error can't find the container with id 1d039433f20227561f787bb182b6f88e6951d11ab52e9687b7100cdd1d4271da
Sep 07 23:05:11.346955 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:11.346865    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wcfgw"]
Sep 07 23:05:11.349110 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:11.349090    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wcfgw"
Sep 07 23:05:11.351338 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:11.351315    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-5jzh7\""
Sep 07 23:05:11.351338 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:11.351315    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 07 23:05:11.351623 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:11.351609    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 07 23:05:11.358246 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:11.358219    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wcfgw"]
Sep 07 23:05:11.481858 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:11.481823    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxqxx\" (UniqueName: \"kubernetes.io/projected/5d235f66-fd9e-4adc-80bf-e247c9f21a3b-kube-api-access-wxqxx\") pod \"cert-manager-55b4d954d5-wcfgw\" (UID: \"5d235f66-fd9e-4adc-80bf-e247c9f21a3b\") " pod="cert-manager/cert-manager-55b4d954d5-wcfgw"
Sep 07 23:05:11.482030 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:11.481947    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d235f66-fd9e-4adc-80bf-e247c9f21a3b-bound-sa-token\") pod \"cert-manager-55b4d954d5-wcfgw\" (UID: \"5d235f66-fd9e-4adc-80bf-e247c9f21a3b\") " pod="cert-manager/cert-manager-55b4d954d5-wcfgw"
Sep 07 23:05:11.583209 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:11.583171    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxqxx\" (UniqueName: \"kubernetes.io/projected/5d235f66-fd9e-4adc-80bf-e247c9f21a3b-kube-api-access-wxqxx\") pod \"cert-manager-55b4d954d5-wcfgw\" (UID: \"5d235f66-fd9e-4adc-80bf-e247c9f21a3b\") " pod="cert-manager/cert-manager-55b4d954d5-wcfgw"
Sep 07 23:05:11.583369 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:11.583242    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d235f66-fd9e-4adc-80bf-e247c9f21a3b-bound-sa-token\") pod \"cert-manager-55b4d954d5-wcfgw\" (UID: \"5d235f66-fd9e-4adc-80bf-e247c9f21a3b\") " pod="cert-manager/cert-manager-55b4d954d5-wcfgw"
Sep 07 23:05:11.590797 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:11.590767    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d235f66-fd9e-4adc-80bf-e247c9f21a3b-bound-sa-token\") pod \"cert-manager-55b4d954d5-wcfgw\" (UID: \"5d235f66-fd9e-4adc-80bf-e247c9f21a3b\") " pod="cert-manager/cert-manager-55b4d954d5-wcfgw"
Sep 07 23:05:11.591210 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:11.591191    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxqxx\" (UniqueName: \"kubernetes.io/projected/5d235f66-fd9e-4adc-80bf-e247c9f21a3b-kube-api-access-wxqxx\") pod \"cert-manager-55b4d954d5-wcfgw\" (UID: \"5d235f66-fd9e-4adc-80bf-e247c9f21a3b\") " pod="cert-manager/cert-manager-55b4d954d5-wcfgw"
Sep 07 23:05:11.659367 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:11.659334    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wcfgw"
Sep 07 23:05:11.737884 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:11.733330    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:11.739433 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:11.739398    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:11.897292 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:11.896258    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-ch965" event={"ID":"d4e397f9-f598-4d13-a683-be0c60d19118","Type":"ContainerStarted","Data":"16f3ae67885b2951e6b04bbe7d24d48973fcc0e89e03ed54ecf1e9aafcbfb3a2"}
Sep 07 23:05:11.897292 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:11.897243    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-ch965"
Sep 07 23:05:11.898993 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:11.898965    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-pgr9t" event={"ID":"17f67775-eb26-4304-9453-563ff8d4a620","Type":"ContainerStarted","Data":"1d039433f20227561f787bb182b6f88e6951d11ab52e9687b7100cdd1d4271da"}
Sep 07 23:05:11.901929 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:11.901481    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8zpb" event={"ID":"bc7d5d68-d7c4-42ea-872d-3a7e6e0839d7","Type":"ContainerStarted","Data":"e0dc5c2897f05c38e821d098232e297d76621a015edb000623781543f8535c77"}
Sep 07 23:05:11.901929 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:11.901534    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:11.903295 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:11.903255    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc"
Sep 07 23:05:11.921356 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:11.917276    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-ch965" podStartSLOduration=1.755498872 podStartE2EDuration="2.91725722s" totalImagesPullingTime="1.161758348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:05:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:05:11.915583749 +0000 UTC m=+503.544066085" watchObservedRunningTime="2026-09-07 23:05:11.91725722 +0000 UTC m=+503.545739556"
Sep 07 23:05:11.949199 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:11.949173    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wcfgw"]
Sep 07 23:05:12.911510 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:12.910939    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wcfgw" event={"ID":"5d235f66-fd9e-4adc-80bf-e247c9f21a3b","Type":"ContainerStarted","Data":"d8e2578fadde5da11375054f42139a0273b0b5c46ef7b3d720904d77ee76832c"}
Sep 07 23:05:13.846163 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:13.846127    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-5pcnj"
Sep 07 23:05:13.920885 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:13.920844    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-pgr9t" event={"ID":"17f67775-eb26-4304-9453-563ff8d4a620","Type":"ContainerStarted","Data":"6da39b3e2841b0ad344bf019ca8b7e044cab95c3db45d6ea1e14ad3b7bddfdd7"}
Sep 07 23:05:13.939973 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:13.939895    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-pgr9t" podStartSLOduration=1.3413968729999999 podStartE2EDuration="3.939873031s" totalImagesPullingTime="2.598476158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:05:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:05:13.93779417 +0000 UTC m=+505.566276506" watchObservedRunningTime="2026-09-07 23:05:13.939873031 +0000 UTC m=+505.568355368"
Sep 07 23:05:16.012327 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:16.012289    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-pgr9t"]
Sep 07 23:05:16.012783 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:16.012468    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-pgr9t" podUID="17f67775-eb26-4304-9453-563ff8d4a620" containerName="authorino" containerID="cri-o://6da39b3e2841b0ad344bf019ca8b7e044cab95c3db45d6ea1e14ad3b7bddfdd7" gracePeriod=30
Sep 07 23:05:16.941680 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:16.941586    2557 generic.go:356] "Generic (PLEG): container finished" podID="17f67775-eb26-4304-9453-563ff8d4a620" containerID="6da39b3e2841b0ad344bf019ca8b7e044cab95c3db45d6ea1e14ad3b7bddfdd7" exitCode=0
Sep 07 23:05:16.941833 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:16.941670    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-pgr9t" event={"ID":"17f67775-eb26-4304-9453-563ff8d4a620","Type":"ContainerDied","Data":"6da39b3e2841b0ad344bf019ca8b7e044cab95c3db45d6ea1e14ad3b7bddfdd7"}
Sep 07 23:05:17.524372 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:17.524345    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-pgr9t"
Sep 07 23:05:17.645489 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:17.645413    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tq4x6\" (UniqueName: \"kubernetes.io/projected/17f67775-eb26-4304-9453-563ff8d4a620-kube-api-access-tq4x6\") pod \"17f67775-eb26-4304-9453-563ff8d4a620\" (UID: \"17f67775-eb26-4304-9453-563ff8d4a620\") "
Sep 07 23:05:17.647635 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:17.647599    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17f67775-eb26-4304-9453-563ff8d4a620-kube-api-access-tq4x6" (OuterVolumeSpecName: "kube-api-access-tq4x6") pod "17f67775-eb26-4304-9453-563ff8d4a620" (UID: "17f67775-eb26-4304-9453-563ff8d4a620"). InnerVolumeSpecName "kube-api-access-tq4x6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 23:05:17.746643 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:17.746613    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tq4x6\" (UniqueName: \"kubernetes.io/projected/17f67775-eb26-4304-9453-563ff8d4a620-kube-api-access-tq4x6\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:05:17.947995 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:17.947909    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-pgr9t"
Sep 07 23:05:17.948168 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:17.947910    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-pgr9t" event={"ID":"17f67775-eb26-4304-9453-563ff8d4a620","Type":"ContainerDied","Data":"1d039433f20227561f787bb182b6f88e6951d11ab52e9687b7100cdd1d4271da"}
Sep 07 23:05:17.948168 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:17.948079    2557 scope.go:117] "RemoveContainer" containerID="6da39b3e2841b0ad344bf019ca8b7e044cab95c3db45d6ea1e14ad3b7bddfdd7"
Sep 07 23:05:17.949632 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:17.949599    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8zpb" event={"ID":"bc7d5d68-d7c4-42ea-872d-3a7e6e0839d7","Type":"ContainerStarted","Data":"06fbbdd8c73255d28511d30282c523141efd0a95a9dc2e2c74bffb8b9f33f365"}
Sep 07 23:05:17.949744 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:17.949725    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8zpb"
Sep 07 23:05:17.951472 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:17.951447    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wcfgw" event={"ID":"5d235f66-fd9e-4adc-80bf-e247c9f21a3b","Type":"ContainerStarted","Data":"29558f1f9cf01e3d0f79d4b61d00fb0853e88767d94692cd84d2ffd73e760353"}
Sep 07 23:05:17.964467 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:17.964398    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8zpb" podStartSLOduration=1.527545387 podStartE2EDuration="7.964383676s" totalImagesPullingTime="6.436838289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:05:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:05:17.963580127 +0000 UTC m=+509.592062463" watchObservedRunningTime="2026-09-07 23:05:17.964383676 +0000 UTC m=+509.592866009"
Sep 07 23:05:17.974612 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:17.974589    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-pgr9t"]
Sep 07 23:05:17.978009 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:17.977989    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-pgr9t"]
Sep 07 23:05:17.990495 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:17.990455    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-wcfgw" podStartSLOduration=1.5189215809999999 podStartE2EDuration="6.990442238s" totalImagesPullingTime="5.471520657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:05:17.988978308 +0000 UTC m=+509.617460645" watchObservedRunningTime="2026-09-07 23:05:17.990442238 +0000 UTC m=+509.618924572"
Sep 07 23:05:18.876613 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:18.876579    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17f67775-eb26-4304-9453-563ff8d4a620" path="/var/lib/kubelet/pods/17f67775-eb26-4304-9453-563ff8d4a620/volumes"
Sep 07 23:05:23.922391 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:23.922362    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-ch965"
Sep 07 23:05:23.986698 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:23.986669    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8zpb"
Sep 07 23:05:26.990253 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:26.990213    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-ch965"]
Sep 07 23:05:26.990706 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:26.990434    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-ch965" podUID="d4e397f9-f598-4d13-a683-be0c60d19118" containerName="limitador" containerID="cri-o://16f3ae67885b2951e6b04bbe7d24d48973fcc0e89e03ed54ecf1e9aafcbfb3a2" gracePeriod=30
Sep 07 23:05:27.538539 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:27.538512    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-ch965"
Sep 07 23:05:27.629565 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:27.629539    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpncn\" (UniqueName: \"kubernetes.io/projected/d4e397f9-f598-4d13-a683-be0c60d19118-kube-api-access-gpncn\") pod \"d4e397f9-f598-4d13-a683-be0c60d19118\" (UID: \"d4e397f9-f598-4d13-a683-be0c60d19118\") "
Sep 07 23:05:27.629730 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:27.629591    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d4e397f9-f598-4d13-a683-be0c60d19118-config-file\") pod \"d4e397f9-f598-4d13-a683-be0c60d19118\" (UID: \"d4e397f9-f598-4d13-a683-be0c60d19118\") "
Sep 07 23:05:27.629982 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:27.629953    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4e397f9-f598-4d13-a683-be0c60d19118-config-file" (OuterVolumeSpecName: "config-file") pod "d4e397f9-f598-4d13-a683-be0c60d19118" (UID: "d4e397f9-f598-4d13-a683-be0c60d19118"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 23:05:27.631597 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:27.631575    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4e397f9-f598-4d13-a683-be0c60d19118-kube-api-access-gpncn" (OuterVolumeSpecName: "kube-api-access-gpncn") pod "d4e397f9-f598-4d13-a683-be0c60d19118" (UID: "d4e397f9-f598-4d13-a683-be0c60d19118"). InnerVolumeSpecName "kube-api-access-gpncn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 23:05:27.731082 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:27.731054    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpncn\" (UniqueName: \"kubernetes.io/projected/d4e397f9-f598-4d13-a683-be0c60d19118-kube-api-access-gpncn\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:05:27.731082 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:27.731080    2557 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d4e397f9-f598-4d13-a683-be0c60d19118-config-file\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:05:28.001665 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.001581    2557 generic.go:356] "Generic (PLEG): container finished" podID="d4e397f9-f598-4d13-a683-be0c60d19118" containerID="16f3ae67885b2951e6b04bbe7d24d48973fcc0e89e03ed54ecf1e9aafcbfb3a2" exitCode=0
Sep 07 23:05:28.001665 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.001622    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-ch965"
Sep 07 23:05:28.002112 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.001674    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-ch965" event={"ID":"d4e397f9-f598-4d13-a683-be0c60d19118","Type":"ContainerDied","Data":"16f3ae67885b2951e6b04bbe7d24d48973fcc0e89e03ed54ecf1e9aafcbfb3a2"}
Sep 07 23:05:28.002112 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.001723    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-ch965" event={"ID":"d4e397f9-f598-4d13-a683-be0c60d19118","Type":"ContainerDied","Data":"428cd1c8f5e2908aa4d69a0ba3980343205384bb6f4462e6810c5324375e313f"}
Sep 07 23:05:28.002112 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.001745    2557 scope.go:117] "RemoveContainer" containerID="16f3ae67885b2951e6b04bbe7d24d48973fcc0e89e03ed54ecf1e9aafcbfb3a2"
Sep 07 23:05:28.010324 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.010308    2557 scope.go:117] "RemoveContainer" containerID="16f3ae67885b2951e6b04bbe7d24d48973fcc0e89e03ed54ecf1e9aafcbfb3a2"
Sep 07 23:05:28.010559 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:05:28.010543    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16f3ae67885b2951e6b04bbe7d24d48973fcc0e89e03ed54ecf1e9aafcbfb3a2\": container with ID starting with 16f3ae67885b2951e6b04bbe7d24d48973fcc0e89e03ed54ecf1e9aafcbfb3a2 not found: ID does not exist" containerID="16f3ae67885b2951e6b04bbe7d24d48973fcc0e89e03ed54ecf1e9aafcbfb3a2"
Sep 07 23:05:28.010611 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.010566    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16f3ae67885b2951e6b04bbe7d24d48973fcc0e89e03ed54ecf1e9aafcbfb3a2"} err="failed to get container status \"16f3ae67885b2951e6b04bbe7d24d48973fcc0e89e03ed54ecf1e9aafcbfb3a2\": rpc error: code = NotFound desc = could not find container \"16f3ae67885b2951e6b04bbe7d24d48973fcc0e89e03ed54ecf1e9aafcbfb3a2\": container with ID starting with 16f3ae67885b2951e6b04bbe7d24d48973fcc0e89e03ed54ecf1e9aafcbfb3a2 not found: ID does not exist"
Sep 07 23:05:28.022601 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.022580    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-ch965"]
Sep 07 23:05:28.025979 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.025958    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-ch965"]
Sep 07 23:05:28.502956 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.502911    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b777ff976-rrhkj"]
Sep 07 23:05:28.503353 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.503333    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4e397f9-f598-4d13-a683-be0c60d19118" containerName="limitador"
Sep 07 23:05:28.503353 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.503351    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4e397f9-f598-4d13-a683-be0c60d19118" containerName="limitador"
Sep 07 23:05:28.503497 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.503363    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f67775-eb26-4304-9453-563ff8d4a620" containerName="authorino"
Sep 07 23:05:28.503497 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.503370    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f67775-eb26-4304-9453-563ff8d4a620" containerName="authorino"
Sep 07 23:05:28.503497 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.503435    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4e397f9-f598-4d13-a683-be0c60d19118" containerName="limitador"
Sep 07 23:05:28.503497 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.503442    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="17f67775-eb26-4304-9453-563ff8d4a620" containerName="authorino"
Sep 07 23:05:28.508992 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.508971    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b777ff976-rrhkj"
Sep 07 23:05:28.511444 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.511403    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 07 23:05:28.511620 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.511586    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 07 23:05:28.511737 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.511637    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 07 23:05:28.512485 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.512464    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-d954z\""
Sep 07 23:05:28.512485 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.512479    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 07 23:05:28.512679 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.512563    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 07 23:05:28.515271 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.515243    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b777ff976-rrhkj"]
Sep 07 23:05:28.637436 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.637409    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/55c83ec4-ebd2-4a32-87c7-e00854d1f6ef-webhook-cert\") pod \"maas-controller-b777ff976-rrhkj\" (UID: \"55c83ec4-ebd2-4a32-87c7-e00854d1f6ef\") " pod="opendatahub/maas-controller-b777ff976-rrhkj"
Sep 07 23:05:28.637592 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.637459    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhz2n\" (UniqueName: \"kubernetes.io/projected/55c83ec4-ebd2-4a32-87c7-e00854d1f6ef-kube-api-access-vhz2n\") pod \"maas-controller-b777ff976-rrhkj\" (UID: \"55c83ec4-ebd2-4a32-87c7-e00854d1f6ef\") " pod="opendatahub/maas-controller-b777ff976-rrhkj"
Sep 07 23:05:28.637592 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.637492    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55c83ec4-ebd2-4a32-87c7-e00854d1f6ef-metrics-certs\") pod \"maas-controller-b777ff976-rrhkj\" (UID: \"55c83ec4-ebd2-4a32-87c7-e00854d1f6ef\") " pod="opendatahub/maas-controller-b777ff976-rrhkj"
Sep 07 23:05:28.656618 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.656592    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-765fd44cc-6zwpw"]
Sep 07 23:05:28.660688 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.660670    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-765fd44cc-6zwpw"
Sep 07 23:05:28.672254 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.672229    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-765fd44cc-6zwpw"]
Sep 07 23:05:28.738379 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.738350    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhz2n\" (UniqueName: \"kubernetes.io/projected/55c83ec4-ebd2-4a32-87c7-e00854d1f6ef-kube-api-access-vhz2n\") pod \"maas-controller-b777ff976-rrhkj\" (UID: \"55c83ec4-ebd2-4a32-87c7-e00854d1f6ef\") " pod="opendatahub/maas-controller-b777ff976-rrhkj"
Sep 07 23:05:28.738512 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.738421    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55c83ec4-ebd2-4a32-87c7-e00854d1f6ef-metrics-certs\") pod \"maas-controller-b777ff976-rrhkj\" (UID: \"55c83ec4-ebd2-4a32-87c7-e00854d1f6ef\") " pod="opendatahub/maas-controller-b777ff976-rrhkj"
Sep 07 23:05:28.738512 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.738466    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/55c83ec4-ebd2-4a32-87c7-e00854d1f6ef-webhook-cert\") pod \"maas-controller-b777ff976-rrhkj\" (UID: \"55c83ec4-ebd2-4a32-87c7-e00854d1f6ef\") " pod="opendatahub/maas-controller-b777ff976-rrhkj"
Sep 07 23:05:28.740871 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.740844    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55c83ec4-ebd2-4a32-87c7-e00854d1f6ef-metrics-certs\") pod \"maas-controller-b777ff976-rrhkj\" (UID: \"55c83ec4-ebd2-4a32-87c7-e00854d1f6ef\") " pod="opendatahub/maas-controller-b777ff976-rrhkj"
Sep 07 23:05:28.740984 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.740937    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/55c83ec4-ebd2-4a32-87c7-e00854d1f6ef-webhook-cert\") pod \"maas-controller-b777ff976-rrhkj\" (UID: \"55c83ec4-ebd2-4a32-87c7-e00854d1f6ef\") " pod="opendatahub/maas-controller-b777ff976-rrhkj"
Sep 07 23:05:28.745276 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.745253    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhz2n\" (UniqueName: \"kubernetes.io/projected/55c83ec4-ebd2-4a32-87c7-e00854d1f6ef-kube-api-access-vhz2n\") pod \"maas-controller-b777ff976-rrhkj\" (UID: \"55c83ec4-ebd2-4a32-87c7-e00854d1f6ef\") " pod="opendatahub/maas-controller-b777ff976-rrhkj"
Sep 07 23:05:28.820075 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.820009    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b777ff976-rrhkj"
Sep 07 23:05:28.839985 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.839956    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9ae5d4e-f7a1-47df-8995-add30ed46b3d-webhook-cert\") pod \"maas-controller-765fd44cc-6zwpw\" (UID: \"a9ae5d4e-f7a1-47df-8995-add30ed46b3d\") " pod="opendatahub/maas-controller-765fd44cc-6zwpw"
Sep 07 23:05:28.840087 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.840000    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9ae5d4e-f7a1-47df-8995-add30ed46b3d-metrics-certs\") pod \"maas-controller-765fd44cc-6zwpw\" (UID: \"a9ae5d4e-f7a1-47df-8995-add30ed46b3d\") " pod="opendatahub/maas-controller-765fd44cc-6zwpw"
Sep 07 23:05:28.840087 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.840068    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2btmj\" (UniqueName: \"kubernetes.io/projected/a9ae5d4e-f7a1-47df-8995-add30ed46b3d-kube-api-access-2btmj\") pod \"maas-controller-765fd44cc-6zwpw\" (UID: \"a9ae5d4e-f7a1-47df-8995-add30ed46b3d\") " pod="opendatahub/maas-controller-765fd44cc-6zwpw"
Sep 07 23:05:28.880130 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.880089    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4e397f9-f598-4d13-a683-be0c60d19118" path="/var/lib/kubelet/pods/d4e397f9-f598-4d13-a683-be0c60d19118/volumes"
Sep 07 23:05:28.940571 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.940543    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9ae5d4e-f7a1-47df-8995-add30ed46b3d-webhook-cert\") pod \"maas-controller-765fd44cc-6zwpw\" (UID: \"a9ae5d4e-f7a1-47df-8995-add30ed46b3d\") " pod="opendatahub/maas-controller-765fd44cc-6zwpw"
Sep 07 23:05:28.940717 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.940577    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9ae5d4e-f7a1-47df-8995-add30ed46b3d-metrics-certs\") pod \"maas-controller-765fd44cc-6zwpw\" (UID: \"a9ae5d4e-f7a1-47df-8995-add30ed46b3d\") " pod="opendatahub/maas-controller-765fd44cc-6zwpw"
Sep 07 23:05:28.940717 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.940601    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2btmj\" (UniqueName: \"kubernetes.io/projected/a9ae5d4e-f7a1-47df-8995-add30ed46b3d-kube-api-access-2btmj\") pod \"maas-controller-765fd44cc-6zwpw\" (UID: \"a9ae5d4e-f7a1-47df-8995-add30ed46b3d\") " pod="opendatahub/maas-controller-765fd44cc-6zwpw"
Sep 07 23:05:28.943258 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.943235    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9ae5d4e-f7a1-47df-8995-add30ed46b3d-metrics-certs\") pod \"maas-controller-765fd44cc-6zwpw\" (UID: \"a9ae5d4e-f7a1-47df-8995-add30ed46b3d\") " pod="opendatahub/maas-controller-765fd44cc-6zwpw"
Sep 07 23:05:28.943368 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.943270    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9ae5d4e-f7a1-47df-8995-add30ed46b3d-webhook-cert\") pod \"maas-controller-765fd44cc-6zwpw\" (UID: \"a9ae5d4e-f7a1-47df-8995-add30ed46b3d\") " pod="opendatahub/maas-controller-765fd44cc-6zwpw"
Sep 07 23:05:28.947337 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.947314    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2btmj\" (UniqueName: \"kubernetes.io/projected/a9ae5d4e-f7a1-47df-8995-add30ed46b3d-kube-api-access-2btmj\") pod \"maas-controller-765fd44cc-6zwpw\" (UID: \"a9ae5d4e-f7a1-47df-8995-add30ed46b3d\") " pod="opendatahub/maas-controller-765fd44cc-6zwpw"
Sep 07 23:05:28.973609 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:28.973588    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-765fd44cc-6zwpw"
Sep 07 23:05:29.089344 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:29.089319    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b777ff976-rrhkj"]
Sep 07 23:05:29.090319 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:05:29.090296    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c83ec4_ebd2_4a32_87c7_e00854d1f6ef.slice/crio-a2286bb1cdda63c222c9c44b710be5db17bee7825cc1e47e08351f5c4ed467ef WatchSource:0}: Error finding container a2286bb1cdda63c222c9c44b710be5db17bee7825cc1e47e08351f5c4ed467ef: Status 404 returned error can't find the container with id a2286bb1cdda63c222c9c44b710be5db17bee7825cc1e47e08351f5c4ed467ef
Sep 07 23:05:29.245886 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:29.245864    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-765fd44cc-6zwpw"]
Sep 07 23:05:29.246824 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:05:29.246798    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ae5d4e_f7a1_47df_8995_add30ed46b3d.slice/crio-f4a8a0e91efdea3492202b96ec32addbafdee025cc12bb2935979548e5e236fb WatchSource:0}: Error finding container f4a8a0e91efdea3492202b96ec32addbafdee025cc12bb2935979548e5e236fb: Status 404 returned error can't find the container with id f4a8a0e91efdea3492202b96ec32addbafdee025cc12bb2935979548e5e236fb
Sep 07 23:05:30.015541 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:30.015504    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-765fd44cc-6zwpw" event={"ID":"a9ae5d4e-f7a1-47df-8995-add30ed46b3d","Type":"ContainerStarted","Data":"f4a8a0e91efdea3492202b96ec32addbafdee025cc12bb2935979548e5e236fb"}
Sep 07 23:05:30.016925 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:30.016882    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b777ff976-rrhkj" event={"ID":"55c83ec4-ebd2-4a32-87c7-e00854d1f6ef","Type":"ContainerStarted","Data":"a2286bb1cdda63c222c9c44b710be5db17bee7825cc1e47e08351f5c4ed467ef"}
Sep 07 23:05:30.558348 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:30.558294    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-5pcnj"]
Sep 07 23:05:30.558782 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:30.558523    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-5pcnj" podUID="2a5e7af8-b4e2-4ef6-98ce-40a356205e34" containerName="manager" containerID="cri-o://acd0a9b9ac3efd126be1d5721583f465bf929f83965da9fdfa5b486f67454198" gracePeriod=10
Sep 07 23:05:30.862850 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:30.862821    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-5pcnj"
Sep 07 23:05:31.024195 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:31.024167    2557 generic.go:356] "Generic (PLEG): container finished" podID="2a5e7af8-b4e2-4ef6-98ce-40a356205e34" containerID="acd0a9b9ac3efd126be1d5721583f465bf929f83965da9fdfa5b486f67454198" exitCode=0
Sep 07 23:05:31.024354 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:31.024210    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-5pcnj"
Sep 07 23:05:31.024354 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:31.024247    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-5pcnj" event={"ID":"2a5e7af8-b4e2-4ef6-98ce-40a356205e34","Type":"ContainerDied","Data":"acd0a9b9ac3efd126be1d5721583f465bf929f83965da9fdfa5b486f67454198"}
Sep 07 23:05:31.024354 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:31.024315    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-5pcnj" event={"ID":"2a5e7af8-b4e2-4ef6-98ce-40a356205e34","Type":"ContainerDied","Data":"614fa688da849697e9f29bb66ea5cc85119f674faa289d35634a021d479fab40"}
Sep 07 23:05:31.024354 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:31.024334    2557 scope.go:117] "RemoveContainer" containerID="acd0a9b9ac3efd126be1d5721583f465bf929f83965da9fdfa5b486f67454198"
Sep 07 23:05:31.025942 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:31.025897    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b777ff976-rrhkj" event={"ID":"55c83ec4-ebd2-4a32-87c7-e00854d1f6ef","Type":"ContainerStarted","Data":"64e7fa90352f55ee03a8115c14033ee1ca8d989c5c9fe0477a7bc59680687431"}
Sep 07 23:05:31.026311 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:31.026287    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b777ff976-rrhkj"
Sep 07 23:05:31.027906 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:31.027881    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-765fd44cc-6zwpw" event={"ID":"a9ae5d4e-f7a1-47df-8995-add30ed46b3d","Type":"ContainerStarted","Data":"cd1fe78137b4bc6bb6380d26a564703589d1ab93cbe232a02df555f2ab2b7d09"}
Sep 07 23:05:31.028061 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:31.028042    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-765fd44cc-6zwpw"
Sep 07 23:05:31.034052 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:31.034029    2557 scope.go:117] "RemoveContainer" containerID="acd0a9b9ac3efd126be1d5721583f465bf929f83965da9fdfa5b486f67454198"
Sep 07 23:05:31.034369 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:05:31.034348    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acd0a9b9ac3efd126be1d5721583f465bf929f83965da9fdfa5b486f67454198\": container with ID starting with acd0a9b9ac3efd126be1d5721583f465bf929f83965da9fdfa5b486f67454198 not found: ID does not exist" containerID="acd0a9b9ac3efd126be1d5721583f465bf929f83965da9fdfa5b486f67454198"
Sep 07 23:05:31.034456 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:31.034378    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acd0a9b9ac3efd126be1d5721583f465bf929f83965da9fdfa5b486f67454198"} err="failed to get container status \"acd0a9b9ac3efd126be1d5721583f465bf929f83965da9fdfa5b486f67454198\": rpc error: code = NotFound desc = could not find container \"acd0a9b9ac3efd126be1d5721583f465bf929f83965da9fdfa5b486f67454198\": container with ID starting with acd0a9b9ac3efd126be1d5721583f465bf929f83965da9fdfa5b486f67454198 not found: ID does not exist"
Sep 07 23:05:31.059940 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:31.059893    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a5e7af8-b4e2-4ef6-98ce-40a356205e34-extensions-socket-volume\") pod \"2a5e7af8-b4e2-4ef6-98ce-40a356205e34\" (UID: \"2a5e7af8-b4e2-4ef6-98ce-40a356205e34\") "
Sep 07 23:05:31.060036 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:31.060024    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98mzg\" (UniqueName: \"kubernetes.io/projected/2a5e7af8-b4e2-4ef6-98ce-40a356205e34-kube-api-access-98mzg\") pod \"2a5e7af8-b4e2-4ef6-98ce-40a356205e34\" (UID: \"2a5e7af8-b4e2-4ef6-98ce-40a356205e34\") "
Sep 07 23:05:31.060414 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:31.060391    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a5e7af8-b4e2-4ef6-98ce-40a356205e34-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2a5e7af8-b4e2-4ef6-98ce-40a356205e34" (UID: "2a5e7af8-b4e2-4ef6-98ce-40a356205e34"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 23:05:31.062096 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:31.062060    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a5e7af8-b4e2-4ef6-98ce-40a356205e34-kube-api-access-98mzg" (OuterVolumeSpecName: "kube-api-access-98mzg") pod "2a5e7af8-b4e2-4ef6-98ce-40a356205e34" (UID: "2a5e7af8-b4e2-4ef6-98ce-40a356205e34"). InnerVolumeSpecName "kube-api-access-98mzg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 23:05:31.068235 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:31.068195    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b777ff976-rrhkj" podStartSLOduration=1.389802563 podStartE2EDuration="3.068181922s" totalImagesPullingTime="1.678379359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:05:31.066732872 +0000 UTC m=+522.695215206" watchObservedRunningTime="2026-09-07 23:05:31.068181922 +0000 UTC m=+522.696664256"
Sep 07 23:05:31.109418 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:31.109348    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-765fd44cc-6zwpw" podStartSLOduration=1.582727047 podStartE2EDuration="3.109335159s" totalImagesPullingTime="1.526608112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:05:31.107642996 +0000 UTC m=+522.736125334" watchObservedRunningTime="2026-09-07 23:05:31.109335159 +0000 UTC m=+522.737817494"
Sep 07 23:05:31.166124 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:31.162095    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98mzg\" (UniqueName: \"kubernetes.io/projected/2a5e7af8-b4e2-4ef6-98ce-40a356205e34-kube-api-access-98mzg\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:05:31.166124 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:31.162126    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a5e7af8-b4e2-4ef6-98ce-40a356205e34-extensions-socket-volume\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:05:31.353199 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:31.353165    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-5pcnj"]
Sep 07 23:05:31.356721 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:31.356695    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84995cf88c-5pcnj"]
Sep 07 23:05:32.876927 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:32.876879    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a5e7af8-b4e2-4ef6-98ce-40a356205e34" path="/var/lib/kubelet/pods/2a5e7af8-b4e2-4ef6-98ce-40a356205e34/volumes"
Sep 07 23:05:42.037021 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:42.036941    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b777ff976-rrhkj"
Sep 07 23:05:42.037021 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:42.037014    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-765fd44cc-6zwpw"
Sep 07 23:05:42.093472 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:42.093440    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b777ff976-rrhkj"]
Sep 07 23:05:42.093677 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:42.093652    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-b777ff976-rrhkj" podUID="55c83ec4-ebd2-4a32-87c7-e00854d1f6ef" containerName="manager" containerID="cri-o://64e7fa90352f55ee03a8115c14033ee1ca8d989c5c9fe0477a7bc59680687431" gracePeriod=30
Sep 07 23:05:42.333782 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:42.333754    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b777ff976-rrhkj"
Sep 07 23:05:42.345891 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:42.345867    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/55c83ec4-ebd2-4a32-87c7-e00854d1f6ef-webhook-cert\") pod \"55c83ec4-ebd2-4a32-87c7-e00854d1f6ef\" (UID: \"55c83ec4-ebd2-4a32-87c7-e00854d1f6ef\") "
Sep 07 23:05:42.346017 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:42.345992    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55c83ec4-ebd2-4a32-87c7-e00854d1f6ef-metrics-certs\") pod \"55c83ec4-ebd2-4a32-87c7-e00854d1f6ef\" (UID: \"55c83ec4-ebd2-4a32-87c7-e00854d1f6ef\") "
Sep 07 23:05:42.346075 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:42.346038    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhz2n\" (UniqueName: \"kubernetes.io/projected/55c83ec4-ebd2-4a32-87c7-e00854d1f6ef-kube-api-access-vhz2n\") pod \"55c83ec4-ebd2-4a32-87c7-e00854d1f6ef\" (UID: \"55c83ec4-ebd2-4a32-87c7-e00854d1f6ef\") "
Sep 07 23:05:42.348134 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:42.348101    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55c83ec4-ebd2-4a32-87c7-e00854d1f6ef-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "55c83ec4-ebd2-4a32-87c7-e00854d1f6ef" (UID: "55c83ec4-ebd2-4a32-87c7-e00854d1f6ef"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 23:05:42.348239 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:42.348130    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55c83ec4-ebd2-4a32-87c7-e00854d1f6ef-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "55c83ec4-ebd2-4a32-87c7-e00854d1f6ef" (UID: "55c83ec4-ebd2-4a32-87c7-e00854d1f6ef"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 23:05:42.348435 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:42.348410    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55c83ec4-ebd2-4a32-87c7-e00854d1f6ef-kube-api-access-vhz2n" (OuterVolumeSpecName: "kube-api-access-vhz2n") pod "55c83ec4-ebd2-4a32-87c7-e00854d1f6ef" (UID: "55c83ec4-ebd2-4a32-87c7-e00854d1f6ef"). InnerVolumeSpecName "kube-api-access-vhz2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 23:05:42.446841 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:42.446811    2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/55c83ec4-ebd2-4a32-87c7-e00854d1f6ef-webhook-cert\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:05:42.446841 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:42.446835    2557 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55c83ec4-ebd2-4a32-87c7-e00854d1f6ef-metrics-certs\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:05:42.446841 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:42.446845    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhz2n\" (UniqueName: \"kubernetes.io/projected/55c83ec4-ebd2-4a32-87c7-e00854d1f6ef-kube-api-access-vhz2n\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:05:43.093551 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.093519    2557 generic.go:356] "Generic (PLEG): container finished" podID="55c83ec4-ebd2-4a32-87c7-e00854d1f6ef" containerID="64e7fa90352f55ee03a8115c14033ee1ca8d989c5c9fe0477a7bc59680687431" exitCode=0
Sep 07 23:05:43.093960 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.093563    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b777ff976-rrhkj"
Sep 07 23:05:43.093960 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.093603    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b777ff976-rrhkj" event={"ID":"55c83ec4-ebd2-4a32-87c7-e00854d1f6ef","Type":"ContainerDied","Data":"64e7fa90352f55ee03a8115c14033ee1ca8d989c5c9fe0477a7bc59680687431"}
Sep 07 23:05:43.093960 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.093652    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b777ff976-rrhkj" event={"ID":"55c83ec4-ebd2-4a32-87c7-e00854d1f6ef","Type":"ContainerDied","Data":"a2286bb1cdda63c222c9c44b710be5db17bee7825cc1e47e08351f5c4ed467ef"}
Sep 07 23:05:43.093960 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.093673    2557 scope.go:117] "RemoveContainer" containerID="64e7fa90352f55ee03a8115c14033ee1ca8d989c5c9fe0477a7bc59680687431"
Sep 07 23:05:43.102017 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.101995    2557 scope.go:117] "RemoveContainer" containerID="64e7fa90352f55ee03a8115c14033ee1ca8d989c5c9fe0477a7bc59680687431"
Sep 07 23:05:43.102281 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:05:43.102259    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64e7fa90352f55ee03a8115c14033ee1ca8d989c5c9fe0477a7bc59680687431\": container with ID starting with 64e7fa90352f55ee03a8115c14033ee1ca8d989c5c9fe0477a7bc59680687431 not found: ID does not exist" containerID="64e7fa90352f55ee03a8115c14033ee1ca8d989c5c9fe0477a7bc59680687431"
Sep 07 23:05:43.102354 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.102292    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64e7fa90352f55ee03a8115c14033ee1ca8d989c5c9fe0477a7bc59680687431"} err="failed to get container status \"64e7fa90352f55ee03a8115c14033ee1ca8d989c5c9fe0477a7bc59680687431\": rpc error: code = NotFound desc = could not find container \"64e7fa90352f55ee03a8115c14033ee1ca8d989c5c9fe0477a7bc59680687431\": container with ID starting with 64e7fa90352f55ee03a8115c14033ee1ca8d989c5c9fe0477a7bc59680687431 not found: ID does not exist"
Sep 07 23:05:43.109013 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.108992    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b777ff976-rrhkj"]
Sep 07 23:05:43.112495 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.112475    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-b777ff976-rrhkj"]
Sep 07 23:05:43.756025 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.755990    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-c5599c49-jkt2m"]
Sep 07 23:05:43.756335 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.756322    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a5e7af8-b4e2-4ef6-98ce-40a356205e34" containerName="manager"
Sep 07 23:05:43.756379 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.756337    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a5e7af8-b4e2-4ef6-98ce-40a356205e34" containerName="manager"
Sep 07 23:05:43.756379 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.756356    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55c83ec4-ebd2-4a32-87c7-e00854d1f6ef" containerName="manager"
Sep 07 23:05:43.756379 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.756362    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="55c83ec4-ebd2-4a32-87c7-e00854d1f6ef" containerName="manager"
Sep 07 23:05:43.756473 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.756416    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="55c83ec4-ebd2-4a32-87c7-e00854d1f6ef" containerName="manager"
Sep 07 23:05:43.756473 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.756425    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a5e7af8-b4e2-4ef6-98ce-40a356205e34" containerName="manager"
Sep 07 23:05:43.761092 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.761074    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-c5599c49-jkt2m"
Sep 07 23:05:43.763301 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.763282    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\""
Sep 07 23:05:43.764538 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.764318    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Sep 07 23:05:43.764538 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.764395    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Sep 07 23:05:43.764538 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.764434    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\""
Sep 07 23:05:43.764745 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.764548    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\""
Sep 07 23:05:43.764745 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.764683    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-hrsg6\""
Sep 07 23:05:43.767433 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.767409    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-c5599c49-jkt2m"]
Sep 07 23:05:43.856574 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.856544    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d595e818-b29c-4164-8843-0d8f02c572eb-cert\") pod \"jobset-controller-manager-c5599c49-jkt2m\" (UID: \"d595e818-b29c-4164-8843-0d8f02c572eb\") " pod="openshift-jobset-operator/jobset-controller-manager-c5599c49-jkt2m"
Sep 07 23:05:43.856691 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.856580    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d595e818-b29c-4164-8843-0d8f02c572eb-metrics-certs\") pod \"jobset-controller-manager-c5599c49-jkt2m\" (UID: \"d595e818-b29c-4164-8843-0d8f02c572eb\") " pod="openshift-jobset-operator/jobset-controller-manager-c5599c49-jkt2m"
Sep 07 23:05:43.856691 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.856598    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d595e818-b29c-4164-8843-0d8f02c572eb-manager-config\") pod \"jobset-controller-manager-c5599c49-jkt2m\" (UID: \"d595e818-b29c-4164-8843-0d8f02c572eb\") " pod="openshift-jobset-operator/jobset-controller-manager-c5599c49-jkt2m"
Sep 07 23:05:43.856691 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.856667    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zdp4\" (UniqueName: \"kubernetes.io/projected/d595e818-b29c-4164-8843-0d8f02c572eb-kube-api-access-9zdp4\") pod \"jobset-controller-manager-c5599c49-jkt2m\" (UID: \"d595e818-b29c-4164-8843-0d8f02c572eb\") " pod="openshift-jobset-operator/jobset-controller-manager-c5599c49-jkt2m"
Sep 07 23:05:43.957817 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.957791    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zdp4\" (UniqueName: \"kubernetes.io/projected/d595e818-b29c-4164-8843-0d8f02c572eb-kube-api-access-9zdp4\") pod \"jobset-controller-manager-c5599c49-jkt2m\" (UID: \"d595e818-b29c-4164-8843-0d8f02c572eb\") " pod="openshift-jobset-operator/jobset-controller-manager-c5599c49-jkt2m"
Sep 07 23:05:43.957975 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.957872    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d595e818-b29c-4164-8843-0d8f02c572eb-cert\") pod \"jobset-controller-manager-c5599c49-jkt2m\" (UID: \"d595e818-b29c-4164-8843-0d8f02c572eb\") " pod="openshift-jobset-operator/jobset-controller-manager-c5599c49-jkt2m"
Sep 07 23:05:43.957975 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.957911    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d595e818-b29c-4164-8843-0d8f02c572eb-metrics-certs\") pod \"jobset-controller-manager-c5599c49-jkt2m\" (UID: \"d595e818-b29c-4164-8843-0d8f02c572eb\") " pod="openshift-jobset-operator/jobset-controller-manager-c5599c49-jkt2m"
Sep 07 23:05:43.957975 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.957950    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d595e818-b29c-4164-8843-0d8f02c572eb-manager-config\") pod \"jobset-controller-manager-c5599c49-jkt2m\" (UID: \"d595e818-b29c-4164-8843-0d8f02c572eb\") " pod="openshift-jobset-operator/jobset-controller-manager-c5599c49-jkt2m"
Sep 07 23:05:43.958600 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.958578    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d595e818-b29c-4164-8843-0d8f02c572eb-manager-config\") pod \"jobset-controller-manager-c5599c49-jkt2m\" (UID: \"d595e818-b29c-4164-8843-0d8f02c572eb\") " pod="openshift-jobset-operator/jobset-controller-manager-c5599c49-jkt2m"
Sep 07 23:05:43.960317 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.960295    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d595e818-b29c-4164-8843-0d8f02c572eb-metrics-certs\") pod \"jobset-controller-manager-c5599c49-jkt2m\" (UID: \"d595e818-b29c-4164-8843-0d8f02c572eb\") " pod="openshift-jobset-operator/jobset-controller-manager-c5599c49-jkt2m"
Sep 07 23:05:43.960453 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.960435    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d595e818-b29c-4164-8843-0d8f02c572eb-cert\") pod \"jobset-controller-manager-c5599c49-jkt2m\" (UID: \"d595e818-b29c-4164-8843-0d8f02c572eb\") " pod="openshift-jobset-operator/jobset-controller-manager-c5599c49-jkt2m"
Sep 07 23:05:43.969942 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:43.969904    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zdp4\" (UniqueName: \"kubernetes.io/projected/d595e818-b29c-4164-8843-0d8f02c572eb-kube-api-access-9zdp4\") pod \"jobset-controller-manager-c5599c49-jkt2m\" (UID: \"d595e818-b29c-4164-8843-0d8f02c572eb\") " pod="openshift-jobset-operator/jobset-controller-manager-c5599c49-jkt2m"
Sep 07 23:05:44.072019 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:44.071961    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-c5599c49-jkt2m"
Sep 07 23:05:44.340406 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:44.340377    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-c5599c49-jkt2m"]
Sep 07 23:05:44.342761 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:05:44.342733    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd595e818_b29c_4164_8843_0d8f02c572eb.slice/crio-8b4c6ad948a43c30f1182c851e425543f020cbb8c4d442ee8ce05a78d00ea63c WatchSource:0}: Error finding container 8b4c6ad948a43c30f1182c851e425543f020cbb8c4d442ee8ce05a78d00ea63c: Status 404 returned error can't find the container with id 8b4c6ad948a43c30f1182c851e425543f020cbb8c4d442ee8ce05a78d00ea63c
Sep 07 23:05:44.876505 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:44.876475    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55c83ec4-ebd2-4a32-87c7-e00854d1f6ef" path="/var/lib/kubelet/pods/55c83ec4-ebd2-4a32-87c7-e00854d1f6ef/volumes"
Sep 07 23:05:45.107746 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:45.107714    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-c5599c49-jkt2m" event={"ID":"d595e818-b29c-4164-8843-0d8f02c572eb","Type":"ContainerStarted","Data":"8b4c6ad948a43c30f1182c851e425543f020cbb8c4d442ee8ce05a78d00ea63c"}
Sep 07 23:05:48.127276 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:48.127243    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-c5599c49-jkt2m" event={"ID":"d595e818-b29c-4164-8843-0d8f02c572eb","Type":"ContainerStarted","Data":"b5abd069f1d704b31f1dc9b596f4e7c7020e81b56e423703739774afbf6a01fe"}
Sep 07 23:05:48.127619 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:48.127324    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-c5599c49-jkt2m"
Sep 07 23:05:48.144423 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:48.144370    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-c5599c49-jkt2m" podStartSLOduration=2.275249248 podStartE2EDuration="5.14435196s" totalImagesPullingTime="2.869102712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:05:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:05:48.142459107 +0000 UTC m=+539.770941442" watchObservedRunningTime="2026-09-07 23:05:48.14435196 +0000 UTC m=+539.772834297"
Sep 07 23:05:59.137719 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:05:59.137690    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-c5599c49-jkt2m"
Sep 07 23:06:00.699063 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:00.699023    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"]
Sep 07 23:06:00.713877 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:00.713856    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:06:00.717070 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:00.717036    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 07 23:06:00.717191 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:00.717171    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-blrjg\""
Sep 07 23:06:00.717542 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:00.717527    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 07 23:06:00.730210 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:00.730189    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"]
Sep 07 23:06:00.800091 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:00.800050    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff64add8-1739-4ee5-a414-3f373f59e7ff-openshift-service-ca\") pod \"maas-api-5cfc59d48-rtk97\" (UID: \"ff64add8-1739-4ee5-a414-3f373f59e7ff\") " pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:06:00.800204 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:00.800121    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff64add8-1739-4ee5-a414-3f373f59e7ff-metrics-certs\") pod \"maas-api-5cfc59d48-rtk97\" (UID: \"ff64add8-1739-4ee5-a414-3f373f59e7ff\") " pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:06:00.800204 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:00.800149    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvzsj\" (UniqueName: \"kubernetes.io/projected/ff64add8-1739-4ee5-a414-3f373f59e7ff-kube-api-access-vvzsj\") pod \"maas-api-5cfc59d48-rtk97\" (UID: \"ff64add8-1739-4ee5-a414-3f373f59e7ff\") " pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:06:00.800379 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:00.800221    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff64add8-1739-4ee5-a414-3f373f59e7ff-maas-api-tls\") pod \"maas-api-5cfc59d48-rtk97\" (UID: \"ff64add8-1739-4ee5-a414-3f373f59e7ff\") " pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:06:00.901437 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:00.901414    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff64add8-1739-4ee5-a414-3f373f59e7ff-maas-api-tls\") pod \"maas-api-5cfc59d48-rtk97\" (UID: \"ff64add8-1739-4ee5-a414-3f373f59e7ff\") " pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:06:00.901563 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:00.901452    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff64add8-1739-4ee5-a414-3f373f59e7ff-openshift-service-ca\") pod \"maas-api-5cfc59d48-rtk97\" (UID: \"ff64add8-1739-4ee5-a414-3f373f59e7ff\") " pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:06:00.901614 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:00.901579    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff64add8-1739-4ee5-a414-3f373f59e7ff-metrics-certs\") pod \"maas-api-5cfc59d48-rtk97\" (UID: \"ff64add8-1739-4ee5-a414-3f373f59e7ff\") " pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:06:00.901614 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:06:00.901601    2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Sep 07 23:06:00.901614 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:00.901609    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvzsj\" (UniqueName: \"kubernetes.io/projected/ff64add8-1739-4ee5-a414-3f373f59e7ff-kube-api-access-vvzsj\") pod \"maas-api-5cfc59d48-rtk97\" (UID: \"ff64add8-1739-4ee5-a414-3f373f59e7ff\") " pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:06:00.901754 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:06:00.901668    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff64add8-1739-4ee5-a414-3f373f59e7ff-maas-api-tls podName:ff64add8-1739-4ee5-a414-3f373f59e7ff nodeName:}" failed. No retries permitted until 2026-09-07 23:06:01.401645682 +0000 UTC m=+553.030127997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ff64add8-1739-4ee5-a414-3f373f59e7ff-maas-api-tls") pod "maas-api-5cfc59d48-rtk97" (UID: "ff64add8-1739-4ee5-a414-3f373f59e7ff") : secret "maas-api-serving-cert" not found
Sep 07 23:06:00.901816 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:06:00.901795    2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 07 23:06:00.901896 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:06:00.901883    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff64add8-1739-4ee5-a414-3f373f59e7ff-metrics-certs podName:ff64add8-1739-4ee5-a414-3f373f59e7ff nodeName:}" failed. No retries permitted until 2026-09-07 23:06:01.401866761 +0000 UTC m=+553.030349084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff64add8-1739-4ee5-a414-3f373f59e7ff-metrics-certs") pod "maas-api-5cfc59d48-rtk97" (UID: "ff64add8-1739-4ee5-a414-3f373f59e7ff") : secret "maas-api-metrics-tls" not found
Sep 07 23:06:00.902131 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:00.902114    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff64add8-1739-4ee5-a414-3f373f59e7ff-openshift-service-ca\") pod \"maas-api-5cfc59d48-rtk97\" (UID: \"ff64add8-1739-4ee5-a414-3f373f59e7ff\") " pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:06:00.914837 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:00.914813    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvzsj\" (UniqueName: \"kubernetes.io/projected/ff64add8-1739-4ee5-a414-3f373f59e7ff-kube-api-access-vvzsj\") pod \"maas-api-5cfc59d48-rtk97\" (UID: \"ff64add8-1739-4ee5-a414-3f373f59e7ff\") " pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:06:01.371248 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:01.371215    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-l2742"]
Sep 07 23:06:01.373526 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:01.373511    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-l2742"
Sep 07 23:06:01.375665 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:01.375648    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-sqz9h\""
Sep 07 23:06:01.375911 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:01.375896    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 07 23:06:01.385551 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:01.385527    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-l2742"]
Sep 07 23:06:01.406215 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:01.406192    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff64add8-1739-4ee5-a414-3f373f59e7ff-metrics-certs\") pod \"maas-api-5cfc59d48-rtk97\" (UID: \"ff64add8-1739-4ee5-a414-3f373f59e7ff\") " pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:06:01.406357 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:01.406243    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff64add8-1739-4ee5-a414-3f373f59e7ff-maas-api-tls\") pod \"maas-api-5cfc59d48-rtk97\" (UID: \"ff64add8-1739-4ee5-a414-3f373f59e7ff\") " pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:06:01.408549 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:01.408521    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff64add8-1739-4ee5-a414-3f373f59e7ff-metrics-certs\") pod \"maas-api-5cfc59d48-rtk97\" (UID: \"ff64add8-1739-4ee5-a414-3f373f59e7ff\") " pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:06:01.408654 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:01.408615    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff64add8-1739-4ee5-a414-3f373f59e7ff-maas-api-tls\") pod \"maas-api-5cfc59d48-rtk97\" (UID: \"ff64add8-1739-4ee5-a414-3f373f59e7ff\") " pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:06:01.507189 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:01.507151    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr5nj\" (UniqueName: \"kubernetes.io/projected/4f045744-26e7-4f82-b7cf-2b47e5500498-kube-api-access-dr5nj\") pod \"payload-pre-processing-59fbc47bf8-l2742\" (UID: \"4f045744-26e7-4f82-b7cf-2b47e5500498\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-l2742"
Sep 07 23:06:01.507359 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:01.507280    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f045744-26e7-4f82-b7cf-2b47e5500498-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-l2742\" (UID: \"4f045744-26e7-4f82-b7cf-2b47e5500498\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-l2742"
Sep 07 23:06:01.608436 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:01.608401    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr5nj\" (UniqueName: \"kubernetes.io/projected/4f045744-26e7-4f82-b7cf-2b47e5500498-kube-api-access-dr5nj\") pod \"payload-pre-processing-59fbc47bf8-l2742\" (UID: \"4f045744-26e7-4f82-b7cf-2b47e5500498\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-l2742"
Sep 07 23:06:01.608607 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:01.608489    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f045744-26e7-4f82-b7cf-2b47e5500498-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-l2742\" (UID: \"4f045744-26e7-4f82-b7cf-2b47e5500498\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-l2742"
Sep 07 23:06:01.609142 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:01.609124    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f045744-26e7-4f82-b7cf-2b47e5500498-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-l2742\" (UID: \"4f045744-26e7-4f82-b7cf-2b47e5500498\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-l2742"
Sep 07 23:06:01.617883 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:01.617857    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr5nj\" (UniqueName: \"kubernetes.io/projected/4f045744-26e7-4f82-b7cf-2b47e5500498-kube-api-access-dr5nj\") pod \"payload-pre-processing-59fbc47bf8-l2742\" (UID: \"4f045744-26e7-4f82-b7cf-2b47e5500498\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-l2742"
Sep 07 23:06:01.624655 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:01.624630    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:06:01.684129 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:01.684099    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-l2742"
Sep 07 23:06:01.910740 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:01.910717    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"]
Sep 07 23:06:01.912885 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:06:01.912856    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff64add8_1739_4ee5_a414_3f373f59e7ff.slice/crio-341d87068bc8011487cf2aab1be9eb575521e207e50f7915db98d6b7c01e7808 WatchSource:0}: Error finding container 341d87068bc8011487cf2aab1be9eb575521e207e50f7915db98d6b7c01e7808: Status 404 returned error can't find the container with id 341d87068bc8011487cf2aab1be9eb575521e207e50f7915db98d6b7c01e7808
Sep 07 23:06:01.963522 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:01.963502    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-l2742"]
Sep 07 23:06:01.963858 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:06:01.963840    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f045744_26e7_4f82_b7cf_2b47e5500498.slice/crio-e6bd4be9e947457ce266e3cabd3af54735fad93ac0db32265cc36f1a659b0d73 WatchSource:0}: Error finding container e6bd4be9e947457ce266e3cabd3af54735fad93ac0db32265cc36f1a659b0d73: Status 404 returned error can't find the container with id e6bd4be9e947457ce266e3cabd3af54735fad93ac0db32265cc36f1a659b0d73
Sep 07 23:06:02.200271 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:02.200185    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-l2742" event={"ID":"4f045744-26e7-4f82-b7cf-2b47e5500498","Type":"ContainerStarted","Data":"e6bd4be9e947457ce266e3cabd3af54735fad93ac0db32265cc36f1a659b0d73"}
Sep 07 23:06:02.201546 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:02.201514    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" event={"ID":"ff64add8-1739-4ee5-a414-3f373f59e7ff","Type":"ContainerStarted","Data":"341d87068bc8011487cf2aab1be9eb575521e207e50f7915db98d6b7c01e7808"}
Sep 07 23:06:04.215235 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:04.215203    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-l2742" event={"ID":"4f045744-26e7-4f82-b7cf-2b47e5500498","Type":"ContainerStarted","Data":"ea081475cf9edf39a45a6c3d39892fb9b4db87d6fbe75de1d8fcab8e05dded36"}
Sep 07 23:06:04.215604 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:04.215371    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-l2742"
Sep 07 23:06:04.216838 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:04.216813    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" event={"ID":"ff64add8-1739-4ee5-a414-3f373f59e7ff","Type":"ContainerStarted","Data":"55dd39774f7e9b7ff3345d14bccd45efa3d9a7c522bb6f92a3e600ff26d92bfc"}
Sep 07 23:06:04.217010 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:04.216991    2557 scope.go:117] "RemoveContainer" containerID="55dd39774f7e9b7ff3345d14bccd45efa3d9a7c522bb6f92a3e600ff26d92bfc"
Sep 07 23:06:04.231888 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:04.231843    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-l2742" podStartSLOduration=1.435919536 podStartE2EDuration="3.231829746s" totalImagesPullingTime="1.79591021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:06:04.229939867 +0000 UTC m=+555.858422195" watchObservedRunningTime="2026-09-07 23:06:04.231829746 +0000 UTC m=+555.860312080"
Sep 07 23:06:05.224829 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:05.224752    2557 generic.go:356] "Generic (PLEG): container finished" podID="ff64add8-1739-4ee5-a414-3f373f59e7ff" containerID="55dd39774f7e9b7ff3345d14bccd45efa3d9a7c522bb6f92a3e600ff26d92bfc" exitCode=1
Sep 07 23:06:05.224829 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:05.224776    2557 generic.go:356] "Generic (PLEG): container finished" podID="ff64add8-1739-4ee5-a414-3f373f59e7ff" containerID="f68f914e3994868c6eaeb12ca07dac35a9d6208209d4e973030ebe71775951a6" exitCode=1
Sep 07 23:06:05.224829 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:05.224788    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" event={"ID":"ff64add8-1739-4ee5-a414-3f373f59e7ff","Type":"ContainerDied","Data":"55dd39774f7e9b7ff3345d14bccd45efa3d9a7c522bb6f92a3e600ff26d92bfc"}
Sep 07 23:06:05.225381 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:05.224852    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" event={"ID":"ff64add8-1739-4ee5-a414-3f373f59e7ff","Type":"ContainerDied","Data":"f68f914e3994868c6eaeb12ca07dac35a9d6208209d4e973030ebe71775951a6"}
Sep 07 23:06:05.225381 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:05.224934    2557 scope.go:117] "RemoveContainer" containerID="55dd39774f7e9b7ff3345d14bccd45efa3d9a7c522bb6f92a3e600ff26d92bfc"
Sep 07 23:06:05.225381 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:05.225092    2557 scope.go:117] "RemoveContainer" containerID="f68f914e3994868c6eaeb12ca07dac35a9d6208209d4e973030ebe71775951a6"
Sep 07 23:06:05.225381 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:06:05.225305    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:06:05.234943 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:05.234891    2557 scope.go:117] "RemoveContainer" containerID="55dd39774f7e9b7ff3345d14bccd45efa3d9a7c522bb6f92a3e600ff26d92bfc"
Sep 07 23:06:05.235220 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:06:05.235201    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55dd39774f7e9b7ff3345d14bccd45efa3d9a7c522bb6f92a3e600ff26d92bfc\": container with ID starting with 55dd39774f7e9b7ff3345d14bccd45efa3d9a7c522bb6f92a3e600ff26d92bfc not found: ID does not exist" containerID="55dd39774f7e9b7ff3345d14bccd45efa3d9a7c522bb6f92a3e600ff26d92bfc"
Sep 07 23:06:05.235277 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:05.235228    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55dd39774f7e9b7ff3345d14bccd45efa3d9a7c522bb6f92a3e600ff26d92bfc"} err="failed to get container status \"55dd39774f7e9b7ff3345d14bccd45efa3d9a7c522bb6f92a3e600ff26d92bfc\": rpc error: code = NotFound desc = could not find container \"55dd39774f7e9b7ff3345d14bccd45efa3d9a7c522bb6f92a3e600ff26d92bfc\": container with ID starting with 55dd39774f7e9b7ff3345d14bccd45efa3d9a7c522bb6f92a3e600ff26d92bfc not found: ID does not exist"
Sep 07 23:06:05.616497 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:05.616413    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-bb7b75cc4-l68xn"]
Sep 07 23:06:05.619397 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:05.619371    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-bb7b75cc4-l68xn"
Sep 07 23:06:05.622861 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:05.622842    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-4xls6\""
Sep 07 23:06:05.623011 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:05.622848    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Sep 07 23:06:05.623131 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:05.623116    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 07 23:06:05.638777 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:05.638747    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-bb7b75cc4-l68xn"]
Sep 07 23:06:05.744876 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:05.744842    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3859e3ff-d62b-4a85-af0b-4c5ad27dc356-metrics-certs\") pod \"odh-model-controller-bb7b75cc4-l68xn\" (UID: \"3859e3ff-d62b-4a85-af0b-4c5ad27dc356\") " pod="opendatahub/odh-model-controller-bb7b75cc4-l68xn"
Sep 07 23:06:05.744876 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:05.744879    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3859e3ff-d62b-4a85-af0b-4c5ad27dc356-cert\") pod \"odh-model-controller-bb7b75cc4-l68xn\" (UID: \"3859e3ff-d62b-4a85-af0b-4c5ad27dc356\") " pod="opendatahub/odh-model-controller-bb7b75cc4-l68xn"
Sep 07 23:06:05.745108 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:05.744956    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xjlf\" (UniqueName: \"kubernetes.io/projected/3859e3ff-d62b-4a85-af0b-4c5ad27dc356-kube-api-access-2xjlf\") pod \"odh-model-controller-bb7b75cc4-l68xn\" (UID: \"3859e3ff-d62b-4a85-af0b-4c5ad27dc356\") " pod="opendatahub/odh-model-controller-bb7b75cc4-l68xn"
Sep 07 23:06:05.846284 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:05.846245    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xjlf\" (UniqueName: \"kubernetes.io/projected/3859e3ff-d62b-4a85-af0b-4c5ad27dc356-kube-api-access-2xjlf\") pod \"odh-model-controller-bb7b75cc4-l68xn\" (UID: \"3859e3ff-d62b-4a85-af0b-4c5ad27dc356\") " pod="opendatahub/odh-model-controller-bb7b75cc4-l68xn"
Sep 07 23:06:05.846454 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:05.846313    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3859e3ff-d62b-4a85-af0b-4c5ad27dc356-metrics-certs\") pod \"odh-model-controller-bb7b75cc4-l68xn\" (UID: \"3859e3ff-d62b-4a85-af0b-4c5ad27dc356\") " pod="opendatahub/odh-model-controller-bb7b75cc4-l68xn"
Sep 07 23:06:05.846454 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:05.846336    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3859e3ff-d62b-4a85-af0b-4c5ad27dc356-cert\") pod \"odh-model-controller-bb7b75cc4-l68xn\" (UID: \"3859e3ff-d62b-4a85-af0b-4c5ad27dc356\") " pod="opendatahub/odh-model-controller-bb7b75cc4-l68xn"
Sep 07 23:06:05.846454 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:06:05.846445    2557 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 07 23:06:05.846577 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:06:05.846490    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3859e3ff-d62b-4a85-af0b-4c5ad27dc356-cert podName:3859e3ff-d62b-4a85-af0b-4c5ad27dc356 nodeName:}" failed. No retries permitted until 2026-09-07 23:06:06.346475407 +0000 UTC m=+557.974957720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3859e3ff-d62b-4a85-af0b-4c5ad27dc356-cert") pod "odh-model-controller-bb7b75cc4-l68xn" (UID: "3859e3ff-d62b-4a85-af0b-4c5ad27dc356") : secret "odh-model-controller-webhook-cert" not found
Sep 07 23:06:05.848750 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:05.848730    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3859e3ff-d62b-4a85-af0b-4c5ad27dc356-metrics-certs\") pod \"odh-model-controller-bb7b75cc4-l68xn\" (UID: \"3859e3ff-d62b-4a85-af0b-4c5ad27dc356\") " pod="opendatahub/odh-model-controller-bb7b75cc4-l68xn"
Sep 07 23:06:05.858183 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:05.858159    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xjlf\" (UniqueName: \"kubernetes.io/projected/3859e3ff-d62b-4a85-af0b-4c5ad27dc356-kube-api-access-2xjlf\") pod \"odh-model-controller-bb7b75cc4-l68xn\" (UID: \"3859e3ff-d62b-4a85-af0b-4c5ad27dc356\") " pod="opendatahub/odh-model-controller-bb7b75cc4-l68xn"
Sep 07 23:06:06.232093 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:06.232055    2557 scope.go:117] "RemoveContainer" containerID="f68f914e3994868c6eaeb12ca07dac35a9d6208209d4e973030ebe71775951a6"
Sep 07 23:06:06.232514 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:06:06.232280    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:06:06.350942 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:06.350880    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3859e3ff-d62b-4a85-af0b-4c5ad27dc356-cert\") pod \"odh-model-controller-bb7b75cc4-l68xn\" (UID: \"3859e3ff-d62b-4a85-af0b-4c5ad27dc356\") " pod="opendatahub/odh-model-controller-bb7b75cc4-l68xn"
Sep 07 23:06:06.353231 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:06.353210    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3859e3ff-d62b-4a85-af0b-4c5ad27dc356-cert\") pod \"odh-model-controller-bb7b75cc4-l68xn\" (UID: \"3859e3ff-d62b-4a85-af0b-4c5ad27dc356\") " pod="opendatahub/odh-model-controller-bb7b75cc4-l68xn"
Sep 07 23:06:06.532702 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:06.532637    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-bb7b75cc4-l68xn"
Sep 07 23:06:06.625343 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:06.625294    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:06:06.799127 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:06.799103    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-bb7b75cc4-l68xn"]
Sep 07 23:06:06.800512 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:06:06.800484    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3859e3ff_d62b_4a85_af0b_4c5ad27dc356.slice/crio-07b214552fb35d8bbc60cb3e9962bb21395063b6d61597adfa2a9cfaf3ce07ba WatchSource:0}: Error finding container 07b214552fb35d8bbc60cb3e9962bb21395063b6d61597adfa2a9cfaf3ce07ba: Status 404 returned error can't find the container with id 07b214552fb35d8bbc60cb3e9962bb21395063b6d61597adfa2a9cfaf3ce07ba
Sep 07 23:06:07.238172 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:07.238138    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-bb7b75cc4-l68xn" event={"ID":"3859e3ff-d62b-4a85-af0b-4c5ad27dc356","Type":"ContainerStarted","Data":"07b214552fb35d8bbc60cb3e9962bb21395063b6d61597adfa2a9cfaf3ce07ba"}
Sep 07 23:06:07.238520 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:07.238440    2557 scope.go:117] "RemoveContainer" containerID="f68f914e3994868c6eaeb12ca07dac35a9d6208209d4e973030ebe71775951a6"
Sep 07 23:06:07.238610 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:06:07.238592    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:06:10.257353 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:10.257319    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-bb7b75cc4-l68xn" event={"ID":"3859e3ff-d62b-4a85-af0b-4c5ad27dc356","Type":"ContainerStarted","Data":"7dfc252c2900ee42fbbb6ae0124fda8b1ae92647ec9fc134a021a9fd7da59b6d"}
Sep 07 23:06:10.257768 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:10.257450    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-bb7b75cc4-l68xn"
Sep 07 23:06:10.273014 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:10.272954    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-bb7b75cc4-l68xn" podStartSLOduration=2.623982795 podStartE2EDuration="5.272933685s" totalImagesPullingTime="2.64895089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:06:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:06:10.271770355 +0000 UTC m=+561.900252697" watchObservedRunningTime="2026-09-07 23:06:10.272933685 +0000 UTC m=+561.901416021"
Sep 07 23:06:11.625640 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:11.625607    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:06:11.626159 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:11.626142    2557 scope.go:117] "RemoveContainer" containerID="f68f914e3994868c6eaeb12ca07dac35a9d6208209d4e973030ebe71775951a6"
Sep 07 23:06:11.626367 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:06:11.626346    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:06:15.226737 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:15.226705    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-l2742"
Sep 07 23:06:21.264103 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:21.264068    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-bb7b75cc4-l68xn"
Sep 07 23:06:25.871639 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:25.871611    2557 scope.go:117] "RemoveContainer" containerID="f68f914e3994868c6eaeb12ca07dac35a9d6208209d4e973030ebe71775951a6"
Sep 07 23:06:27.345558 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:27.345523    2557 generic.go:356] "Generic (PLEG): container finished" podID="ff64add8-1739-4ee5-a414-3f373f59e7ff" containerID="5df5b432ada3848dda04faeffe71c06928a76690146fbc2fa7dfb7348a08b0a5" exitCode=1
Sep 07 23:06:27.345990 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:27.345597    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" event={"ID":"ff64add8-1739-4ee5-a414-3f373f59e7ff","Type":"ContainerDied","Data":"5df5b432ada3848dda04faeffe71c06928a76690146fbc2fa7dfb7348a08b0a5"}
Sep 07 23:06:27.345990 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:27.345656    2557 scope.go:117] "RemoveContainer" containerID="f68f914e3994868c6eaeb12ca07dac35a9d6208209d4e973030ebe71775951a6"
Sep 07 23:06:27.345990 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:27.345977    2557 scope.go:117] "RemoveContainer" containerID="5df5b432ada3848dda04faeffe71c06928a76690146fbc2fa7dfb7348a08b0a5"
Sep 07 23:06:27.346188 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:06:27.346171    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:06:31.625348 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:31.625308    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:06:31.625730 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:31.625398    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:06:31.625772 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:31.625743    2557 scope.go:117] "RemoveContainer" containerID="5df5b432ada3848dda04faeffe71c06928a76690146fbc2fa7dfb7348a08b0a5"
Sep 07 23:06:31.625940 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:06:31.625897    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:06:42.871887 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:42.871850    2557 scope.go:117] "RemoveContainer" containerID="5df5b432ada3848dda04faeffe71c06928a76690146fbc2fa7dfb7348a08b0a5"
Sep 07 23:06:42.872371 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:06:42.872074    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:06:48.831824 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:48.831793    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/ovn-acl-logging/0.log"
Sep 07 23:06:48.832280 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:48.832138    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/ovn-acl-logging/0.log"
Sep 07 23:06:55.871725 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:55.871694    2557 scope.go:117] "RemoveContainer" containerID="5df5b432ada3848dda04faeffe71c06928a76690146fbc2fa7dfb7348a08b0a5"
Sep 07 23:06:55.874148 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:55.871992    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 23:06:56.499368 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:56.499291    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" event={"ID":"ff64add8-1739-4ee5-a414-3f373f59e7ff","Type":"ContainerStarted","Data":"b8955afd44b5c6c2f6cfb665011f56e18ce315561ee0a85a1d41274cf4cdef09"}
Sep 07 23:06:56.499506 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:56.499491    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:06:56.515810 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:56.515760    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podStartSLOduration=53.495882639 podStartE2EDuration="56.515742208s" totalImagesPullingTime="3.019859569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:06:00 +0000 UTC" imagePullSessionsCount=4 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:06:56.514285886 +0000 UTC m=+608.142768222" watchObservedRunningTime="2026-09-07 23:06:56.515742208 +0000 UTC m=+608.144224543"
Sep 07 23:06:57.506714 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:57.506681    2557 generic.go:356] "Generic (PLEG): container finished" podID="ff64add8-1739-4ee5-a414-3f373f59e7ff" containerID="b8955afd44b5c6c2f6cfb665011f56e18ce315561ee0a85a1d41274cf4cdef09" exitCode=1
Sep 07 23:06:57.507141 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:57.506767    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" event={"ID":"ff64add8-1739-4ee5-a414-3f373f59e7ff","Type":"ContainerDied","Data":"b8955afd44b5c6c2f6cfb665011f56e18ce315561ee0a85a1d41274cf4cdef09"}
Sep 07 23:06:57.507141 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:57.506826    2557 scope.go:117] "RemoveContainer" containerID="5df5b432ada3848dda04faeffe71c06928a76690146fbc2fa7dfb7348a08b0a5"
Sep 07 23:06:57.507141 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:57.506962    2557 scope.go:117] "RemoveContainer" containerID="b8955afd44b5c6c2f6cfb665011f56e18ce315561ee0a85a1d41274cf4cdef09"
Sep 07 23:06:57.507317 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:06:57.507146    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:06:58.514324 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:06:58.514285    2557 scope.go:117] "RemoveContainer" containerID="b8955afd44b5c6c2f6cfb665011f56e18ce315561ee0a85a1d41274cf4cdef09"
Sep 07 23:06:58.514707 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:06:58.514449    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:07:01.625193 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:01.625155    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:07:01.625582 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:01.625555    2557 scope.go:117] "RemoveContainer" containerID="b8955afd44b5c6c2f6cfb665011f56e18ce315561ee0a85a1d41274cf4cdef09"
Sep 07 23:07:01.625727 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:07:01.625708    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:07:13.871422 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:13.871340    2557 scope.go:117] "RemoveContainer" containerID="b8955afd44b5c6c2f6cfb665011f56e18ce315561ee0a85a1d41274cf4cdef09"
Sep 07 23:07:13.871797 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:07:13.871572    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:07:27.871102 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:27.871067    2557 scope.go:117] "RemoveContainer" containerID="b8955afd44b5c6c2f6cfb665011f56e18ce315561ee0a85a1d41274cf4cdef09"
Sep 07 23:07:27.871701 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:07:27.871313    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:07:29.982726 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:29.982687    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bb679d7d9-ppc9l"]
Sep 07 23:07:29.986314 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:29.986286    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:30.000064 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.000032    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bb679d7d9-ppc9l"]
Sep 07 23:07:30.139956 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.139885    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8321c521-b135-445d-8d5e-d3a53f292874-trusted-ca-bundle\") pod \"console-6bb679d7d9-ppc9l\" (UID: \"8321c521-b135-445d-8d5e-d3a53f292874\") " pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:30.140166 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.139972    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8321c521-b135-445d-8d5e-d3a53f292874-oauth-serving-cert\") pod \"console-6bb679d7d9-ppc9l\" (UID: \"8321c521-b135-445d-8d5e-d3a53f292874\") " pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:30.140166 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.140011    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8321c521-b135-445d-8d5e-d3a53f292874-console-oauth-config\") pod \"console-6bb679d7d9-ppc9l\" (UID: \"8321c521-b135-445d-8d5e-d3a53f292874\") " pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:30.140166 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.140031    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8321c521-b135-445d-8d5e-d3a53f292874-console-config\") pod \"console-6bb679d7d9-ppc9l\" (UID: \"8321c521-b135-445d-8d5e-d3a53f292874\") " pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:30.140166 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.140092    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8321c521-b135-445d-8d5e-d3a53f292874-console-serving-cert\") pod \"console-6bb679d7d9-ppc9l\" (UID: \"8321c521-b135-445d-8d5e-d3a53f292874\") " pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:30.140166 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.140112    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8321c521-b135-445d-8d5e-d3a53f292874-service-ca\") pod \"console-6bb679d7d9-ppc9l\" (UID: \"8321c521-b135-445d-8d5e-d3a53f292874\") " pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:30.140166 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.140133    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlcqc\" (UniqueName: \"kubernetes.io/projected/8321c521-b135-445d-8d5e-d3a53f292874-kube-api-access-wlcqc\") pod \"console-6bb679d7d9-ppc9l\" (UID: \"8321c521-b135-445d-8d5e-d3a53f292874\") " pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:30.241334 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.241227    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8321c521-b135-445d-8d5e-d3a53f292874-console-oauth-config\") pod \"console-6bb679d7d9-ppc9l\" (UID: \"8321c521-b135-445d-8d5e-d3a53f292874\") " pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:30.241334 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.241277    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8321c521-b135-445d-8d5e-d3a53f292874-console-config\") pod \"console-6bb679d7d9-ppc9l\" (UID: \"8321c521-b135-445d-8d5e-d3a53f292874\") " pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:30.241334 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.241311    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8321c521-b135-445d-8d5e-d3a53f292874-console-serving-cert\") pod \"console-6bb679d7d9-ppc9l\" (UID: \"8321c521-b135-445d-8d5e-d3a53f292874\") " pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:30.241334 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.241328    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8321c521-b135-445d-8d5e-d3a53f292874-service-ca\") pod \"console-6bb679d7d9-ppc9l\" (UID: \"8321c521-b135-445d-8d5e-d3a53f292874\") " pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:30.241334 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.241343    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlcqc\" (UniqueName: \"kubernetes.io/projected/8321c521-b135-445d-8d5e-d3a53f292874-kube-api-access-wlcqc\") pod \"console-6bb679d7d9-ppc9l\" (UID: \"8321c521-b135-445d-8d5e-d3a53f292874\") " pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:30.241720 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.241516    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8321c521-b135-445d-8d5e-d3a53f292874-trusted-ca-bundle\") pod \"console-6bb679d7d9-ppc9l\" (UID: \"8321c521-b135-445d-8d5e-d3a53f292874\") " pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:30.241720 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.241570    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8321c521-b135-445d-8d5e-d3a53f292874-oauth-serving-cert\") pod \"console-6bb679d7d9-ppc9l\" (UID: \"8321c521-b135-445d-8d5e-d3a53f292874\") " pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:30.242198 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.242172    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8321c521-b135-445d-8d5e-d3a53f292874-console-config\") pod \"console-6bb679d7d9-ppc9l\" (UID: \"8321c521-b135-445d-8d5e-d3a53f292874\") " pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:30.242322 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.242218    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8321c521-b135-445d-8d5e-d3a53f292874-service-ca\") pod \"console-6bb679d7d9-ppc9l\" (UID: \"8321c521-b135-445d-8d5e-d3a53f292874\") " pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:30.242389 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.242321    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8321c521-b135-445d-8d5e-d3a53f292874-trusted-ca-bundle\") pod \"console-6bb679d7d9-ppc9l\" (UID: \"8321c521-b135-445d-8d5e-d3a53f292874\") " pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:30.242389 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.242335    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8321c521-b135-445d-8d5e-d3a53f292874-oauth-serving-cert\") pod \"console-6bb679d7d9-ppc9l\" (UID: \"8321c521-b135-445d-8d5e-d3a53f292874\") " pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:30.243807 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.243778    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8321c521-b135-445d-8d5e-d3a53f292874-console-serving-cert\") pod \"console-6bb679d7d9-ppc9l\" (UID: \"8321c521-b135-445d-8d5e-d3a53f292874\") " pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:30.243904 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.243857    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8321c521-b135-445d-8d5e-d3a53f292874-console-oauth-config\") pod \"console-6bb679d7d9-ppc9l\" (UID: \"8321c521-b135-445d-8d5e-d3a53f292874\") " pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:30.249029 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.249008    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlcqc\" (UniqueName: \"kubernetes.io/projected/8321c521-b135-445d-8d5e-d3a53f292874-kube-api-access-wlcqc\") pod \"console-6bb679d7d9-ppc9l\" (UID: \"8321c521-b135-445d-8d5e-d3a53f292874\") " pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:30.298459 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.298426    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:30.570082 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.570004    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bb679d7d9-ppc9l"]
Sep 07 23:07:30.573019 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:07:30.572991    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8321c521_b135_445d_8d5e_d3a53f292874.slice/crio-b640ce181f773ccb315eb085e26835a3ffe597c7a2b50eae6bcbec8c45a6d98e WatchSource:0}: Error finding container b640ce181f773ccb315eb085e26835a3ffe597c7a2b50eae6bcbec8c45a6d98e: Status 404 returned error can't find the container with id b640ce181f773ccb315eb085e26835a3ffe597c7a2b50eae6bcbec8c45a6d98e
Sep 07 23:07:30.679836 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.679799    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bb679d7d9-ppc9l" event={"ID":"8321c521-b135-445d-8d5e-d3a53f292874","Type":"ContainerStarted","Data":"f0df030fbaa671cc566f0a818df9c40a3a9d0f025173c0ac98caa520dbe7d024"}
Sep 07 23:07:30.680130 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.680100    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bb679d7d9-ppc9l" event={"ID":"8321c521-b135-445d-8d5e-d3a53f292874","Type":"ContainerStarted","Data":"b640ce181f773ccb315eb085e26835a3ffe597c7a2b50eae6bcbec8c45a6d98e"}
Sep 07 23:07:30.696982 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:30.696930    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bb679d7d9-ppc9l" podStartSLOduration=1.6968940780000001 podStartE2EDuration="1.696894078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:07:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:07:30.694460117 +0000 UTC m=+642.322942491" watchObservedRunningTime="2026-09-07 23:07:30.696894078 +0000 UTC m=+642.325376416"
Sep 07 23:07:40.298579 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:40.298547    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:40.299047 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:40.298597    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:40.304434 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:40.304406    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:40.735454 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:40.735420    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bb679d7d9-ppc9l"
Sep 07 23:07:40.780462 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:40.780429    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64c88fbdfd-rbh64"]
Sep 07 23:07:42.872027 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:42.871998    2557 scope.go:117] "RemoveContainer" containerID="b8955afd44b5c6c2f6cfb665011f56e18ce315561ee0a85a1d41274cf4cdef09"
Sep 07 23:07:43.747009 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:43.746976    2557 generic.go:356] "Generic (PLEG): container finished" podID="ff64add8-1739-4ee5-a414-3f373f59e7ff" containerID="e77a0a64bfb956a7327a2a12d146c70ceb296df4601987723724f996474203ec" exitCode=1
Sep 07 23:07:43.747177 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:43.747049    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" event={"ID":"ff64add8-1739-4ee5-a414-3f373f59e7ff","Type":"ContainerDied","Data":"e77a0a64bfb956a7327a2a12d146c70ceb296df4601987723724f996474203ec"}
Sep 07 23:07:43.747177 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:43.747109    2557 scope.go:117] "RemoveContainer" containerID="b8955afd44b5c6c2f6cfb665011f56e18ce315561ee0a85a1d41274cf4cdef09"
Sep 07 23:07:43.747419 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:43.747403    2557 scope.go:117] "RemoveContainer" containerID="e77a0a64bfb956a7327a2a12d146c70ceb296df4601987723724f996474203ec"
Sep 07 23:07:43.747607 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:07:43.747590    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:07:46.500001 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:46.499960    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:07:46.500894 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:46.500863    2557 scope.go:117] "RemoveContainer" containerID="e77a0a64bfb956a7327a2a12d146c70ceb296df4601987723724f996474203ec"
Sep 07 23:07:46.501283 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:07:46.501256    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:07:51.625583 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:51.625549    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:07:51.625971 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:07:51.625957    2557 scope.go:117] "RemoveContainer" containerID="e77a0a64bfb956a7327a2a12d146c70ceb296df4601987723724f996474203ec"
Sep 07 23:07:51.626146 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:07:51.626125    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:08:01.871795 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:01.871768    2557 scope.go:117] "RemoveContainer" containerID="e77a0a64bfb956a7327a2a12d146c70ceb296df4601987723724f996474203ec"
Sep 07 23:08:01.872295 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:08:01.871952    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:08:05.802938 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:05.802883    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-64c88fbdfd-rbh64" podUID="f93e25a5-5352-4c72-a91b-460e6c457da3" containerName="console" containerID="cri-o://ad57f20f0c1d771697716a3148d84a91d258984be97d4c2430667fc50e7055f1" gracePeriod=15
Sep 07 23:08:06.048419 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.048397    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:08:06.139039 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.139015    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4r9m\" (UniqueName: \"kubernetes.io/projected/f93e25a5-5352-4c72-a91b-460e6c457da3-kube-api-access-c4r9m\") pod \"f93e25a5-5352-4c72-a91b-460e6c457da3\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") "
Sep 07 23:08:06.139178 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.139062    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f93e25a5-5352-4c72-a91b-460e6c457da3-console-serving-cert\") pod \"f93e25a5-5352-4c72-a91b-460e6c457da3\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") "
Sep 07 23:08:06.139178 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.139106    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f93e25a5-5352-4c72-a91b-460e6c457da3-console-oauth-config\") pod \"f93e25a5-5352-4c72-a91b-460e6c457da3\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") "
Sep 07 23:08:06.139178 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.139138    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f93e25a5-5352-4c72-a91b-460e6c457da3-trusted-ca-bundle\") pod \"f93e25a5-5352-4c72-a91b-460e6c457da3\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") "
Sep 07 23:08:06.139348 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.139181    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f93e25a5-5352-4c72-a91b-460e6c457da3-console-config\") pod \"f93e25a5-5352-4c72-a91b-460e6c457da3\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") "
Sep 07 23:08:06.139348 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.139215    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f93e25a5-5352-4c72-a91b-460e6c457da3-oauth-serving-cert\") pod \"f93e25a5-5352-4c72-a91b-460e6c457da3\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") "
Sep 07 23:08:06.139457 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.139353    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f93e25a5-5352-4c72-a91b-460e6c457da3-service-ca\") pod \"f93e25a5-5352-4c72-a91b-460e6c457da3\" (UID: \"f93e25a5-5352-4c72-a91b-460e6c457da3\") "
Sep 07 23:08:06.139616 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.139591    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f93e25a5-5352-4c72-a91b-460e6c457da3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f93e25a5-5352-4c72-a91b-460e6c457da3" (UID: "f93e25a5-5352-4c72-a91b-460e6c457da3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 23:08:06.139774 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.139599    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f93e25a5-5352-4c72-a91b-460e6c457da3-console-config" (OuterVolumeSpecName: "console-config") pod "f93e25a5-5352-4c72-a91b-460e6c457da3" (UID: "f93e25a5-5352-4c72-a91b-460e6c457da3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 23:08:06.139873 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.139637    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f93e25a5-5352-4c72-a91b-460e6c457da3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f93e25a5-5352-4c72-a91b-460e6c457da3" (UID: "f93e25a5-5352-4c72-a91b-460e6c457da3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 23:08:06.140034 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.140010    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f93e25a5-5352-4c72-a91b-460e6c457da3-service-ca" (OuterVolumeSpecName: "service-ca") pod "f93e25a5-5352-4c72-a91b-460e6c457da3" (UID: "f93e25a5-5352-4c72-a91b-460e6c457da3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 23:08:06.141136 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.141117    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f93e25a5-5352-4c72-a91b-460e6c457da3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f93e25a5-5352-4c72-a91b-460e6c457da3" (UID: "f93e25a5-5352-4c72-a91b-460e6c457da3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 23:08:06.141136 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.141127    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f93e25a5-5352-4c72-a91b-460e6c457da3-kube-api-access-c4r9m" (OuterVolumeSpecName: "kube-api-access-c4r9m") pod "f93e25a5-5352-4c72-a91b-460e6c457da3" (UID: "f93e25a5-5352-4c72-a91b-460e6c457da3"). InnerVolumeSpecName "kube-api-access-c4r9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 23:08:06.141233 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.141204    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f93e25a5-5352-4c72-a91b-460e6c457da3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f93e25a5-5352-4c72-a91b-460e6c457da3" (UID: "f93e25a5-5352-4c72-a91b-460e6c457da3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 23:08:06.240223 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.240196    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f93e25a5-5352-4c72-a91b-460e6c457da3-console-config\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:08:06.240223 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.240220    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f93e25a5-5352-4c72-a91b-460e6c457da3-oauth-serving-cert\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:08:06.240382 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.240229    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f93e25a5-5352-4c72-a91b-460e6c457da3-service-ca\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:08:06.240382 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.240238    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4r9m\" (UniqueName: \"kubernetes.io/projected/f93e25a5-5352-4c72-a91b-460e6c457da3-kube-api-access-c4r9m\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:08:06.240382 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.240247    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f93e25a5-5352-4c72-a91b-460e6c457da3-console-serving-cert\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:08:06.240382 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.240257    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f93e25a5-5352-4c72-a91b-460e6c457da3-console-oauth-config\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:08:06.240382 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.240266    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f93e25a5-5352-4c72-a91b-460e6c457da3-trusted-ca-bundle\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:08:06.867656 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.867623    2557 generic.go:356] "Generic (PLEG): container finished" podID="f93e25a5-5352-4c72-a91b-460e6c457da3" containerID="ad57f20f0c1d771697716a3148d84a91d258984be97d4c2430667fc50e7055f1" exitCode=0
Sep 07 23:08:06.868197 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.867677    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c88fbdfd-rbh64"
Sep 07 23:08:06.868197 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.867717    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c88fbdfd-rbh64" event={"ID":"f93e25a5-5352-4c72-a91b-460e6c457da3","Type":"ContainerDied","Data":"ad57f20f0c1d771697716a3148d84a91d258984be97d4c2430667fc50e7055f1"}
Sep 07 23:08:06.868197 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.867775    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c88fbdfd-rbh64" event={"ID":"f93e25a5-5352-4c72-a91b-460e6c457da3","Type":"ContainerDied","Data":"167bfc86a04d27de0349c78216f965fff03e377682c5ab9def810c9ab780d118"}
Sep 07 23:08:06.868197 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.867796    2557 scope.go:117] "RemoveContainer" containerID="ad57f20f0c1d771697716a3148d84a91d258984be97d4c2430667fc50e7055f1"
Sep 07 23:08:06.877416 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.877396    2557 scope.go:117] "RemoveContainer" containerID="ad57f20f0c1d771697716a3148d84a91d258984be97d4c2430667fc50e7055f1"
Sep 07 23:08:06.877724 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:08:06.877705    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad57f20f0c1d771697716a3148d84a91d258984be97d4c2430667fc50e7055f1\": container with ID starting with ad57f20f0c1d771697716a3148d84a91d258984be97d4c2430667fc50e7055f1 not found: ID does not exist" containerID="ad57f20f0c1d771697716a3148d84a91d258984be97d4c2430667fc50e7055f1"
Sep 07 23:08:06.877766 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.877731    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad57f20f0c1d771697716a3148d84a91d258984be97d4c2430667fc50e7055f1"} err="failed to get container status \"ad57f20f0c1d771697716a3148d84a91d258984be97d4c2430667fc50e7055f1\": rpc error: code = NotFound desc = could not find container \"ad57f20f0c1d771697716a3148d84a91d258984be97d4c2430667fc50e7055f1\": container with ID starting with ad57f20f0c1d771697716a3148d84a91d258984be97d4c2430667fc50e7055f1 not found: ID does not exist"
Sep 07 23:08:06.889836 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.889807    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64c88fbdfd-rbh64"]
Sep 07 23:08:06.891908 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:06.891889    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64c88fbdfd-rbh64"]
Sep 07 23:08:08.877579 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:08.877544    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f93e25a5-5352-4c72-a91b-460e6c457da3" path="/var/lib/kubelet/pods/f93e25a5-5352-4c72-a91b-460e6c457da3/volumes"
Sep 07 23:08:14.871629 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:14.871595    2557 scope.go:117] "RemoveContainer" containerID="e77a0a64bfb956a7327a2a12d146c70ceb296df4601987723724f996474203ec"
Sep 07 23:08:14.872084 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:08:14.871812    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:08:25.871309 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:25.871275    2557 scope.go:117] "RemoveContainer" containerID="e77a0a64bfb956a7327a2a12d146c70ceb296df4601987723724f996474203ec"
Sep 07 23:08:25.871701 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:08:25.871513    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:08:36.876897 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:36.876868    2557 scope.go:117] "RemoveContainer" containerID="e77a0a64bfb956a7327a2a12d146c70ceb296df4601987723724f996474203ec"
Sep 07 23:08:36.877407 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:08:36.877049    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:08:48.875449 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:08:48.875423    2557 scope.go:117] "RemoveContainer" containerID="e77a0a64bfb956a7327a2a12d146c70ceb296df4601987723724f996474203ec"
Sep 07 23:08:48.875846 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:08:48.875638    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:09:00.871378 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:09:00.871349    2557 scope.go:117] "RemoveContainer" containerID="e77a0a64bfb956a7327a2a12d146c70ceb296df4601987723724f996474203ec"
Sep 07 23:09:00.871838 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:09:00.871490    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:09:14.872062 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:09:14.872032    2557 scope.go:117] "RemoveContainer" containerID="e77a0a64bfb956a7327a2a12d146c70ceb296df4601987723724f996474203ec"
Sep 07 23:09:16.225963 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:09:16.225933    2557 generic.go:356] "Generic (PLEG): container finished" podID="ff64add8-1739-4ee5-a414-3f373f59e7ff" containerID="cde9f47c988b8cddb6e30738b5765ee1ea2feffb70ac1b745e4b0abb6f0a3bba" exitCode=1
Sep 07 23:09:16.226414 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:09:16.226016    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" event={"ID":"ff64add8-1739-4ee5-a414-3f373f59e7ff","Type":"ContainerDied","Data":"cde9f47c988b8cddb6e30738b5765ee1ea2feffb70ac1b745e4b0abb6f0a3bba"}
Sep 07 23:09:16.226414 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:09:16.226092    2557 scope.go:117] "RemoveContainer" containerID="e77a0a64bfb956a7327a2a12d146c70ceb296df4601987723724f996474203ec"
Sep 07 23:09:16.226530 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:09:16.226489    2557 scope.go:117] "RemoveContainer" containerID="cde9f47c988b8cddb6e30738b5765ee1ea2feffb70ac1b745e4b0abb6f0a3bba"
Sep 07 23:09:16.226668 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:09:16.226643    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:09:16.500258 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:09:16.500184    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:09:17.232669 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:09:17.232637    2557 scope.go:117] "RemoveContainer" containerID="cde9f47c988b8cddb6e30738b5765ee1ea2feffb70ac1b745e4b0abb6f0a3bba"
Sep 07 23:09:17.233076 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:09:17.232789    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:09:21.625363 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:09:21.625319    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:09:21.625820 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:09:21.625686    2557 scope.go:117] "RemoveContainer" containerID="cde9f47c988b8cddb6e30738b5765ee1ea2feffb70ac1b745e4b0abb6f0a3bba"
Sep 07 23:09:21.625906 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:09:21.625833    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:09:35.871490 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:09:35.871453    2557 scope.go:117] "RemoveContainer" containerID="cde9f47c988b8cddb6e30738b5765ee1ea2feffb70ac1b745e4b0abb6f0a3bba"
Sep 07 23:09:35.872038 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:09:35.871657    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:09:47.871840 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:09:47.871804    2557 scope.go:117] "RemoveContainer" containerID="cde9f47c988b8cddb6e30738b5765ee1ea2feffb70ac1b745e4b0abb6f0a3bba"
Sep 07 23:09:47.872402 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:09:47.871994    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:09:58.873632 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:09:58.873601    2557 scope.go:117] "RemoveContainer" containerID="cde9f47c988b8cddb6e30738b5765ee1ea2feffb70ac1b745e4b0abb6f0a3bba"
Sep 07 23:09:58.874052 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:09:58.873787    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:10:13.871930 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:10:13.871846    2557 scope.go:117] "RemoveContainer" containerID="cde9f47c988b8cddb6e30738b5765ee1ea2feffb70ac1b745e4b0abb6f0a3bba"
Sep 07 23:10:13.872307 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:10:13.872041    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:10:28.874008 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:10:28.873976    2557 scope.go:117] "RemoveContainer" containerID="cde9f47c988b8cddb6e30738b5765ee1ea2feffb70ac1b745e4b0abb6f0a3bba"
Sep 07 23:10:28.874528 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:10:28.874155    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:10:41.871410 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:10:41.871380    2557 scope.go:117] "RemoveContainer" containerID="cde9f47c988b8cddb6e30738b5765ee1ea2feffb70ac1b745e4b0abb6f0a3bba"
Sep 07 23:10:41.871912 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:10:41.871590    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:10:53.871835 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:10:53.871808    2557 scope.go:117] "RemoveContainer" containerID="cde9f47c988b8cddb6e30738b5765ee1ea2feffb70ac1b745e4b0abb6f0a3bba"
Sep 07 23:10:53.872226 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:10:53.871997    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:11:05.871526 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:11:05.871492    2557 scope.go:117] "RemoveContainer" containerID="cde9f47c988b8cddb6e30738b5765ee1ea2feffb70ac1b745e4b0abb6f0a3bba"
Sep 07 23:11:05.871911 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:11:05.871676    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:11:16.872072 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:11:16.872038    2557 scope.go:117] "RemoveContainer" containerID="cde9f47c988b8cddb6e30738b5765ee1ea2feffb70ac1b745e4b0abb6f0a3bba"
Sep 07 23:11:16.872532 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:11:16.872276    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:11:31.871088 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:11:31.871058    2557 scope.go:117] "RemoveContainer" containerID="cde9f47c988b8cddb6e30738b5765ee1ea2feffb70ac1b745e4b0abb6f0a3bba"
Sep 07 23:11:31.871473 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:11:31.871226    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:11:44.871533 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:11:44.871455    2557 scope.go:117] "RemoveContainer" containerID="cde9f47c988b8cddb6e30738b5765ee1ea2feffb70ac1b745e4b0abb6f0a3bba"
Sep 07 23:11:44.871980 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:11:44.871639    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:11:48.865770 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:11:48.865739    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/ovn-acl-logging/0.log"
Sep 07 23:11:48.867947 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:11:48.867894    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/ovn-acl-logging/0.log"
Sep 07 23:11:59.871386 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:11:59.871356    2557 scope.go:117] "RemoveContainer" containerID="cde9f47c988b8cddb6e30738b5765ee1ea2feffb70ac1b745e4b0abb6f0a3bba"
Sep 07 23:11:59.873688 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:11:59.871665    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 23:12:01.066151 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:12:01.066059    2557 generic.go:356] "Generic (PLEG): container finished" podID="ff64add8-1739-4ee5-a414-3f373f59e7ff" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1" exitCode=1
Sep 07 23:12:01.066151 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:12:01.066130    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" event={"ID":"ff64add8-1739-4ee5-a414-3f373f59e7ff","Type":"ContainerDied","Data":"3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"}
Sep 07 23:12:01.066621 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:12:01.066190    2557 scope.go:117] "RemoveContainer" containerID="cde9f47c988b8cddb6e30738b5765ee1ea2feffb70ac1b745e4b0abb6f0a3bba"
Sep 07 23:12:01.066621 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:12:01.066547    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:12:01.066722 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:12:01.066704    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:12:01.500515 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:12:01.500475    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:12:01.625158 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:12:01.625124    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:12:02.073022 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:12:02.072993    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:12:02.073462 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:12:02.073212    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:12:03.077770 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:12:03.077742    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:12:03.078159 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:12:03.077904    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:12:16.872160 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:12:16.872123    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:12:16.872529 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:12:16.872376    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:12:30.871099 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:12:30.871071    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:12:30.871662 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:12:30.871248    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:12:45.871735 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:12:45.871704    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:12:45.872215 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:12:45.871869    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:12:57.871598 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:12:57.871568    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:12:57.872008 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:12:57.871711    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:13:10.871455 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:13:10.871428    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:13:10.871808 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:13:10.871587    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:13:21.872081 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:13:21.872009    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:13:21.872504 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:13:21.872181    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:13:35.871817 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:13:35.871784    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:13:35.872292 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:13:35.871994    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:13:47.871138 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:13:47.871098    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:13:47.871524 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:13:47.871287    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:14:00.871491 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:14:00.871457    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:14:00.872053 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:14:00.871664    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:14:12.871867 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:14:12.871832    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:14:12.872271 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:14:12.872106    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:14:26.871577 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:14:26.871539    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:14:26.871983 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:14:26.871747    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:14:38.874337 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:14:38.874301    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:14:38.874796 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:14:38.874495    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:14:49.872021 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:14:49.871947    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:14:49.872401 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:14:49.872126    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:15:01.871973 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:15:01.871910    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:15:01.872436 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:15:01.872178    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:15:14.871550 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:15:14.871517    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:15:14.872001 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:15:14.871698    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:15:29.871550 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:15:29.871517    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:15:29.872080 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:15:29.871688    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:15:41.871402 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:15:41.871367    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:15:41.871950 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:15:41.871603    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:15:56.871596 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:15:56.871563    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:15:56.872084 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:15:56.871742    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:16:11.871165 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:16:11.871093    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:16:11.871541 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:16:11.871280    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:16:25.871932 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:16:25.871886    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:16:25.872384 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:16:25.872111    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:16:36.871395 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:16:36.871357    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:16:36.871967 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:16:36.871579    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:16:48.898843 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:16:48.898808    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/ovn-acl-logging/0.log"
Sep 07 23:16:48.902879 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:16:48.902855    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/ovn-acl-logging/0.log"
Sep 07 23:16:49.871789 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:16:49.871764    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:16:49.871986 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:16:49.871964    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:17:01.871893 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:17:01.871858    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:17:01.874299 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:17:01.872271    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 23:17:02.602427 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:17:02.602396    2557 generic.go:356] "Generic (PLEG): container finished" podID="ff64add8-1739-4ee5-a414-3f373f59e7ff" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8" exitCode=1
Sep 07 23:17:02.602618 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:17:02.602473    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" event={"ID":"ff64add8-1739-4ee5-a414-3f373f59e7ff","Type":"ContainerDied","Data":"fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"}
Sep 07 23:17:02.602618 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:17:02.602551    2557 scope.go:117] "RemoveContainer" containerID="3373ed1f2aefc5cd33a3b521f7d8f4ff0cf03b77673389dfffc5e5c9a2a9ecd1"
Sep 07 23:17:02.602907 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:17:02.602891    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:17:02.603160 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:17:02.603142    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:17:06.500577 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:17:06.500536    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:17:06.500990 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:17:06.500863    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:17:06.501051 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:17:06.501034    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:17:11.625581 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:17:11.625542    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:17:11.626060 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:17:11.625938    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:17:11.626128 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:17:11.626108    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:17:26.871373 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:17:26.871335    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:17:26.871872 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:17:26.871555    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:17:40.872053 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:17:40.872024    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:17:40.872504 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:17:40.872223    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:17:53.872179 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:17:53.872100    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:17:53.872524 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:17:53.872315    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:18:04.871177 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:18:04.871138    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:18:04.871658 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:18:04.871368    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:18:18.873447 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:18:18.873418    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:18:18.874127 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:18:18.873588    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:18:32.871423 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:18:32.871386    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:18:32.871864 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:18:32.871607    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:18:46.871802 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:18:46.871768    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:18:46.872311 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:18:46.871969    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:18:58.876143 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:18:58.876109    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:18:58.876594 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:18:58.876385    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:19:13.871656 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:19:13.871576    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:19:13.872178 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:19:13.871776    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:19:25.872151 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:19:25.872116    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:19:25.872630 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:19:25.872263    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:19:37.871721 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:19:37.871688    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:19:37.872222 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:19:37.871851    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:19:51.871665 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:19:51.871636    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:19:51.872063 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:19:51.871816    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:20:04.871094 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:20:04.871062    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:20:04.871488 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:20:04.871245    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:20:16.871380 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:20:16.871345    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:20:16.872001 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:20:16.871514    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:20:30.871376 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:20:30.871345    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:20:30.871832 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:20:30.871556    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:20:42.871651 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:20:42.871565    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:20:42.872205 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:20:42.871798    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:20:54.871420 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:20:54.871388    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:20:54.871968 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:20:54.871602    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:21:05.871498 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:21:05.871467    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:21:05.871992 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:21:05.871650    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:21:17.871392 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:21:17.871353    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:21:17.871973 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:21:17.871579    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:21:31.871453 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:21:31.871418    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:21:31.871943 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:21:31.871607    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:21:43.871009 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:21:43.870974    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:21:43.871545 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:21:43.871215    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:21:48.931631 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:21:48.931603    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/ovn-acl-logging/0.log"
Sep 07 23:21:48.939778 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:21:48.939756    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/ovn-acl-logging/0.log"
Sep 07 23:21:56.871975 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:21:56.871944    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:21:56.872516 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:21:56.872199    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:22:09.871326 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:22:09.871285    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:22:09.873637 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:22:09.871686    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 23:22:11.195273 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:22:11.195188    2557 generic.go:356] "Generic (PLEG): container finished" podID="ff64add8-1739-4ee5-a414-3f373f59e7ff" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190" exitCode=1
Sep 07 23:22:11.195273 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:22:11.195258    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" event={"ID":"ff64add8-1739-4ee5-a414-3f373f59e7ff","Type":"ContainerDied","Data":"3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"}
Sep 07 23:22:11.195756 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:22:11.195316    2557 scope.go:117] "RemoveContainer" containerID="fdd6dae27858f2a829716afe616e8084fc8c6b0cb33b824067df31a37e3327f8"
Sep 07 23:22:11.195756 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:22:11.195657    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:22:11.195878 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:22:11.195855    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:22:11.500251 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:22:11.500159    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:22:11.625688 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:22:11.625655    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:22:12.202508 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:22:12.202478    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:22:12.202898 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:22:12.202699    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:22:13.207712 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:22:13.207685    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:22:13.208130 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:22:13.207851    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:22:23.871497 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:22:23.871464    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:22:23.871895 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:22:23.871626    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:22:35.871396 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:22:35.871361    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:22:35.871877 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:22:35.871535    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:22:49.871885 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:22:49.871851    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:22:49.872303 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:22:49.872037    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:23:00.871450 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:23:00.871414    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:23:00.871953 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:23:00.871582    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:23:15.871303 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:23:15.871272    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:23:15.871747 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:23:15.871463    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:23:28.874022 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:23:28.873985    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:23:28.874557 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:23:28.874219    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:23:40.871149 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:23:40.871112    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:23:40.871618 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:23:40.871319    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:23:54.871668 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:23:54.871584    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:23:54.872253 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:23:54.871764    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:24:05.871616 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:24:05.871579    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:24:05.872199 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:24:05.871809    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:24:19.871515 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:24:19.871485    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:24:19.871906 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:24:19.871667    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:24:30.871954 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:24:30.871891    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:24:30.872339 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:24:30.872205    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:24:44.871640 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:24:44.871605    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:24:44.872433 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:24:44.871782    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:24:59.871993 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:24:59.871960    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:24:59.872445 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:24:59.872164    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:25:14.871726 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:14.871634    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:25:14.872339 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:25:14.871822    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:25:28.874206 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:28.874175    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:25:28.874673 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:25:28.874413    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:25:40.871759 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:40.871718    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:25:40.872267 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:25:40.871898    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:25:44.743733 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.743697    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-6nr4r"]
Sep 07 23:25:44.744137 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.744063    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f93e25a5-5352-4c72-a91b-460e6c457da3" containerName="console"
Sep 07 23:25:44.744137 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.744077    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f93e25a5-5352-4c72-a91b-460e6c457da3" containerName="console"
Sep 07 23:25:44.744213 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.744148    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f93e25a5-5352-4c72-a91b-460e6c457da3" containerName="console"
Sep 07 23:25:44.747020 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.747005    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-6nr4r"
Sep 07 23:25:44.749374 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.749354    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-p5msm\""
Sep 07 23:25:44.761965 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.761942    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-6nr4r"]
Sep 07 23:25:44.762833 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.762807    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9h68\" (UniqueName: \"kubernetes.io/projected/218b2216-f0e9-4522-b175-ba9148153f76-kube-api-access-r9h68\") pod \"authorino-5dc7ccb5f-6nr4r\" (UID: \"218b2216-f0e9-4522-b175-ba9148153f76\") " pod="kuadrant-system/authorino-5dc7ccb5f-6nr4r"
Sep 07 23:25:44.861434 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.861396    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-687cff4559-pztg5"]
Sep 07 23:25:44.863287 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.863261    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9h68\" (UniqueName: \"kubernetes.io/projected/218b2216-f0e9-4522-b175-ba9148153f76-kube-api-access-r9h68\") pod \"authorino-5dc7ccb5f-6nr4r\" (UID: \"218b2216-f0e9-4522-b175-ba9148153f76\") " pod="kuadrant-system/authorino-5dc7ccb5f-6nr4r"
Sep 07 23:25:44.864705 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.864685    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:25:44.870336 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.870315    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-6nr4r"]
Sep 07 23:25:44.870546 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:25:44.870529    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-r9h68], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-6nr4r" podUID="218b2216-f0e9-4522-b175-ba9148153f76"
Sep 07 23:25:44.878619 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.878593    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9h68\" (UniqueName: \"kubernetes.io/projected/218b2216-f0e9-4522-b175-ba9148153f76-kube-api-access-r9h68\") pod \"authorino-5dc7ccb5f-6nr4r\" (UID: \"218b2216-f0e9-4522-b175-ba9148153f76\") " pod="kuadrant-system/authorino-5dc7ccb5f-6nr4r"
Sep 07 23:25:44.878619 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.878599    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-687cff4559-pztg5"]
Sep 07 23:25:44.894984 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.894957    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687bd45585-5m4bk"]
Sep 07 23:25:44.898435 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.898411    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-5m4bk"
Sep 07 23:25:44.900643 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.900620    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 07 23:25:44.904095 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.904062    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687bd45585-5m4bk"]
Sep 07 23:25:44.964146 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.964114    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/369ba7bb-5ded-4bc4-b33b-91eb1f1fe901-tls-cert\") pod \"authorino-687bd45585-5m4bk\" (UID: \"369ba7bb-5ded-4bc4-b33b-91eb1f1fe901\") " pod="kuadrant-system/authorino-687bd45585-5m4bk"
Sep 07 23:25:44.964146 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.964162    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a1408d9-6d74-4e69-9603-5320a8863bff-metrics-certs\") pod \"maas-api-687cff4559-pztg5\" (UID: \"3a1408d9-6d74-4e69-9603-5320a8863bff\") " pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:25:44.964403 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.964278    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a1408d9-6d74-4e69-9603-5320a8863bff-maas-api-tls\") pod \"maas-api-687cff4559-pztg5\" (UID: \"3a1408d9-6d74-4e69-9603-5320a8863bff\") " pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:25:44.964403 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.964310    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7v85\" (UniqueName: \"kubernetes.io/projected/369ba7bb-5ded-4bc4-b33b-91eb1f1fe901-kube-api-access-p7v85\") pod \"authorino-687bd45585-5m4bk\" (UID: \"369ba7bb-5ded-4bc4-b33b-91eb1f1fe901\") " pod="kuadrant-system/authorino-687bd45585-5m4bk"
Sep 07 23:25:44.964403 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.964339    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws7qp\" (UniqueName: \"kubernetes.io/projected/3a1408d9-6d74-4e69-9603-5320a8863bff-kube-api-access-ws7qp\") pod \"maas-api-687cff4559-pztg5\" (UID: \"3a1408d9-6d74-4e69-9603-5320a8863bff\") " pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:25:44.964403 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.964388    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a1408d9-6d74-4e69-9603-5320a8863bff-openshift-service-ca\") pod \"maas-api-687cff4559-pztg5\" (UID: \"3a1408d9-6d74-4e69-9603-5320a8863bff\") " pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:25:44.968790 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.968765    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-5m4bk"]
Sep 07 23:25:44.969008 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:25:44.968990    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-p7v85 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-687bd45585-5m4bk" podUID="369ba7bb-5ded-4bc4-b33b-91eb1f1fe901"
Sep 07 23:25:44.993024 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.992996    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7cd4f9547b-ptdqg"]
Sep 07 23:25:44.996348 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:44.996297    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cd4f9547b-ptdqg"
Sep 07 23:25:45.002536 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.002513    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cd4f9547b-ptdqg"]
Sep 07 23:25:45.064977 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.064941    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvm29\" (UniqueName: \"kubernetes.io/projected/93828e2b-beed-4478-9b41-2e59f831bbcc-kube-api-access-zvm29\") pod \"authorino-7cd4f9547b-ptdqg\" (UID: \"93828e2b-beed-4478-9b41-2e59f831bbcc\") " pod="kuadrant-system/authorino-7cd4f9547b-ptdqg"
Sep 07 23:25:45.065155 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.064984    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a1408d9-6d74-4e69-9603-5320a8863bff-maas-api-tls\") pod \"maas-api-687cff4559-pztg5\" (UID: \"3a1408d9-6d74-4e69-9603-5320a8863bff\") " pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:25:45.065155 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.065090    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7v85\" (UniqueName: \"kubernetes.io/projected/369ba7bb-5ded-4bc4-b33b-91eb1f1fe901-kube-api-access-p7v85\") pod \"authorino-687bd45585-5m4bk\" (UID: \"369ba7bb-5ded-4bc4-b33b-91eb1f1fe901\") " pod="kuadrant-system/authorino-687bd45585-5m4bk"
Sep 07 23:25:45.065155 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.065119    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws7qp\" (UniqueName: \"kubernetes.io/projected/3a1408d9-6d74-4e69-9603-5320a8863bff-kube-api-access-ws7qp\") pod \"maas-api-687cff4559-pztg5\" (UID: \"3a1408d9-6d74-4e69-9603-5320a8863bff\") " pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:25:45.065331 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.065158    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/93828e2b-beed-4478-9b41-2e59f831bbcc-tls-cert\") pod \"authorino-7cd4f9547b-ptdqg\" (UID: \"93828e2b-beed-4478-9b41-2e59f831bbcc\") " pod="kuadrant-system/authorino-7cd4f9547b-ptdqg"
Sep 07 23:25:45.065331 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.065191    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a1408d9-6d74-4e69-9603-5320a8863bff-openshift-service-ca\") pod \"maas-api-687cff4559-pztg5\" (UID: \"3a1408d9-6d74-4e69-9603-5320a8863bff\") " pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:25:45.065331 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.065240    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/369ba7bb-5ded-4bc4-b33b-91eb1f1fe901-tls-cert\") pod \"authorino-687bd45585-5m4bk\" (UID: \"369ba7bb-5ded-4bc4-b33b-91eb1f1fe901\") " pod="kuadrant-system/authorino-687bd45585-5m4bk"
Sep 07 23:25:45.065484 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.065316    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a1408d9-6d74-4e69-9603-5320a8863bff-metrics-certs\") pod \"maas-api-687cff4559-pztg5\" (UID: \"3a1408d9-6d74-4e69-9603-5320a8863bff\") " pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:25:45.065894 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.065870    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a1408d9-6d74-4e69-9603-5320a8863bff-openshift-service-ca\") pod \"maas-api-687cff4559-pztg5\" (UID: \"3a1408d9-6d74-4e69-9603-5320a8863bff\") " pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:25:45.067451 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.067428    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a1408d9-6d74-4e69-9603-5320a8863bff-maas-api-tls\") pod \"maas-api-687cff4559-pztg5\" (UID: \"3a1408d9-6d74-4e69-9603-5320a8863bff\") " pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:25:45.067585 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.067526    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/369ba7bb-5ded-4bc4-b33b-91eb1f1fe901-tls-cert\") pod \"authorino-687bd45585-5m4bk\" (UID: \"369ba7bb-5ded-4bc4-b33b-91eb1f1fe901\") " pod="kuadrant-system/authorino-687bd45585-5m4bk"
Sep 07 23:25:45.067688 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.067668    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a1408d9-6d74-4e69-9603-5320a8863bff-metrics-certs\") pod \"maas-api-687cff4559-pztg5\" (UID: \"3a1408d9-6d74-4e69-9603-5320a8863bff\") " pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:25:45.072108 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.072076    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws7qp\" (UniqueName: \"kubernetes.io/projected/3a1408d9-6d74-4e69-9603-5320a8863bff-kube-api-access-ws7qp\") pod \"maas-api-687cff4559-pztg5\" (UID: \"3a1408d9-6d74-4e69-9603-5320a8863bff\") " pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:25:45.072253 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.072235    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7v85\" (UniqueName: \"kubernetes.io/projected/369ba7bb-5ded-4bc4-b33b-91eb1f1fe901-kube-api-access-p7v85\") pod \"authorino-687bd45585-5m4bk\" (UID: \"369ba7bb-5ded-4bc4-b33b-91eb1f1fe901\") " pod="kuadrant-system/authorino-687bd45585-5m4bk"
Sep 07 23:25:45.165897 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.165850    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvm29\" (UniqueName: \"kubernetes.io/projected/93828e2b-beed-4478-9b41-2e59f831bbcc-kube-api-access-zvm29\") pod \"authorino-7cd4f9547b-ptdqg\" (UID: \"93828e2b-beed-4478-9b41-2e59f831bbcc\") " pod="kuadrant-system/authorino-7cd4f9547b-ptdqg"
Sep 07 23:25:45.166112 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.165941    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/93828e2b-beed-4478-9b41-2e59f831bbcc-tls-cert\") pod \"authorino-7cd4f9547b-ptdqg\" (UID: \"93828e2b-beed-4478-9b41-2e59f831bbcc\") " pod="kuadrant-system/authorino-7cd4f9547b-ptdqg"
Sep 07 23:25:45.168343 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.168311    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/93828e2b-beed-4478-9b41-2e59f831bbcc-tls-cert\") pod \"authorino-7cd4f9547b-ptdqg\" (UID: \"93828e2b-beed-4478-9b41-2e59f831bbcc\") " pod="kuadrant-system/authorino-7cd4f9547b-ptdqg"
Sep 07 23:25:45.172742 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.172724    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvm29\" (UniqueName: \"kubernetes.io/projected/93828e2b-beed-4478-9b41-2e59f831bbcc-kube-api-access-zvm29\") pod \"authorino-7cd4f9547b-ptdqg\" (UID: \"93828e2b-beed-4478-9b41-2e59f831bbcc\") " pod="kuadrant-system/authorino-7cd4f9547b-ptdqg"
Sep 07 23:25:45.176594 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.176574    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:25:45.291163 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.291091    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-5m4bk"
Sep 07 23:25:45.291307 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.291093    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-6nr4r"
Sep 07 23:25:45.298647 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.298627    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-5m4bk"
Sep 07 23:25:45.301422 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.301406    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-6nr4r"
Sep 07 23:25:45.306121 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.306103    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cd4f9547b-ptdqg"
Sep 07 23:25:45.367620 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.367544    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7v85\" (UniqueName: \"kubernetes.io/projected/369ba7bb-5ded-4bc4-b33b-91eb1f1fe901-kube-api-access-p7v85\") pod \"369ba7bb-5ded-4bc4-b33b-91eb1f1fe901\" (UID: \"369ba7bb-5ded-4bc4-b33b-91eb1f1fe901\") "
Sep 07 23:25:45.367765 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.367634    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9h68\" (UniqueName: \"kubernetes.io/projected/218b2216-f0e9-4522-b175-ba9148153f76-kube-api-access-r9h68\") pod \"218b2216-f0e9-4522-b175-ba9148153f76\" (UID: \"218b2216-f0e9-4522-b175-ba9148153f76\") "
Sep 07 23:25:45.367765 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.367731    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/369ba7bb-5ded-4bc4-b33b-91eb1f1fe901-tls-cert\") pod \"369ba7bb-5ded-4bc4-b33b-91eb1f1fe901\" (UID: \"369ba7bb-5ded-4bc4-b33b-91eb1f1fe901\") "
Sep 07 23:25:45.370211 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.370183    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/218b2216-f0e9-4522-b175-ba9148153f76-kube-api-access-r9h68" (OuterVolumeSpecName: "kube-api-access-r9h68") pod "218b2216-f0e9-4522-b175-ba9148153f76" (UID: "218b2216-f0e9-4522-b175-ba9148153f76"). InnerVolumeSpecName "kube-api-access-r9h68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 23:25:45.370345 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.370234    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/369ba7bb-5ded-4bc4-b33b-91eb1f1fe901-kube-api-access-p7v85" (OuterVolumeSpecName: "kube-api-access-p7v85") pod "369ba7bb-5ded-4bc4-b33b-91eb1f1fe901" (UID: "369ba7bb-5ded-4bc4-b33b-91eb1f1fe901"). InnerVolumeSpecName "kube-api-access-p7v85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 23:25:45.370345 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.370299    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/369ba7bb-5ded-4bc4-b33b-91eb1f1fe901-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "369ba7bb-5ded-4bc4-b33b-91eb1f1fe901" (UID: "369ba7bb-5ded-4bc4-b33b-91eb1f1fe901"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 23:25:45.446186 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.446153    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-687cff4559-pztg5"]
Sep 07 23:25:45.447939 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:25:45.447899    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a1408d9_6d74_4e69_9603_5320a8863bff.slice/crio-373eb18b72817733a67d34b697d8ba4af8c2687affa6ea454ceb454fdccd7792 WatchSource:0}: Error finding container 373eb18b72817733a67d34b697d8ba4af8c2687affa6ea454ceb454fdccd7792: Status 404 returned error can't find the container with id 373eb18b72817733a67d34b697d8ba4af8c2687affa6ea454ceb454fdccd7792
Sep 07 23:25:45.468853 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.468827    2557 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/369ba7bb-5ded-4bc4-b33b-91eb1f1fe901-tls-cert\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:25:45.468853 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.468851    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7v85\" (UniqueName: \"kubernetes.io/projected/369ba7bb-5ded-4bc4-b33b-91eb1f1fe901-kube-api-access-p7v85\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:25:45.469012 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.468861    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9h68\" (UniqueName: \"kubernetes.io/projected/218b2216-f0e9-4522-b175-ba9148153f76-kube-api-access-r9h68\") on node \"ip-10-0-133-218.ec2.internal\" DevicePath \"\""
Sep 07 23:25:45.573907 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:45.573728    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cd4f9547b-ptdqg"]
Sep 07 23:25:45.576409 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:25:45.576385    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93828e2b_beed_4478_9b41_2e59f831bbcc.slice/crio-c4fde87cf292a8441d7ea6dd41c95ce004e5a8a2c097833aa4d83e4e3458d8e2 WatchSource:0}: Error finding container c4fde87cf292a8441d7ea6dd41c95ce004e5a8a2c097833aa4d83e4e3458d8e2: Status 404 returned error can't find the container with id c4fde87cf292a8441d7ea6dd41c95ce004e5a8a2c097833aa4d83e4e3458d8e2
Sep 07 23:25:46.297095 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:46.297059    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cd4f9547b-ptdqg" event={"ID":"93828e2b-beed-4478-9b41-2e59f831bbcc","Type":"ContainerStarted","Data":"c4fde87cf292a8441d7ea6dd41c95ce004e5a8a2c097833aa4d83e4e3458d8e2"}
Sep 07 23:25:46.298624 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:46.298599    2557 generic.go:356] "Generic (PLEG): container finished" podID="3a1408d9-6d74-4e69-9603-5320a8863bff" containerID="d6f91095cd1292e6a6a6a407fc0005384202a36b88c2ef3339d655d684b6f529" exitCode=1
Sep 07 23:25:46.298734 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:46.298638    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" event={"ID":"3a1408d9-6d74-4e69-9603-5320a8863bff","Type":"ContainerDied","Data":"d6f91095cd1292e6a6a6a407fc0005384202a36b88c2ef3339d655d684b6f529"}
Sep 07 23:25:46.298734 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:46.298661    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-5m4bk"
Sep 07 23:25:46.298734 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:46.298681    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" event={"ID":"3a1408d9-6d74-4e69-9603-5320a8863bff","Type":"ContainerStarted","Data":"373eb18b72817733a67d34b697d8ba4af8c2687affa6ea454ceb454fdccd7792"}
Sep 07 23:25:46.298734 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:46.298687    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-6nr4r"
Sep 07 23:25:46.298889 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:46.298871    2557 scope.go:117] "RemoveContainer" containerID="d6f91095cd1292e6a6a6a407fc0005384202a36b88c2ef3339d655d684b6f529"
Sep 07 23:25:46.339176 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:46.339149    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-6nr4r"]
Sep 07 23:25:46.343046 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:46.343021    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-6nr4r"]
Sep 07 23:25:46.361750 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:46.361723    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-5m4bk"]
Sep 07 23:25:46.365597 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:46.365574    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687bd45585-5m4bk"]
Sep 07 23:25:46.877532 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:46.877499    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="218b2216-f0e9-4522-b175-ba9148153f76" path="/var/lib/kubelet/pods/218b2216-f0e9-4522-b175-ba9148153f76/volumes"
Sep 07 23:25:46.877781 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:46.877759    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="369ba7bb-5ded-4bc4-b33b-91eb1f1fe901" path="/var/lib/kubelet/pods/369ba7bb-5ded-4bc4-b33b-91eb1f1fe901/volumes"
Sep 07 23:25:47.306076 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:47.305998    2557 generic.go:356] "Generic (PLEG): container finished" podID="3a1408d9-6d74-4e69-9603-5320a8863bff" containerID="6ee66559fb541a2643f9a5d5568239d609eb7a899caefed365855fdaef7c8741" exitCode=1
Sep 07 23:25:47.306475 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:47.306077    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" event={"ID":"3a1408d9-6d74-4e69-9603-5320a8863bff","Type":"ContainerDied","Data":"6ee66559fb541a2643f9a5d5568239d609eb7a899caefed365855fdaef7c8741"}
Sep 07 23:25:47.306475 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:47.306137    2557 scope.go:117] "RemoveContainer" containerID="d6f91095cd1292e6a6a6a407fc0005384202a36b88c2ef3339d655d684b6f529"
Sep 07 23:25:47.306475 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:47.306363    2557 scope.go:117] "RemoveContainer" containerID="6ee66559fb541a2643f9a5d5568239d609eb7a899caefed365855fdaef7c8741"
Sep 07 23:25:47.306614 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:25:47.306565    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:25:47.307685 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:47.307664    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cd4f9547b-ptdqg" event={"ID":"93828e2b-beed-4478-9b41-2e59f831bbcc","Type":"ContainerStarted","Data":"6f7fc313b849a1d375ff590cc88d4d33e904be072d294aa8670297eb1b669df2"}
Sep 07 23:25:47.335478 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:47.335430    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7cd4f9547b-ptdqg" podStartSLOduration=2.494793472 podStartE2EDuration="3.335414982s" totalImagesPullingTime="840.62151ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:25:47.334000492 +0000 UTC m=+1738.962482909" watchObservedRunningTime="2026-09-07 23:25:47.335414982 +0000 UTC m=+1738.963897318"
Sep 07 23:25:48.314994 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:48.314964    2557 scope.go:117] "RemoveContainer" containerID="6ee66559fb541a2643f9a5d5568239d609eb7a899caefed365855fdaef7c8741"
Sep 07 23:25:48.315351 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:25:48.315145    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:25:50.177696 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:50.177658    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:25:50.178112 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:50.178096    2557 scope.go:117] "RemoveContainer" containerID="6ee66559fb541a2643f9a5d5568239d609eb7a899caefed365855fdaef7c8741"
Sep 07 23:25:50.178294 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:25:50.178275    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:25:53.872065 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:53.872031    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:25:53.872477 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:25:53.872228    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:25:55.177030 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:55.176995    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:25:55.177398 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:25:55.177383    2557 scope.go:117] "RemoveContainer" containerID="6ee66559fb541a2643f9a5d5568239d609eb7a899caefed365855fdaef7c8741"
Sep 07 23:25:55.177564 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:25:55.177544    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:26:05.872053 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:05.872020    2557 scope.go:117] "RemoveContainer" containerID="6ee66559fb541a2643f9a5d5568239d609eb7a899caefed365855fdaef7c8741"
Sep 07 23:26:05.872526 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:05.872186    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:26:05.872526 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:26:05.872395    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:26:06.416863 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:06.416830    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" event={"ID":"3a1408d9-6d74-4e69-9603-5320a8863bff","Type":"ContainerStarted","Data":"cf1cd753bbbe51252076d5cb68337058e907102dcb5a67b978c60a23bae7944d"}
Sep 07 23:26:06.417071 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:06.417053    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:26:06.437765 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:06.437712    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podStartSLOduration=21.317628249 podStartE2EDuration="22.437695166s" totalImagesPullingTime="1.120066917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:25:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:26:06.435426133 +0000 UTC m=+1758.063908472" watchObservedRunningTime="2026-09-07 23:26:06.437695166 +0000 UTC m=+1758.066177500"
Sep 07 23:26:07.425169 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:07.425130    2557 generic.go:356] "Generic (PLEG): container finished" podID="3a1408d9-6d74-4e69-9603-5320a8863bff" containerID="cf1cd753bbbe51252076d5cb68337058e907102dcb5a67b978c60a23bae7944d" exitCode=1
Sep 07 23:26:07.425646 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:07.425183    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" event={"ID":"3a1408d9-6d74-4e69-9603-5320a8863bff","Type":"ContainerDied","Data":"cf1cd753bbbe51252076d5cb68337058e907102dcb5a67b978c60a23bae7944d"}
Sep 07 23:26:07.425646 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:07.425229    2557 scope.go:117] "RemoveContainer" containerID="6ee66559fb541a2643f9a5d5568239d609eb7a899caefed365855fdaef7c8741"
Sep 07 23:26:07.425646 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:07.425533    2557 scope.go:117] "RemoveContainer" containerID="cf1cd753bbbe51252076d5cb68337058e907102dcb5a67b978c60a23bae7944d"
Sep 07 23:26:07.425805 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:26:07.425763    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:26:08.432621 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:08.432596    2557 scope.go:117] "RemoveContainer" containerID="cf1cd753bbbe51252076d5cb68337058e907102dcb5a67b978c60a23bae7944d"
Sep 07 23:26:08.433003 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:26:08.432764    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:26:15.177682 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:15.177645    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:26:15.178070 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:15.178060    2557 scope.go:117] "RemoveContainer" containerID="cf1cd753bbbe51252076d5cb68337058e907102dcb5a67b978c60a23bae7944d"
Sep 07 23:26:15.178248 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:26:15.178227    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:26:19.871547 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:19.871514    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:26:19.872055 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:26:19.871686    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:26:26.872172 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:26.872138    2557 scope.go:117] "RemoveContainer" containerID="cf1cd753bbbe51252076d5cb68337058e907102dcb5a67b978c60a23bae7944d"
Sep 07 23:26:27.532641 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:27.532611    2557 generic.go:356] "Generic (PLEG): container finished" podID="3a1408d9-6d74-4e69-9603-5320a8863bff" containerID="6a4e8ec416bb630f85d7c0526c2115b3d1e2488ec4f75ea41d38886ef7cd89f1" exitCode=1
Sep 07 23:26:27.532788 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:27.532688    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" event={"ID":"3a1408d9-6d74-4e69-9603-5320a8863bff","Type":"ContainerDied","Data":"6a4e8ec416bb630f85d7c0526c2115b3d1e2488ec4f75ea41d38886ef7cd89f1"}
Sep 07 23:26:27.532788 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:27.532739    2557 scope.go:117] "RemoveContainer" containerID="cf1cd753bbbe51252076d5cb68337058e907102dcb5a67b978c60a23bae7944d"
Sep 07 23:26:27.533176 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:27.533155    2557 scope.go:117] "RemoveContainer" containerID="6a4e8ec416bb630f85d7c0526c2115b3d1e2488ec4f75ea41d38886ef7cd89f1"
Sep 07 23:26:27.533416 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:26:27.533391    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:26:31.417517 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:31.417480    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:26:31.417953 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:31.417846    2557 scope.go:117] "RemoveContainer" containerID="6a4e8ec416bb630f85d7c0526c2115b3d1e2488ec4f75ea41d38886ef7cd89f1"
Sep 07 23:26:31.418074 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:26:31.418053    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:26:31.871233 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:31.871140    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:26:31.871404 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:26:31.871369    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:26:35.177046 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:35.176994    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:26:35.177445 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:35.177387    2557 scope.go:117] "RemoveContainer" containerID="6a4e8ec416bb630f85d7c0526c2115b3d1e2488ec4f75ea41d38886ef7cd89f1"
Sep 07 23:26:35.177577 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:26:35.177559    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:26:43.871129 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:43.871049    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:26:43.871486 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:26:43.871237    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:26:46.871479 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:46.871446    2557 scope.go:117] "RemoveContainer" containerID="6a4e8ec416bb630f85d7c0526c2115b3d1e2488ec4f75ea41d38886ef7cd89f1"
Sep 07 23:26:46.871863 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:26:46.871695    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:26:48.974390 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:48.974363    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/ovn-acl-logging/0.log"
Sep 07 23:26:48.982121 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:48.982101    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/ovn-acl-logging/0.log"
Sep 07 23:26:55.872186 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:55.872155    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:26:55.872636 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:26:55.872315    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:26:57.872103 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:26:57.872068    2557 scope.go:117] "RemoveContainer" containerID="6a4e8ec416bb630f85d7c0526c2115b3d1e2488ec4f75ea41d38886ef7cd89f1"
Sep 07 23:26:57.872493 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:26:57.872248    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:27:08.874000 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:27:08.873962    2557 scope.go:117] "RemoveContainer" containerID="6a4e8ec416bb630f85d7c0526c2115b3d1e2488ec4f75ea41d38886ef7cd89f1"
Sep 07 23:27:09.754294 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:27:09.754263    2557 generic.go:356] "Generic (PLEG): container finished" podID="3a1408d9-6d74-4e69-9603-5320a8863bff" containerID="7482970b9da331d52f5b8784c170457f0a5936e15039d0b557a1629ea1b52764" exitCode=1
Sep 07 23:27:09.754464 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:27:09.754311    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" event={"ID":"3a1408d9-6d74-4e69-9603-5320a8863bff","Type":"ContainerDied","Data":"7482970b9da331d52f5b8784c170457f0a5936e15039d0b557a1629ea1b52764"}
Sep 07 23:27:09.754464 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:27:09.754378    2557 scope.go:117] "RemoveContainer" containerID="6a4e8ec416bb630f85d7c0526c2115b3d1e2488ec4f75ea41d38886ef7cd89f1"
Sep 07 23:27:09.754740 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:27:09.754721    2557 scope.go:117] "RemoveContainer" containerID="7482970b9da331d52f5b8784c170457f0a5936e15039d0b557a1629ea1b52764"
Sep 07 23:27:09.754958 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:27:09.754932    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:27:10.871977 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:27:10.871940    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:27:10.874317 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:27:10.872354    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 23:27:11.417754 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:27:11.417714    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:27:11.418140 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:27:11.418124    2557 scope.go:117] "RemoveContainer" containerID="7482970b9da331d52f5b8784c170457f0a5936e15039d0b557a1629ea1b52764"
Sep 07 23:27:11.418316 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:27:11.418297    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:27:11.771384 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:27:11.771348    2557 generic.go:356] "Generic (PLEG): container finished" podID="ff64add8-1739-4ee5-a414-3f373f59e7ff" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64" exitCode=1
Sep 07 23:27:11.771555 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:27:11.771423    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" event={"ID":"ff64add8-1739-4ee5-a414-3f373f59e7ff","Type":"ContainerDied","Data":"e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"}
Sep 07 23:27:11.771555 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:27:11.771484    2557 scope.go:117] "RemoveContainer" containerID="3c4bee5440d5fdf021e430f424a55a68ae6ec537a5103b2bf075ae775a94d190"
Sep 07 23:27:11.771836 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:27:11.771816    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:27:11.772109 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:27:11.772080    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:27:15.176998 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:27:15.176964    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:27:15.177367 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:27:15.177321    2557 scope.go:117] "RemoveContainer" containerID="7482970b9da331d52f5b8784c170457f0a5936e15039d0b557a1629ea1b52764"
Sep 07 23:27:15.177518 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:27:15.177499    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:27:16.500173 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:27:16.500137    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:27:16.500574 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:27:16.500507    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:27:16.500705 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:27:16.500684    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:27:21.625219 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:27:21.625183    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:27:21.625624 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:27:21.625575    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:27:21.625772 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:27:21.625751    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:27:27.871422 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:27:27.871388    2557 scope.go:117] "RemoveContainer" containerID="7482970b9da331d52f5b8784c170457f0a5936e15039d0b557a1629ea1b52764"
Sep 07 23:27:27.871946 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:27:27.871605    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:27:36.871125 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:27:36.871093    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:27:36.871507 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:27:36.871298    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:27:39.871227 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:27:39.871197    2557 scope.go:117] "RemoveContainer" containerID="7482970b9da331d52f5b8784c170457f0a5936e15039d0b557a1629ea1b52764"
Sep 07 23:27:39.871597 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:27:39.871362    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:27:47.871492 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:27:47.871454    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:27:47.871882 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:27:47.871628    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:27:52.877845 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:27:52.877817    2557 scope.go:117] "RemoveContainer" containerID="7482970b9da331d52f5b8784c170457f0a5936e15039d0b557a1629ea1b52764"
Sep 07 23:27:52.878272 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:27:52.877982    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:28:00.872097 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:28:00.872064    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:28:00.872558 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:28:00.872250    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:28:05.871499 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:28:05.871463    2557 scope.go:117] "RemoveContainer" containerID="7482970b9da331d52f5b8784c170457f0a5936e15039d0b557a1629ea1b52764"
Sep 07 23:28:05.871904 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:28:05.871658    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:28:12.871456 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:28:12.871381    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:28:12.871812 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:28:12.871562    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:28:16.877608 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:28:16.877572    2557 scope.go:117] "RemoveContainer" containerID="7482970b9da331d52f5b8784c170457f0a5936e15039d0b557a1629ea1b52764"
Sep 07 23:28:16.878100 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:28:16.877791    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:28:26.877348 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:28:26.877317    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:28:26.877752 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:28:26.877510    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:28:29.871780 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:28:29.871748    2557 scope.go:117] "RemoveContainer" containerID="7482970b9da331d52f5b8784c170457f0a5936e15039d0b557a1629ea1b52764"
Sep 07 23:28:31.183072 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:28:31.183039    2557 generic.go:356] "Generic (PLEG): container finished" podID="3a1408d9-6d74-4e69-9603-5320a8863bff" containerID="49b781c9839db4f5413f859ca99a869de936b64f424762fe91e2b10bd35cf2a2" exitCode=1
Sep 07 23:28:31.183441 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:28:31.183109    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" event={"ID":"3a1408d9-6d74-4e69-9603-5320a8863bff","Type":"ContainerDied","Data":"49b781c9839db4f5413f859ca99a869de936b64f424762fe91e2b10bd35cf2a2"}
Sep 07 23:28:31.183441 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:28:31.183169    2557 scope.go:117] "RemoveContainer" containerID="7482970b9da331d52f5b8784c170457f0a5936e15039d0b557a1629ea1b52764"
Sep 07 23:28:31.183566 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:28:31.183510    2557 scope.go:117] "RemoveContainer" containerID="49b781c9839db4f5413f859ca99a869de936b64f424762fe91e2b10bd35cf2a2"
Sep 07 23:28:31.183705 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:28:31.183683    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:28:31.417392 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:28:31.417353    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:28:32.189653 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:28:32.189621    2557 scope.go:117] "RemoveContainer" containerID="49b781c9839db4f5413f859ca99a869de936b64f424762fe91e2b10bd35cf2a2"
Sep 07 23:28:32.190150 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:28:32.189793    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:28:35.177383 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:28:35.177340    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:28:35.177780 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:28:35.177759    2557 scope.go:117] "RemoveContainer" containerID="49b781c9839db4f5413f859ca99a869de936b64f424762fe91e2b10bd35cf2a2"
Sep 07 23:28:35.177987 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:28:35.177967    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:28:38.874351 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:28:38.874324    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:28:38.874805 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:28:38.874518    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:28:45.871772 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:28:45.871736    2557 scope.go:117] "RemoveContainer" containerID="49b781c9839db4f5413f859ca99a869de936b64f424762fe91e2b10bd35cf2a2"
Sep 07 23:28:45.872165 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:28:45.871953    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:28:53.871200 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:28:53.871168    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:28:53.871565 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:28:53.871336    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:28:58.874380 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:28:58.874351    2557 scope.go:117] "RemoveContainer" containerID="49b781c9839db4f5413f859ca99a869de936b64f424762fe91e2b10bd35cf2a2"
Sep 07 23:28:58.874831 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:28:58.874519    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:29:04.871986 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:29:04.871949    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:29:04.872564 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:29:04.872160    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:29:11.871466 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:29:11.871434    2557 scope.go:117] "RemoveContainer" containerID="49b781c9839db4f5413f859ca99a869de936b64f424762fe91e2b10bd35cf2a2"
Sep 07 23:29:11.871850 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:29:11.871601    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:29:17.871689 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:29:17.871660    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:29:17.872124 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:29:17.871835    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:29:26.872159 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:29:26.872126    2557 scope.go:117] "RemoveContainer" containerID="49b781c9839db4f5413f859ca99a869de936b64f424762fe91e2b10bd35cf2a2"
Sep 07 23:29:26.872529 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:29:26.872343    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:29:28.874078 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:29:28.874042    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:29:28.874548 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:29:28.874243    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:29:41.871712 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:29:41.871642    2557 scope.go:117] "RemoveContainer" containerID="49b781c9839db4f5413f859ca99a869de936b64f424762fe91e2b10bd35cf2a2"
Sep 07 23:29:41.872178 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:29:41.871843    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:29:43.870982 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:29:43.870948    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:29:43.871468 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:29:43.871107    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:29:52.871807 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:29:52.871774    2557 scope.go:117] "RemoveContainer" containerID="49b781c9839db4f5413f859ca99a869de936b64f424762fe91e2b10bd35cf2a2"
Sep 07 23:29:52.872187 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:29:52.871973    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:29:54.871473 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:29:54.871447    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:29:54.871845 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:29:54.871627    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:30:05.871793 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:30:05.871758    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:30:05.872206 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:30:05.871965    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:30:06.871901 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:30:06.871868    2557 scope.go:117] "RemoveContainer" containerID="49b781c9839db4f5413f859ca99a869de936b64f424762fe91e2b10bd35cf2a2"
Sep 07 23:30:06.872322 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:30:06.872085    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:30:17.871297 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:30:17.871265    2557 scope.go:117] "RemoveContainer" containerID="49b781c9839db4f5413f859ca99a869de936b64f424762fe91e2b10bd35cf2a2"
Sep 07 23:30:17.871761 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:30:17.871453    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:30:20.871485 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:30:20.871453    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:30:20.871867 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:30:20.871636    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:30:30.871699 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:30:30.871669    2557 scope.go:117] "RemoveContainer" containerID="49b781c9839db4f5413f859ca99a869de936b64f424762fe91e2b10bd35cf2a2"
Sep 07 23:30:30.872094 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:30:30.871813    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:30:33.871246 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:30:33.871220    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:30:33.871619 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:30:33.871406    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:30:41.871462 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:30:41.871432    2557 scope.go:117] "RemoveContainer" containerID="49b781c9839db4f5413f859ca99a869de936b64f424762fe91e2b10bd35cf2a2"
Sep 07 23:30:41.871842 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:30:41.871603    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:30:45.872047 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:30:45.872015    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:30:45.872435 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:30:45.872224    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:30:53.871140 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:30:53.871107    2557 scope.go:117] "RemoveContainer" containerID="49b781c9839db4f5413f859ca99a869de936b64f424762fe91e2b10bd35cf2a2"
Sep 07 23:30:53.871600 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:30:53.871290    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:30:59.872017 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:30:59.871982    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:30:59.872459 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:30:59.872239    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:31:08.873561 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:31:08.873522    2557 scope.go:117] "RemoveContainer" containerID="49b781c9839db4f5413f859ca99a869de936b64f424762fe91e2b10bd35cf2a2"
Sep 07 23:31:08.874045 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:31:08.873773    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:31:13.871484 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:31:13.871410    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:31:13.871847 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:31:13.871579    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:31:20.871767 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:31:20.871726    2557 scope.go:117] "RemoveContainer" containerID="49b781c9839db4f5413f859ca99a869de936b64f424762fe91e2b10bd35cf2a2"
Sep 07 23:31:22.069740 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:31:22.069658    2557 generic.go:356] "Generic (PLEG): container finished" podID="3a1408d9-6d74-4e69-9603-5320a8863bff" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63" exitCode=1
Sep 07 23:31:22.069740 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:31:22.069728    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" event={"ID":"3a1408d9-6d74-4e69-9603-5320a8863bff","Type":"ContainerDied","Data":"ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"}
Sep 07 23:31:22.070192 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:31:22.069790    2557 scope.go:117] "RemoveContainer" containerID="49b781c9839db4f5413f859ca99a869de936b64f424762fe91e2b10bd35cf2a2"
Sep 07 23:31:22.070192 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:31:22.070135    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:31:22.070326 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:31:22.070306    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:31:25.177558 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:31:25.177532    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:31:25.178036 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:31:25.177841    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:31:25.178082 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:31:25.178066    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:31:26.418040 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:31:26.417995    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5"
Sep 07 23:31:26.418409 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:31:26.418389    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:31:26.418573 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:31:26.418550    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:31:27.871127 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:31:27.871094    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:31:27.871504 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:31:27.871264    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:31:36.871384 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:31:36.871355    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:31:36.871749 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:31:36.871512    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:31:42.872053 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:31:42.872016    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:31:42.872452 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:31:42.872210    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:31:49.009770 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:31:49.009744    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/ovn-acl-logging/0.log"
Sep 07 23:31:49.021718 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:31:49.021694    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/ovn-acl-logging/0.log"
Sep 07 23:31:49.871712 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:31:49.871681    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:31:49.871892 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:31:49.871861    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:31:54.871388 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:31:54.871353    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:31:54.871756 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:31:54.871590    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:32:02.871414 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:32:02.871373    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:32:02.871883 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:32:02.871569    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:32:07.870973 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:32:07.870943    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:32:07.871338 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:32:07.871127    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:32:13.871255 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:32:13.871214    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:32:13.873658 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:32:13.871471    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:32:18.874909 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:32:18.874872    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:32:18.875377 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:32:18.875295    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 23:32:19.371016 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:32:19.370985    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" event={"ID":"ff64add8-1739-4ee5-a414-3f373f59e7ff","Type":"ContainerStarted","Data":"b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8"}
Sep 07 23:32:19.371205 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:32:19.371186    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:32:20.379370 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:32:20.379326    2557 generic.go:356] "Generic (PLEG): container finished" podID="ff64add8-1739-4ee5-a414-3f373f59e7ff" containerID="b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8" exitCode=1
Sep 07 23:32:20.379827 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:32:20.379414    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" event={"ID":"ff64add8-1739-4ee5-a414-3f373f59e7ff","Type":"ContainerDied","Data":"b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8"}
Sep 07 23:32:20.379827 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:32:20.379485    2557 scope.go:117] "RemoveContainer" containerID="e3efa06f486b252c80491d1de5a4e9175ac040d54a1d0cc81c8d4e317a64ac64"
Sep 07 23:32:20.379827 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:32:20.379730    2557 scope.go:117] "RemoveContainer" containerID="b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8"
Sep 07 23:32:20.379998 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:32:20.379963    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:32:21.386192 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:32:21.386159    2557 scope.go:117] "RemoveContainer" containerID="b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8"
Sep 07 23:32:21.386571 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:32:21.386339    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:32:21.625589 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:32:21.625551    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97"
Sep 07 23:32:22.391011 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:32:22.390984    2557 scope.go:117] "RemoveContainer" containerID="b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8"
Sep 07 23:32:22.391392 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:32:22.391159    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:32:26.871296 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:32:26.871259    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:32:26.871713 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:32:26.871483    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:32:32.871611 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:32:32.871570    2557 scope.go:117] "RemoveContainer" containerID="b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8"
Sep 07 23:32:32.872148 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:32:32.871795    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:32:37.871507 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:32:37.871476    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:32:37.872002 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:32:37.871635    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:32:43.871971 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:32:43.871880    2557 scope.go:117] "RemoveContainer" containerID="b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8"
Sep 07 23:32:43.872329 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:32:43.872099    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:32:49.871863 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:32:49.871828    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:32:49.872284 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:32:49.872057    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:32:56.871842 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:32:56.871812    2557 scope.go:117] "RemoveContainer" containerID="b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8"
Sep 07 23:32:56.872262 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:32:56.872012    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:33:04.871822 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:33:04.871789    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:33:04.872257 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:33:04.871973    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:33:07.871431 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:33:07.871396    2557 scope.go:117] "RemoveContainer" containerID="b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8"
Sep 07 23:33:07.871868 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:33:07.871614    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:33:15.872187 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:33:15.872154    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:33:15.872666 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:33:15.872317    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:33:22.879069 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:33:22.878480    2557 scope.go:117] "RemoveContainer" containerID="b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8"
Sep 07 23:33:22.879069 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:33:22.878827    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:33:29.871409 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:33:29.871374    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:33:29.871785 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:33:29.871531    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:33:33.871315 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:33:33.871280    2557 scope.go:117] "RemoveContainer" containerID="b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8"
Sep 07 23:33:33.871678 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:33:33.871473    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:33:40.872000 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:33:40.871969    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:33:40.872409 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:33:40.872133    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:33:47.871096 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:33:47.871063    2557 scope.go:117] "RemoveContainer" containerID="b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8"
Sep 07 23:33:47.871553 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:33:47.871293    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:33:54.872214 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:33:54.872175    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:33:54.872668 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:33:54.872420    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:34:01.872037 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:34:01.872005    2557 scope.go:117] "RemoveContainer" containerID="b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8"
Sep 07 23:34:01.872408 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:34:01.872179    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:34:05.872100 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:34:05.872060    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:34:05.872529 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:34:05.872268    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:34:14.871962 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:34:14.871842    2557 scope.go:117] "RemoveContainer" containerID="b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8"
Sep 07 23:34:14.872355 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:34:14.872120    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:34:20.871993 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:34:20.871957    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:34:20.872469 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:34:20.872166    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:34:29.871270 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:34:29.871240    2557 scope.go:117] "RemoveContainer" containerID="b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8"
Sep 07 23:34:29.871646 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:34:29.871408    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:34:33.871263 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:34:33.871231    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:34:33.871636 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:34:33.871404    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:34:42.872239 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:34:42.872205    2557 scope.go:117] "RemoveContainer" containerID="b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8"
Sep 07 23:34:42.872615 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:34:42.872389    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:34:47.871253 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:34:47.871219    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:34:47.871656 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:34:47.871410    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:34:56.871694 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:34:56.871661    2557 scope.go:117] "RemoveContainer" containerID="b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8"
Sep 07 23:34:56.872164 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:34:56.871831    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:35:00.871285 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:35:00.871257    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:35:00.871649 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:35:00.871426    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:35:08.877323 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:35:08.877292    2557 scope.go:117] "RemoveContainer" containerID="b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8"
Sep 07 23:35:08.877687 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:35:08.877467    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:35:15.871665 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:35:15.871634    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:35:15.872065 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:35:15.871803    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:35:23.871591 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:35:23.871560    2557 scope.go:117] "RemoveContainer" containerID="b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8"
Sep 07 23:35:23.871998 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:35:23.871751    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:35:29.871116 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:35:29.871087    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:35:29.871607 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:35:29.871254    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:35:34.871403 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:35:34.871368    2557 scope.go:117] "RemoveContainer" containerID="b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8"
Sep 07 23:35:34.871781 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:35:34.871601    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:35:41.871244 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:35:41.871167    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:35:41.871598 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:35:41.871345    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:35:48.398540 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:35:48.398502    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7cd4f9547b-ptdqg_93828e2b-beed-4478-9b41-2e59f831bbcc/authorino/0.log"
Sep 07 23:35:49.871797 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:35:49.871772    2557 scope.go:117] "RemoveContainer" containerID="b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8"
Sep 07 23:35:49.872206 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:35:49.871970    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:35:52.871073 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:35:52.871040    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:35:52.871435 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:35:52.871270    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:35:53.878268 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:35:53.878236    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-765fd44cc-6zwpw_a9ae5d4e-f7a1-47df-8995-add30ed46b3d/manager/0.log"
Sep 07 23:35:54.096962 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:35:54.096936    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-bb7b75cc4-l68xn_3859e3ff-d62b-4a85-af0b-4c5ad27dc356/manager/0.log"
Sep 07 23:35:54.427230 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:35:54.427201    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5cfc59d48-rtk97_ff64add8-1739-4ee5-a414-3f373f59e7ff/maas-api/10.log"
Sep 07 23:35:54.533852 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:35:54.533824    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-687cff4559-pztg5_3a1408d9-6d74-4e69-9603-5320a8863bff/maas-api/6.log"
Sep 07 23:35:54.640396 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:35:54.640369    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-t8zpb_bc7d5d68-d7c4-42ea-872d-3a7e6e0839d7/postgres/0.log"
Sep 07 23:35:55.395707 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:35:55.395634    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7cd4f9547b-ptdqg_93828e2b-beed-4478-9b41-2e59f831bbcc/authorino/0.log"
Sep 07 23:35:55.506574 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:35:55.506544    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-84d9bfc694-7s8bm_4b7683d3-7b29-4fb2-ab28-2b7169f2e03d/manager/0.log"
Sep 07 23:35:55.616734 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:35:55.616708    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ffcddf5cd-snpxn_b34bb24b-d2b1-4ae1-adfa-fcc578f26386/manager/0.log"
Sep 07 23:35:56.042797 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:35:56.042768    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-565895c755-wg5xf_70d63e30-af65-4ab2-a822-936e7472a5cf/manager/0.log"
Sep 07 23:35:56.380178 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:35:56.380148    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc_403c29f1-00d6-479c-ac66-6d657f541a53/istio-proxy/0.log"
Sep 07 23:35:56.814593 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:35:56.814528    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g_53830593-eb6a-4d68-aaed-97e53c51a711/istio-proxy/0.log"
Sep 07 23:35:56.925189 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:35:56.925166    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-l2742_4f045744-26e7-4f82-b7cf-2b47e5500498/payload-pre-processing/0.log"
Sep 07 23:35:57.143049 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:35:57.143026    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79fdf4c694-bqmz4_a445422f-9995-4e11-88d9-b896c2070032/router/0.log"
Sep 07 23:36:02.688185 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:02.688153    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p6296/must-gather-hhz6l"]
Sep 07 23:36:02.691776 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:02.691756    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p6296/must-gather-hhz6l"
Sep 07 23:36:02.694003 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:02.693985    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p6296\"/\"kube-root-ca.crt\""
Sep 07 23:36:02.695094 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:02.695075    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p6296\"/\"default-dockercfg-qqdml\""
Sep 07 23:36:02.695190 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:02.695081    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p6296\"/\"openshift-service-ca.crt\""
Sep 07 23:36:02.705378 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:02.705358    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p6296/must-gather-hhz6l"]
Sep 07 23:36:02.815143 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:02.815114    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/00efe575-4463-4b68-96f2-3e594d35ad77-must-gather-output\") pod \"must-gather-hhz6l\" (UID: \"00efe575-4463-4b68-96f2-3e594d35ad77\") " pod="openshift-must-gather-p6296/must-gather-hhz6l"
Sep 07 23:36:02.815288 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:02.815171    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g624f\" (UniqueName: \"kubernetes.io/projected/00efe575-4463-4b68-96f2-3e594d35ad77-kube-api-access-g624f\") pod \"must-gather-hhz6l\" (UID: \"00efe575-4463-4b68-96f2-3e594d35ad77\") " pod="openshift-must-gather-p6296/must-gather-hhz6l"
Sep 07 23:36:02.871277 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:02.871248    2557 scope.go:117] "RemoveContainer" containerID="b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8"
Sep 07 23:36:02.871458 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:36:02.871438    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:36:02.916057 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:02.916027    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g624f\" (UniqueName: \"kubernetes.io/projected/00efe575-4463-4b68-96f2-3e594d35ad77-kube-api-access-g624f\") pod \"must-gather-hhz6l\" (UID: \"00efe575-4463-4b68-96f2-3e594d35ad77\") " pod="openshift-must-gather-p6296/must-gather-hhz6l"
Sep 07 23:36:02.916170 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:02.916088    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/00efe575-4463-4b68-96f2-3e594d35ad77-must-gather-output\") pod \"must-gather-hhz6l\" (UID: \"00efe575-4463-4b68-96f2-3e594d35ad77\") " pod="openshift-must-gather-p6296/must-gather-hhz6l"
Sep 07 23:36:02.916391 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:02.916376    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/00efe575-4463-4b68-96f2-3e594d35ad77-must-gather-output\") pod \"must-gather-hhz6l\" (UID: \"00efe575-4463-4b68-96f2-3e594d35ad77\") " pod="openshift-must-gather-p6296/must-gather-hhz6l"
Sep 07 23:36:02.923118 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:02.923089    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g624f\" (UniqueName: \"kubernetes.io/projected/00efe575-4463-4b68-96f2-3e594d35ad77-kube-api-access-g624f\") pod \"must-gather-hhz6l\" (UID: \"00efe575-4463-4b68-96f2-3e594d35ad77\") " pod="openshift-must-gather-p6296/must-gather-hhz6l"
Sep 07 23:36:03.000748 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:03.000691    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p6296/must-gather-hhz6l"
Sep 07 23:36:03.269049 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:03.269020    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p6296/must-gather-hhz6l"]
Sep 07 23:36:03.271228 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:36:03.271201    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00efe575_4463_4b68_96f2_3e594d35ad77.slice/crio-a7d303fe358ecd97a6acc1935fb3d407bf30b0663d805a124b85af5152b50b0c WatchSource:0}: Error finding container a7d303fe358ecd97a6acc1935fb3d407bf30b0663d805a124b85af5152b50b0c: Status 404 returned error can't find the container with id a7d303fe358ecd97a6acc1935fb3d407bf30b0663d805a124b85af5152b50b0c
Sep 07 23:36:03.553053 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:03.552966    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p6296/must-gather-hhz6l" event={"ID":"00efe575-4463-4b68-96f2-3e594d35ad77","Type":"ContainerStarted","Data":"a7d303fe358ecd97a6acc1935fb3d407bf30b0663d805a124b85af5152b50b0c"}
Sep 07 23:36:03.871110 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:03.871049    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:36:03.871499 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:36:03.871267    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:36:04.563441 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:04.563346    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p6296/must-gather-hhz6l" event={"ID":"00efe575-4463-4b68-96f2-3e594d35ad77","Type":"ContainerStarted","Data":"86ec538bb711259c2b4f88ef413b7d69bbb6c233460997dbaea98dca4e455f17"}
Sep 07 23:36:04.563441 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:04.563398    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p6296/must-gather-hhz6l" event={"ID":"00efe575-4463-4b68-96f2-3e594d35ad77","Type":"ContainerStarted","Data":"a90c54f995afbb99eec7f00843fc90ce0f8fc522230d54789553567542eefcf1"}
Sep 07 23:36:04.579793 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:04.579742    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p6296/must-gather-hhz6l" podStartSLOduration=1.857658671 podStartE2EDuration="2.57972695s" totalImagesPullingTime="722.068279ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 23:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:36:04.577176092 +0000 UTC m=+2356.205658424" watchObservedRunningTime="2026-09-07 23:36:04.57972695 +0000 UTC m=+2356.208209326"
Sep 07 23:36:05.447062 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:05.447023    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cds22_2d26fc16-73a5-4574-9525-4ff6eabc0c32/global-pull-secret-syncer/0.log"
Sep 07 23:36:05.615857 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:05.615825    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jg69x_98ee66cc-6517-4fa8-81cd-8b045c045c79/konnectivity-agent/0.log"
Sep 07 23:36:05.633414 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:05.633385    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-218.ec2.internal_a2bbcb9fb12c236ec947180a3f51ffeb/haproxy/0.log"
Sep 07 23:36:10.320695 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:10.320660    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7cd4f9547b-ptdqg_93828e2b-beed-4478-9b41-2e59f831bbcc/authorino/0.log"
Sep 07 23:36:10.373163 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:10.373135    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-84d9bfc694-7s8bm_4b7683d3-7b29-4fb2-ab28-2b7169f2e03d/manager/0.log"
Sep 07 23:36:10.395388 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:10.395356    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ffcddf5cd-snpxn_b34bb24b-d2b1-4ae1-adfa-fcc578f26386/manager/0.log"
Sep 07 23:36:10.497876 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:10.497847    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-565895c755-wg5xf_70d63e30-af65-4ab2-a822-936e7472a5cf/manager/0.log"
Sep 07 23:36:12.204297 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:12.204243    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6478f78969-ccntq_6436db55-918b-4fac-8921-31480283cfc8/metrics-server/0.log"
Sep 07 23:36:12.326208 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:12.326178    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q2djh_64f45b57-271c-4bdf-b3fc-35852e273be2/node-exporter/0.log"
Sep 07 23:36:12.344135 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:12.344100    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q2djh_64f45b57-271c-4bdf-b3fc-35852e273be2/kube-rbac-proxy/0.log"
Sep 07 23:36:12.363481 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:12.363457    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q2djh_64f45b57-271c-4bdf-b3fc-35852e273be2/init-textfile/0.log"
Sep 07 23:36:12.730500 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:12.730442    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-mq6gt_c5028c95-12ed-45c7-8da2-c321bee5bc65/prometheus-operator/0.log"
Sep 07 23:36:12.758679 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:12.758649    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-mq6gt_c5028c95-12ed-45c7-8da2-c321bee5bc65/kube-rbac-proxy/0.log"
Sep 07 23:36:14.444051 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:14.444015    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-dtxv7_d6c9a39c-171b-4644-9e98-c5dd3ae84d3b/networking-console-plugin/0.log"
Sep 07 23:36:15.198151 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:15.198112    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf"]
Sep 07 23:36:15.203621 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:15.203590    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf"
Sep 07 23:36:15.209252 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:15.209226    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf"]
Sep 07 23:36:15.351309 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:15.351279    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km6l7\" (UniqueName: \"kubernetes.io/projected/d48c7419-85b1-4d65-951b-39d2f5e28bfc-kube-api-access-km6l7\") pod \"perf-node-gather-daemonset-h4rmf\" (UID: \"d48c7419-85b1-4d65-951b-39d2f5e28bfc\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf"
Sep 07 23:36:15.351475 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:15.351327    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d48c7419-85b1-4d65-951b-39d2f5e28bfc-podres\") pod \"perf-node-gather-daemonset-h4rmf\" (UID: \"d48c7419-85b1-4d65-951b-39d2f5e28bfc\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf"
Sep 07 23:36:15.351475 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:15.351425    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d48c7419-85b1-4d65-951b-39d2f5e28bfc-proc\") pod \"perf-node-gather-daemonset-h4rmf\" (UID: \"d48c7419-85b1-4d65-951b-39d2f5e28bfc\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf"
Sep 07 23:36:15.351475 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:15.351444    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d48c7419-85b1-4d65-951b-39d2f5e28bfc-lib-modules\") pod \"perf-node-gather-daemonset-h4rmf\" (UID: \"d48c7419-85b1-4d65-951b-39d2f5e28bfc\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf"
Sep 07 23:36:15.351601 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:15.351481    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d48c7419-85b1-4d65-951b-39d2f5e28bfc-sys\") pod \"perf-node-gather-daemonset-h4rmf\" (UID: \"d48c7419-85b1-4d65-951b-39d2f5e28bfc\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf"
Sep 07 23:36:15.452904 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:15.452821    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km6l7\" (UniqueName: \"kubernetes.io/projected/d48c7419-85b1-4d65-951b-39d2f5e28bfc-kube-api-access-km6l7\") pod \"perf-node-gather-daemonset-h4rmf\" (UID: \"d48c7419-85b1-4d65-951b-39d2f5e28bfc\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf"
Sep 07 23:36:15.452904 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:15.452893    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d48c7419-85b1-4d65-951b-39d2f5e28bfc-podres\") pod \"perf-node-gather-daemonset-h4rmf\" (UID: \"d48c7419-85b1-4d65-951b-39d2f5e28bfc\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf"
Sep 07 23:36:15.453411 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:15.452988    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d48c7419-85b1-4d65-951b-39d2f5e28bfc-proc\") pod \"perf-node-gather-daemonset-h4rmf\" (UID: \"d48c7419-85b1-4d65-951b-39d2f5e28bfc\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf"
Sep 07 23:36:15.453411 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:15.453019    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d48c7419-85b1-4d65-951b-39d2f5e28bfc-lib-modules\") pod \"perf-node-gather-daemonset-h4rmf\" (UID: \"d48c7419-85b1-4d65-951b-39d2f5e28bfc\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf"
Sep 07 23:36:15.453411 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:15.453056    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d48c7419-85b1-4d65-951b-39d2f5e28bfc-sys\") pod \"perf-node-gather-daemonset-h4rmf\" (UID: \"d48c7419-85b1-4d65-951b-39d2f5e28bfc\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf"
Sep 07 23:36:15.453411 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:15.453190    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d48c7419-85b1-4d65-951b-39d2f5e28bfc-sys\") pod \"perf-node-gather-daemonset-h4rmf\" (UID: \"d48c7419-85b1-4d65-951b-39d2f5e28bfc\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf"
Sep 07 23:36:15.453634 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:15.453611    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d48c7419-85b1-4d65-951b-39d2f5e28bfc-podres\") pod \"perf-node-gather-daemonset-h4rmf\" (UID: \"d48c7419-85b1-4d65-951b-39d2f5e28bfc\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf"
Sep 07 23:36:15.453844 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:15.453825    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d48c7419-85b1-4d65-951b-39d2f5e28bfc-proc\") pod \"perf-node-gather-daemonset-h4rmf\" (UID: \"d48c7419-85b1-4d65-951b-39d2f5e28bfc\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf"
Sep 07 23:36:15.454002 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:15.453877    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d48c7419-85b1-4d65-951b-39d2f5e28bfc-lib-modules\") pod \"perf-node-gather-daemonset-h4rmf\" (UID: \"d48c7419-85b1-4d65-951b-39d2f5e28bfc\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf"
Sep 07 23:36:15.460811 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:15.460786    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km6l7\" (UniqueName: \"kubernetes.io/projected/d48c7419-85b1-4d65-951b-39d2f5e28bfc-kube-api-access-km6l7\") pod \"perf-node-gather-daemonset-h4rmf\" (UID: \"d48c7419-85b1-4d65-951b-39d2f5e28bfc\") " pod="openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf"
Sep 07 23:36:15.516822 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:15.516791    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6bb679d7d9-ppc9l_8321c521-b135-445d-8d5e-d3a53f292874/console/0.log"
Sep 07 23:36:15.518280 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:15.518253    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf"
Sep 07 23:36:15.802131 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:15.802084    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf"]
Sep 07 23:36:15.803278 ip-10-0-133-218 kubenswrapper[2557]: W0907 23:36:15.803242    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd48c7419_85b1_4d65_951b_39d2f5e28bfc.slice/crio-a7c810925c33318d722adf1f8f070291b34c85f3345cbd38f89e49c8ad5d8a07 WatchSource:0}: Error finding container a7c810925c33318d722adf1f8f070291b34c85f3345cbd38f89e49c8ad5d8a07: Status 404 returned error can't find the container with id a7c810925c33318d722adf1f8f070291b34c85f3345cbd38f89e49c8ad5d8a07
Sep 07 23:36:16.667180 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:16.667135    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf" event={"ID":"d48c7419-85b1-4d65-951b-39d2f5e28bfc","Type":"ContainerStarted","Data":"c98f0f1a3a615166feeefe6a67cba55a19a8af48a3f3c7dcd1a87add919da727"}
Sep 07 23:36:16.667655 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:16.667206    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf" event={"ID":"d48c7419-85b1-4d65-951b-39d2f5e28bfc","Type":"ContainerStarted","Data":"a7c810925c33318d722adf1f8f070291b34c85f3345cbd38f89e49c8ad5d8a07"}
Sep 07 23:36:16.668051 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:16.667999    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf"
Sep 07 23:36:16.687894 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:16.687134    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf" podStartSLOduration=1.687114564 podStartE2EDuration="1.687114564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 23:36:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 23:36:16.683022654 +0000 UTC m=+2368.311504990" watchObservedRunningTime="2026-09-07 23:36:16.687114564 +0000 UTC m=+2368.315596901"
Sep 07 23:36:16.871465 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:16.871431    2557 scope.go:117] "RemoveContainer" containerID="b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8"
Sep 07 23:36:16.871674 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:36:16.871646    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:36:17.093690 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:17.093625    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d8gbl_e5b50755-c1fd-418a-9291-74b579b6c4a4/dns/0.log"
Sep 07 23:36:17.111819 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:17.111789    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d8gbl_e5b50755-c1fd-418a-9291-74b579b6c4a4/kube-rbac-proxy/0.log"
Sep 07 23:36:17.218472 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:17.218442    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9fnns_15cf1f7c-7686-47db-83a3-431fa37e2050/dns-node-resolver/0.log"
Sep 07 23:36:17.760635 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:17.760605    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6c8dw_be6f18f7-5628-458a-93fe-962199c8f623/node-ca/0.log"
Sep 07 23:36:17.872307 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:17.872279    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:36:17.872483 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:36:17.872441    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:36:18.663123 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:18.663088    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc_403c29f1-00d6-479c-ac66-6d657f541a53/istio-proxy/0.log"
Sep 07 23:36:18.762218 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:18.762192    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g_53830593-eb6a-4d68-aaed-97e53c51a711/istio-proxy/0.log"
Sep 07 23:36:18.788463 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:18.788435    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-l2742_4f045744-26e7-4f82-b7cf-2b47e5500498/payload-pre-processing/0.log"
Sep 07 23:36:18.829677 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:18.829638    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79fdf4c694-bqmz4_a445422f-9995-4e11-88d9-b896c2070032/router/0.log"
Sep 07 23:36:19.453375 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:19.453342    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zqpbc_d155f254-2c44-4d90-97d8-e182e06fbee7/serve-healthcheck-canary/0.log"
Sep 07 23:36:19.920349 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:19.920318    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6n8kh_3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f/kube-rbac-proxy/0.log"
Sep 07 23:36:19.937966 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:19.937943    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6n8kh_3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f/exporter/0.log"
Sep 07 23:36:19.956283 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:19.956257    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6n8kh_3b6ea64b-8b0b-4c8c-ab99-bbbb6166356f/extractor/0.log"
Sep 07 23:36:22.113348 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:22.113311    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-6f7668fc86-ddnpt_2394c2ad-992d-490b-bf4f-88007dc38651/manager/0.log"
Sep 07 23:36:22.131089 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:22.131063    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-6f7668fc86-ddnpt_2394c2ad-992d-490b-bf4f-88007dc38651/copy-manifests/0.log"
Sep 07 23:36:23.279116 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:23.279090    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-c5599c49-jkt2m_d595e818-b29c-4164-8843-0d8f02c572eb/manager/0.log"
Sep 07 23:36:23.691203 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:23.691176    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p6296/perf-node-gather-daemonset-h4rmf"
Sep 07 23:36:23.937028 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:23.937000    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-765fd44cc-6zwpw_a9ae5d4e-f7a1-47df-8995-add30ed46b3d/manager/0.log"
Sep 07 23:36:23.965147 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:23.965069    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc_403c29f1-00d6-479c-ac66-6d657f541a53/istio-proxy/0.log"
Sep 07 23:36:23.981196 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:23.981168    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-bb7b75cc4-l68xn_3859e3ff-d62b-4a85-af0b-4c5ad27dc356/manager/0.log"
Sep 07 23:36:24.032779 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:24.032750    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g_53830593-eb6a-4d68-aaed-97e53c51a711/istio-proxy/0.log"
Sep 07 23:36:24.047228 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:24.047192    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-l2742_4f045744-26e7-4f82-b7cf-2b47e5500498/payload-pre-processing/0.log"
Sep 07 23:36:24.089476 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:24.089441    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79fdf4c694-bqmz4_a445422f-9995-4e11-88d9-b896c2070032/router/0.log"
Sep 07 23:36:25.146534 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:25.146505    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-msrrc_403c29f1-00d6-479c-ac66-6d657f541a53/istio-proxy/0.log"
Sep 07 23:36:25.239486 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:25.239404    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-9qx4g_53830593-eb6a-4d68-aaed-97e53c51a711/istio-proxy/0.log"
Sep 07 23:36:25.254059 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:25.254023    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-l2742_4f045744-26e7-4f82-b7cf-2b47e5500498/payload-pre-processing/0.log"
Sep 07 23:36:25.288470 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:25.288442    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79fdf4c694-bqmz4_a445422f-9995-4e11-88d9-b896c2070032/router/0.log"
Sep 07 23:36:28.877060 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:28.877029    2557 scope.go:117] "RemoveContainer" containerID="b5cc0f07b97497e401b3b930aef32397a10873684d09dc334fd85e93155784a8"
Sep 07 23:36:28.877436 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:36:28.877237    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5cfc59d48-rtk97_odh-ai-gateway-infra(ff64add8-1739-4ee5-a414-3f373f59e7ff)\"" pod="odh-ai-gateway-infra/maas-api-5cfc59d48-rtk97" podUID="ff64add8-1739-4ee5-a414-3f373f59e7ff"
Sep 07 23:36:28.925570 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:28.925540    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-pv274_170e899e-0597-4720-ba11-64ee6f4588b0/migrator/0.log"
Sep 07 23:36:28.942445 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:28.942416    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-pv274_170e899e-0597-4720-ba11-64ee6f4588b0/graceful-termination/0.log"
Sep 07 23:36:30.409791 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:30.409766    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6pkgd_5604f0be-842e-40a5-b8a4-677763cf9551/kube-multus-additional-cni-plugins/0.log"
Sep 07 23:36:30.427777 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:30.427752    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6pkgd_5604f0be-842e-40a5-b8a4-677763cf9551/egress-router-binary-copy/0.log"
Sep 07 23:36:30.446709 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:30.446667    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6pkgd_5604f0be-842e-40a5-b8a4-677763cf9551/cni-plugins/0.log"
Sep 07 23:36:30.464652 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:30.464631    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6pkgd_5604f0be-842e-40a5-b8a4-677763cf9551/bond-cni-plugin/0.log"
Sep 07 23:36:30.482006 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:30.481983    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6pkgd_5604f0be-842e-40a5-b8a4-677763cf9551/routeoverride-cni/0.log"
Sep 07 23:36:30.502370 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:30.502351    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6pkgd_5604f0be-842e-40a5-b8a4-677763cf9551/whereabouts-cni-bincopy/0.log"
Sep 07 23:36:30.518646 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:30.518619    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6pkgd_5604f0be-842e-40a5-b8a4-677763cf9551/whereabouts-cni/0.log"
Sep 07 23:36:30.680514 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:30.680410    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-drkf4_0af21eb1-139e-444e-809f-39e12274e7e6/kube-multus/0.log"
Sep 07 23:36:30.762406 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:30.762376    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9wwxc_a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff/network-metrics-daemon/0.log"
Sep 07 23:36:30.778090 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:30.778067    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9wwxc_a476ffa2-ceeb-4fee-b5b9-8e3ab2fd93ff/kube-rbac-proxy/0.log"
Sep 07 23:36:30.872059 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:30.872024    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:36:31.573104 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:31.573072    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/ovn-controller/0.log"
Sep 07 23:36:31.587618 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:31.587549    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/ovn-acl-logging/0.log"
Sep 07 23:36:31.587618 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:31.587595    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/ovn-acl-logging/1.log"
Sep 07 23:36:31.609540 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:31.609514    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/kube-rbac-proxy-node/0.log"
Sep 07 23:36:31.630175 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:31.630148    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/kube-rbac-proxy-ovn-metrics/0.log"
Sep 07 23:36:31.646533 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:31.646509    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/northd/0.log"
Sep 07 23:36:31.664350 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:31.664326    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/nbdb/0.log"
Sep 07 23:36:31.681169 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:31.681149    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/sbdb/0.log"
Sep 07 23:36:31.725568 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:31.725542    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dnn7j_ac46b891-0723-42df-a019-f593e45ce30e/ovnkube-controller/0.log"
Sep 07 23:36:31.763231 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:31.763202    2557 generic.go:356] "Generic (PLEG): container finished" podID="3a1408d9-6d74-4e69-9603-5320a8863bff" containerID="aef98aff22557489a6f210f6479f05427c30f36fbc5bddf3c8ba0125eaae89be" exitCode=1
Sep 07 23:36:31.763358 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:31.763281    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" event={"ID":"3a1408d9-6d74-4e69-9603-5320a8863bff","Type":"ContainerDied","Data":"aef98aff22557489a6f210f6479f05427c30f36fbc5bddf3c8ba0125eaae89be"}
Sep 07 23:36:31.763358 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:31.763338    2557 scope.go:117] "RemoveContainer" containerID="ac0482757be6d8f499a68811c20d2fe0d112e024152c8448bbae22753b403b63"
Sep 07 23:36:31.763775 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:31.763757    2557 scope.go:117] "RemoveContainer" containerID="aef98aff22557489a6f210f6479f05427c30f36fbc5bddf3c8ba0125eaae89be"
Sep 07 23:36:31.764025 ip-10-0-133-218 kubenswrapper[2557]: E0907 23:36:31.763993    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-687cff4559-pztg5_odh-ai-gateway-infra(3a1408d9-6d74-4e69-9603-5320a8863bff)\"" pod="odh-ai-gateway-infra/maas-api-687cff4559-pztg5" podUID="3a1408d9-6d74-4e69-9603-5320a8863bff"
Sep 07 23:36:33.077834 ip-10-0-133-218 kubenswrapper[2557]: I0907 23:36:33.077794    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-mtmmp_e11df460-0a45-48e5-a54f-a4e08ec31b19/network-check-target-container/0.log"